-- Logs begin at Thu 2022-05-12 05:49:18 UTC, end at Thu 2022-05-12 07:37:42 UTC. -- May 12 06:42:38.371303 dv-cinder-766064-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 06:42:38.378643 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 06:42:38 2022] *** May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: nodename: dv-cinder-766064-5-iscsi May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: machine: x86_64 May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: clock source: unix May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: pcre jit disabled May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: detected number of CPU cores: 4 May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: current working directory: / May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: detected binary path: /usr/bin/uwsgi-core May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: your processes number limit is 47680 May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: your memory page size is 4096 bytes May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: detected max file descriptor number: 2048 May 12 06:42:38.381910 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: lock engine: pthread robust mutexes May 12 06:42:38.382764 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: thunder lock: enabled May 12 06:42:38.382764 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 06:42:38.382764 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 06:42:38.427625 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: Python main interpreter initialized at 0x56466e1fc9c0 May 12 06:42:38.427625 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: python threads support enabled May 12 06:42:38.427625 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: your server socket listen backlog is limited to 100 connections May 12 06:42:38.427625 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: your mercy for graceful operations on workers is 90 seconds May 12 06:42:38.428032 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: mapped 403077 bytes (393 KB) for 2 cores May 12 06:42:38.428032 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: *** Operational MODE: preforking *** May 12 06:42:38.428308 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: *** uWSGI is running in multiple interpreter mode *** May 12 06:42:38.428308 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: spawned uWSGI master process (pid: 109674) May 12 06:42:38.428499 dv-cinder-766064-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 06:42:38.430770 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: spawned uWSGI worker 1 (pid: 109675, cores: 1) May 12 06:42:38.430770 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: spawned uWSGI worker 2 (pid: 109676, cores: 1) May 12 06:42:38.430770 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 06:42:39.623238 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 06:42:39.627843 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 06:42:40.351625 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:42:40.351625 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: from cryptography.utils import int_from_bytes May 12 06:42:40.351891 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:42:40.351891 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: from cryptography.utils import int_from_bytes May 12 06:42:40.354536 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:42:40.354536 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: from cryptography.utils import int_from_bytes May 12 06:42:40.354861 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:42:40.354861 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: from cryptography.utils import int_from_bytes May 12 06:42:42.916831 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 06:42:42.917393 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 06:42:42.917594 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 06:42:42.918232 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 06:42:42.918480 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 06:42:42.918865 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.919159 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 06:42:42.919531 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.919628 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 06:42:42.919742 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.919825 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.919953 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 06:42:42.920154 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.920312 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 06:42:42.920469 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.920555 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 06:42:42.920791 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.920941 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.921114 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.921268 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.921443 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.921590 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.921707 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.921906 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.922008 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.922236 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.922329 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-766064-5-iscsi {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.922552 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.922637 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.922869 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.922966 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.923189 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.923281 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.923539 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.923640 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.923858 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.923943 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.924127 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.924214 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.924454 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-766064-5-iscsi {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.924560 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.924775 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.924993 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.925103 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.926139 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.926275 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.926383 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.926522 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.926644 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.926765 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.926885 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.927013 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.927144 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.927274 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.927274 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.927502 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.927636 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.927788 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.927921 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.928052 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.928173 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.928300 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.928421 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.928553 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.928684 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.928822 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-766064-5-iscsi {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.928951 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.929079 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.929207 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.929328 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.929500 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.929630 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.929800 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.929933 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.930104 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.930238 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.930495 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-766064-5-iscsi {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.930639 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.930812 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.930991 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.931115 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.931234 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.931426 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.931552 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.931778 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.931944 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.932105 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.932250 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.932425 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.932555 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.932746 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.932879 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.933049 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.933177 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.933358 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.933485 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.933673 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.933799 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.933989 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.934122 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.934294 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.934444 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.934599 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.934734 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.934865 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.934994 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.935147 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.935279 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.935468 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.935607 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.935814 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.935942 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.936119 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.936251 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.936378 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.936510 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.936640 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.936764 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.936925 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.937052 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.937247 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.937382 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.937557 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.937689 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.937865 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.937992 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.938123 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.938243 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.938364 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.938498 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.938652 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.938787 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.938971 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.939098 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.939305 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.939430 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.939612 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.939778 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.939943 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.940069 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.940250 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.940382 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.940556 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.940694 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.940860 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.940997 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.941162 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.941288 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.941482 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.941619 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.941787 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.941924 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.942099 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.942224 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.942420 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.942553 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.942731 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.942855 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.943048 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.943173 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.943365 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.943494 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.943675 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.943819 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.944005 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.944133 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.944312 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.944442 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.944623 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.944760 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.944939 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.945071 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.945260 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.945389 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.945563 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.945654 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.945816 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.945907 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.946122 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.946208 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.946428 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.946515 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.946749 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.946844 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.947056 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.947143 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.947355 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.947447 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.947607 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.947728 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.947940 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.948043 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.948245 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.948333 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.948562 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.948659 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.948861 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.948948 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.949170 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.949267 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.949472 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.949657 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.949770 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.949856 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.950071 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.950169 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.950376 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.950464 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.950679 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.950766 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.950980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.951064 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.951283 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.951378 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.951586 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.951679 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.951916 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.952038 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.952221 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.952311 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.952528 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.952621 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.952843 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.952927 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.953149 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.953236 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.953452 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.953544 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.953756 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.953842 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.954054 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.954160 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.954360 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.954455 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.955183 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.955328 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.955493 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.955623 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.955826 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.955954 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.956149 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.956284 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.956452 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.956577 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.956753 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.956876 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.957068 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.957202 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.957377 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.957501 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.957735 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.957857 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.957984 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.958110 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.958282 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.958400 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.958600 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.958722 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.958891 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.959018 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.959195 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.959313 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.959499 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.959637 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.959870 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.960001 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.960109 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.960213 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.960402 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.960531 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.960705 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.960841 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.961006 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.961132 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.961308 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.961434 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.961606 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.961740 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.961923 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.962048 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.962243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.962368 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.962552 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.962678 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.962860 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.962988 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.963171 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.963295 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.963488 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:42:42.963615 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.963858 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.963986 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.964190 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.964316 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.964519 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.964644 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.964831 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.964963 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.965149 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.965286 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.965463 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.965590 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.965777 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.965903 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.966084 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.966217 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.966399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.966525 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.966724 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.966850 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.967035 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.967171 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.967344 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.967501 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.967641 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.967784 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.967983 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.968122 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.968301 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.968426 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.968644 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.968770 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.968943 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.969077 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.969255 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.969380 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.969569 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.969693 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.969882 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.970018 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.970197 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.970290 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.971097 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.971198 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.971420 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.971512 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.971752 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.971842 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.972070 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.972156 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.972388 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.972478 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.972717 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.972810 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.973045 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.973131 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.973359 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.973462 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.973669 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.973755 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.973980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.974075 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.974287 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.974382 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.974601 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.974695 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.974920 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.975020 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.975230 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.975324 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.975549 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.975646 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.975886 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.975994 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.976200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.976288 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.976513 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.976600 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.976825 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.976920 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.977137 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.977224 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.977452 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.977537 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.977769 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.977869 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.978079 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.978166 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.978388 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.978475 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.978698 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.978814 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.979010 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.979108 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.979313 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.979399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.979622 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.979734 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.979953 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.980037 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.980257 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.980354 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.980560 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.980648 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.980866 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.980954 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.981167 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.981261 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.981486 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.981583 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.981800 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.981893 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.982107 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.982193 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.982420 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.982507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.982727 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.982812 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.983033 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.983127 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.983339 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.983435 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.983646 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.983755 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.983975 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.984077 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.984285 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.984381 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.984594 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.984689 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.984898 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.984995 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.985211 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.985299 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.985516 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.985612 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.985821 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.985917 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.986162 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.986248 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.986476 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.986570 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.986780 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.986857 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.987098 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.987266 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.987412 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.987561 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.987750 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.987896 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.988032 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.988175 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.988311 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.988457 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.988632 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.988776 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.988942 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.989087 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.989256 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.989401 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.989590 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.989734 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.989910 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.990070 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.990277 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.990427 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.990583 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.990719 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.990855 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.990992 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.991668 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.991865 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.992012 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.992156 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.992295 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.992438 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.992587 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.992724 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.992876 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.993021 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.993159 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.993301 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.993301 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.993577 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.993743 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.993880 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.994015 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.994159 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.994303 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.994440 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.994576 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.994721 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.994864 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.995009 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.995153 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.995296 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.995440 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.995608 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.995794 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.995945 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.996083 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.996219 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.996361 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.996506 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.996654 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.996799 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.996935 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.997071 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.997206 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.997349 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.997494 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.997633 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.997768 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.997912 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.998055 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.998191 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.998344 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.998481 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.998625 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.998761 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.998896 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.999047 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.999192 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.999329 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.999472 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.999609 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.999786 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:42.999926 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.000142 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.000315 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.000463 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.000599 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.000735 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.000869 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.001017 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.001160 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.001364 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.001506 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.001648 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.001799 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.001937 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.002080 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.002234 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.002378 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.002525 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.002670 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.002807 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.002951 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.003086 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.003227 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.003364 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.003508 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.003646 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.003817 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.003964 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.004112 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.004248 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.004392 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.004529 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.004707 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.004853 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.005022 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.005175 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.005336 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.005484 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.005649 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.005798 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.005959 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.006120 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.006265 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.006400 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.006571 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.006724 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.006891 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.007042 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.007204 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.007355 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.007523 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.007666 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.007861 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.008028 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.008172 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.008306 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.008486 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.008629 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.008797 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.008949 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.009095 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.009231 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.009407 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.009551 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.009717 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.009861 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.010007 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.010150 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.010316 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.010467 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.010612 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.010757 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.010902 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.011045 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.011205 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.011348 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.011500 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.011637 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.011826 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.011987 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.012123 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.012272 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.012408 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.012543 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.012715 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.012858 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.013030 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.013182 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.013320 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.013456 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.013626 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.013776 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.013930 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.014074 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.014218 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.014390 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.014531 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.014676 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.014812 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.014981 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.015123 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.015258 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.015433 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.015575 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.015765 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.015933 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.016072 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.016216 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.016378 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.016521 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.016671 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.016807 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.016974 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.017117 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.017800 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.017951 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.018107 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.018261 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.018432 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.018581 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.018724 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.018872 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.019023 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.019178 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.019386 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.019536 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.019679 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.019869 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.020024 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.020175 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.020336 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.020479 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.020622 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.020773 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.020916 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.021058 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.021208 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.021351 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.021493 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.021645 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.021796 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.021938 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.022087 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.022241 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.022382 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.022533 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.022677 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.022828 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.022980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.023123 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.023265 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.023416 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.023559 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.023724 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.023874 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.024133 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.024307 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.024453 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.024595 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.024737 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.024879 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.025035 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.025186 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.025389 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.025574 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.025723 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.025906 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.026056 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.026217 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.026361 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.026524 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.026674 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.026825 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.027047 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.027205 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.027357 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.027507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.027650 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.027854 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.027999 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.028152 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.028323 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.028480 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.028623 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.028772 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.028931 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.029075 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.029217 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.029368 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.029511 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.029655 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.029797 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.029940 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.030083 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.030244 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.030396 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.030540 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.030682 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.030825 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.030975 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.031119 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.031269 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.031419 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.031561 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.031726 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.031886 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.032031 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.032189 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.032332 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.032482 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.032633 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.032788 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.033515 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.033667 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.033812 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.033953 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.034096 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.034249 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.034393 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.034553 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.034697 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.034839 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.034990 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.035134 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.035277 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.035427 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.035569 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.035776 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.035945 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.036091 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.036234 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.036377 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.036531 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.036682 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.036835 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.036979 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.037122 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.037264 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.037408 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.037558 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.037702 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.037845 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.037987 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.038136 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.038290 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.038451 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.038596 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.038738 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.038880 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.039029 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.039172 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.039346 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.039528 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.039673 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.039857 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.040000 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.040143 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.040310 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.040454 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.040604 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.040755 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.040899 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.041042 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.041192 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.041335 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.041478 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.041621 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.041771 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.041923 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.042066 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.042225 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.042368 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.042510 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.042653 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.043056 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.043200 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.043342 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.043493 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.043636 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.043816 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.043970 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.044114 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.044257 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.044409 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.044551 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.044695 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.044850 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.044994 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.045137 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.045280 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.045422 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.045572 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.045716 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.045857 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.046007 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.046149 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.046308 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.046459 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.046603 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.046745 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.046895 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.047037 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.047179 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.047333 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.047476 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.047619 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.047799 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.047799 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.048083 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.048246 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.048408 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.048561 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.048703 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.048846 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.048995 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.049146 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.049288 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.049429 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.049629 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.049778 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.049928 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.050091 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.050234 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.050521 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.050670 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.050812 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.050963 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.051114 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.051410 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.051562 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.051753 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.051905 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.052060 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.052309 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.052479 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.052658 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.052806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.053022 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.053169 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.053318 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.053587 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.053736 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.053949 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.054112 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.054256 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.054472 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.054621 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.054784 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.054927 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.055103 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.055255 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.055405 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.055555 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.055732 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.055894 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.056050 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.056200 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.056352 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.056496 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.056638 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.056798 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.056983 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.057134 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.057291 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.057434 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.057576 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.057731 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.057874 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.058016 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.058189 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.058342 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.058484 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.058632 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.058789 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.058931 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.059072 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.059214 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.059387 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.059545 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.059714 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.059864 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.060030 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.060180 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.060335 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.060478 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.060632 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.060781 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.060925 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.061066 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.061216 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.061359 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.061524 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.061675 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.061818 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.061960 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.062139 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.062290 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.062457 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.062620 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.062763 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.062903 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.063054 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.063197 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.063346 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.063488 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.063632 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.063846 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.064001 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.064687 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.064836 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.064978 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.065131 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.065281 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.065425 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.065567 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.065716 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.065858 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.066001 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.066150 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.066299 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.066442 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.066584 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.066726 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.066867 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.067028 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.067173 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.067340 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.067491 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.067658 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.067842 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.067987 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.068128 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.068304 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.068455 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.068619 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.068787 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.068943 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.069086 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.069228 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.069377 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.069519 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.069670 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.069956 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.070106 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.070273 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.070422 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.070586 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.070742 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.070886 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.071039 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.071182 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.071323 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.071473 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.071622 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.071835 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.071980 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.072133 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.072276 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.072430 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.072572 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.072715 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.072862 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.073016 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.073159 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.073333 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.073492 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.073634 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.073776 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.073959 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.074110 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.074261 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.074402 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.074576 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.074726 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.074885 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.075039 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.075184 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.075382 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.075532 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.075721 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.075887 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.076109 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.076259 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.076408 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.076687 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.076837 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.077130 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.077297 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.077442 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.077736 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.077886 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.078152 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.078301 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.078457 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.078600 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.078764 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.078913 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.079088 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.079324 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.079480 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.079634 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.080355 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.080504 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.080647 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.080789 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.080961 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.081112 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.081269 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.081414 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.081586 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.081736 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.081910 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.082069 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.082224 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.082366 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.082619 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.082769 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.082997 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.083156 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.083299 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.083440 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.083628 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.083836 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.083991 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.084141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.084303 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.084446 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.084590 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.084740 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.084895 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.085002 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.085182 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.085317 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.085494 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.085641 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.085821 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.085968 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.086131 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.086276 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.086446 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.086582 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.086761 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.086892 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.087073 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.087200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.087381 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.087505 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.087716 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.087855 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.088039 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.088163 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.088349 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.088476 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.088677 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.088770 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.088996 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.089087 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.089321 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.089421 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.089644 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.089733 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.089968 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.090056 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.090272 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.090367 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.090594 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.090683 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.090902 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.090990 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.091215 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.091395 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.091542 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.091701 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.091851 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.091994 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.092170 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.092336 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.092481 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.092630 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.092774 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.092916 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.093068 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.093219 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.093370 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.093513 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.093686 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.093838 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.094059 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.094212 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.094366 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.094516 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.094659 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.094800 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.094953 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.095097 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.095240 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.095423 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.095630 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.095827 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.096006 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.096305 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.096456 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.096617 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.096803 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.096962 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.097209 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.097373 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.097517 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.097705 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.097870 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.098023 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.098167 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.098309 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.098451 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.098604 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.098746 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.098906 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.099050 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.099192 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.099344 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.099487 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.099637 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.099837 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.099983 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.100126 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.100269 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.100422 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.100585 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.100730 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.100904 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.101059 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.101203 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.101347 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.101498 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.101642 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.101796 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.101947 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.102090 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.102233 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.102384 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.102539 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.102712 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.102863 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.103034 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.103196 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.103340 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.103484 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.103659 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.103861 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.104005 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.104160 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.104311 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.104456 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.104608 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.104752 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.104894 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.105049 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.105200 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.105350 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.105521 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.105672 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.105837 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.106002 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.106146 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.106289 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.106442 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.106669 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.106829 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.107000 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.107157 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.107307 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.107459 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.107602 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.107783 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.107929 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.108073 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.108242 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.108393 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.108546 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.108698 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.108842 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.109083 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.109234 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.109414 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.109571 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.109726 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.109877 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.110022 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.110164 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.110308 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.110473 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.110626 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.110772 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.110937 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.111087 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.111231 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.111382 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.111541 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.111735 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.111898 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.112043 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.112194 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.112352 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.112513 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.112657 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.112805 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.112956 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.113108 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.113253 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.113404 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.113547 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.113712 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.113870 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.114025 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.114185 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.114337 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.114481 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.114622 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.114778 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.114970 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.115125 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.115270 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.115412 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.115582 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.115770 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.115920 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.116074 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.116225 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.116368 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.116519 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.116662 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.116805 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.116946 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.117097 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.117240 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.117413 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.117564 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.117708 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.117868 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.118029 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.118174 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.118326 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.118470 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.118620 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.118903 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.119061 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.119205 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.119355 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.119539 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.119726 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.119878 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.120031 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.120186 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.120404 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.120556 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.120699 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.120847 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.121001 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.121154 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.121298 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.121441 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.121593 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.121736 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.121903 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.122073 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.122218 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.122370 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.122539 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.122689 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.122908 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.123054 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.123197 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.123340 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.123491 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.123634 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.123823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.123979 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.124124 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.124267 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.124410 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.124663 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.124824 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.124967 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.125108 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.125290 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.125442 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.125585 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.125736 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.125880 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.126040 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.126191 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.126335 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.126491 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.127237 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.127382 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.127525 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.127712 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.127894 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.128058 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.128203 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.128345 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.128524 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.128687 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.128852 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.129016 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.129168 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.129312 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.129470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.129616 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.129761 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.129913 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.130064 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.130207 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.130350 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.130503 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.130655 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.130800 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.130943 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.131099 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.131243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.131392 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.131556 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.131758 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.131910 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.132053 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.132196 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.132339 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.132505 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.132649 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.132794 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.132936 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.133079 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.133220 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.133372 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.133522 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.133666 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.133809 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.133952 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.134104 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.134247 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.134400 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.134545 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.134687 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.134829 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.134980 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.135124 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.135276 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.135420 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.135571 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.135738 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.135903 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.136050 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.136192 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.136350 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.136493 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.136635 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.136791 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.136942 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.137086 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.137229 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.137378 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.137530 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.137673 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.137824 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.137975 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.138120 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.138272 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.138428 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.138620 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.138772 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.138922 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.139068 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.139258 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.139455 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.139607 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.139886 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.140040 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.140184 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.140347 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.140504 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.140655 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.140824 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.140983 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.141127 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.141279 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.141431 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.141656 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.141812 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.141990 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.142160 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.142898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.143060 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.143203 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.143347 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.143516 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.143667 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.143970 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.144117 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.144259 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.144404 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.144545 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.144688 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.144839 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.145001 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.145144 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.145288 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.145432 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.145583 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.145727 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.145869 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.146019 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.146162 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.146312 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.146465 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.146608 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.146750 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.146910 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.147054 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.147206 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.147362 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.147506 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.147657 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.147827 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.147971 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.148129 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.148274 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.148424 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.148575 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.148729 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.148873 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.149024 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.149214 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.149357 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.149498 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.149641 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.149782 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.149938 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.150081 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.150263 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.150417 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.150569 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.150737 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.150883 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.151026 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.151169 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.151343 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.151490 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.151646 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.151817 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.151970 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.152113 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.152257 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.152441 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.152677 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.152825 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.152968 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.153111 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.153254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.153406 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.153548 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.153692 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.153835 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.153978 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.154121 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.154272 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.154427 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.154571 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.154722 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.154875 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.155020 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.155172 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.155316 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.155459 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.155601 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.155784 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.155945 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.156090 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.156234 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.156388 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.156538 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.156681 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.156833 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.156986 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.157137 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.157281 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.157425 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.157576 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.157728 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.157899 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.158045 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.158198 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.158342 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.158485 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.158642 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.158787 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.158930 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.159074 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.159216 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.159368 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.159512 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.159654 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.159835 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.159936 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.160078 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.160239 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.160385 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.160543 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.160692 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.160846 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.160998 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.161153 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.161308 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.161460 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.161616 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.161773 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.161924 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.162091 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.162244 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.162388 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.162531 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.162673 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.162828 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.162972 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.163121 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.163269 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.163440 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.163591 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.163772 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.163923 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.164077 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.164225 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.164370 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.164513 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.164665 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.164808 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.164983 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.165134 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.165314 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.165469 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.165622 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.165771 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.165925 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.166068 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.166210 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.166363 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.166530 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.166680 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.166830 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.167014 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.167167 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.167324 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.167477 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.167620 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.168073 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.168238 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.168383 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.168538 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.168683 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.168824 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.168966 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.169107 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.169262 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.169406 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.169550 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.169691 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.169835 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.169977 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.170142 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.170286 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.170439 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.170590 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.170735 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.170877 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.171030 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.171174 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.171317 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.171459 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.171603 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.171822 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.171980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.172124 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.172269 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.172425 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.172569 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.172721 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.172865 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.173008 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.173158 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.173305 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.173474 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.173628 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.173790 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.173934 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.174076 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.174242 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.174403 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.174561 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.174706 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.174884 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.175037 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.175238 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.175398 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.175542 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.175715 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.175911 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.176073 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.176225 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.176381 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.176534 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.176684 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.176828 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.176977 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.177120 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.177277 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.177421 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 06:42:43.177572 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.177811 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.178125 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.178437 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.178743 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:42:43.178985 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 06:42:43.200909 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_db.sqlalchemy.engines [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:42:43.202666 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG oslo_db.sqlalchemy.engines [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:42:43.263236 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.context [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58(cell1) {{(pid=109675) load_cells /opt/stack/nova/nova/context.py:464}} May 12 06:42:43.266546 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.context [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58(cell1) {{(pid=109676) load_cells /opt/stack/nova/nova/context.py:464}} May 12 06:42:43.268119 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:42:43.269692 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:42:43.270464 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:42:43.271605 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG oslo_concurrency.lockutils [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:42:43.272395 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:42:43.273217 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG oslo_concurrency.lockutils [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:42:43.273998 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG oslo_concurrency.lockutils [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:42:43.276060 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG oslo_concurrency.lockutils [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:42:43.283881 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_db.sqlalchemy.engines [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:42:43.284764 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_db.sqlalchemy.engines [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:42:43.289458 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG oslo_db.sqlalchemy.engines [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:42:43.293405 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG oslo_db.sqlalchemy.engines [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:42:43.443451 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_db.sqlalchemy.engines [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:42:43.451630 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG oslo_db.sqlalchemy.engines [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:42:43.878745 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: WARNING keystonemiddleware.auth_token [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 06:42:43.886976 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: WARNING keystonemiddleware.auth_token [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 06:42:43.918539 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: WARNING keystonemiddleware.auth_token [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 06:42:43.926034 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: WARNING keystonemiddleware.auth_token [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 06:42:44.229925 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: WARNING keystonemiddleware.auth_token [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 06:42:44.236535 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: WARNING keystonemiddleware.auth_token [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 06:42:44.242485 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56466e1fc9c0 pid: 109675 (default app) May 12 06:42:44.248816 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:42:44.248816 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 May 12 06:42:44.248816 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Thu May 12 06:42:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:42:44.273531 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: WARNING keystonemiddleware.auth_token [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 06:42:44.279640 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: WARNING keystonemiddleware.auth_token [None req-e89e59fd-aec2-470e-bcf6-74579ce8837e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 06:42:44.286345 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56466e1fc9c0 pid: 109676 (default app) May 12 06:44:04.336354 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:04.337436 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 May 12 06:44:04.337845 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:04.752697 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-dca69197-5629-4466-867e-e7497ee23d5f admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:04.782202 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-dca69197-5629-4466-867e-e7497ee23d5f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.436838 May 12 06:44:04.782872 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1291 bytes} [Thu May 12 06:44:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:44:07.058437 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:07.059443 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-041b3cdb-e48e-4cd8-87d8-e80a967af6cc None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 12 06:44:07.060410 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:07.124878 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-5d761b22-3875-4fa4-86b1-e1f261beb2d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:07.143561 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:44:07.143561 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: warnings.warn(msg) May 12 06:44:07.277854 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-5d761b22-3875-4fa4-86b1-e1f261beb2d4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.211733 May 12 06:44:07.278544 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 12 06:44:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:44:07.491830 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-d63e0425-4d26-4ae6-a0be-3a4818bdbcaa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:07.494259 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:44:07.494259 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: warnings.warn(msg) May 12 06:44:07.601125 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-d63e0425-4d26-4ae6-a0be-3a4818bdbcaa admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.314531 May 12 06:44:07.610389 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1335 bytes} [Thu May 12 06:44:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:44:09.881712 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-5d761b22-3875-4fa4-86b1-e1f261beb2d4 admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:09.883059 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-5d761b22-3875-4fa4-86b1-e1f261beb2d4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001850 May 12 06:44:09.883543 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:09.990701 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-b69fd8e1-4d75-4488-9a36-0604b03f866f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:10.009537 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:44:10.009537 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: warnings.warn(msg) May 12 06:44:10.126916 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-b69fd8e1-4d75-4488-9a36-0604b03f866f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.237308 May 12 06:44:10.127414 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 12 06:44:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:44:10.139236 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-2cf64739-ef7f-4819-9583-8167b601fcee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:10.140739 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:44:10.140739 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: warnings.warn(msg) May 12 06:44:10.240050 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-2cf64739-ef7f-4819-9583-8167b601fcee admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104443 May 12 06:44:10.240806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1335 bytes} [Thu May 12 06:44:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:44:12.519484 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-b69fd8e1-4d75-4488-9a36-0604b03f866f admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:12.520583 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-b69fd8e1-4d75-4488-9a36-0604b03f866f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 May 12 06:44:12.521193 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:12.585643 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-2063c051-9bb9-46a9-bc5c-f97f458c5f67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:12.669297 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-2063c051-9bb9-46a9-bc5c-f97f458c5f67 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142028 May 12 06:44:12.675884 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 12 06:44:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:44:12.682032 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-bd61039d-7692-4877-af02-1a6afa4cd493 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:12.755634 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-bd61039d-7692-4877-af02-1a6afa4cd493 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077460 May 12 06:44:12.756955 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1335 bytes} [Thu May 12 06:44:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:44:15.036916 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-2063c051-9bb9-46a9-bc5c-f97f458c5f67 admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:15.037933 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-2063c051-9bb9-46a9-bc5c-f97f458c5f67 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 12 06:44:15.038334 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:15.097113 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-633dab1d-bd79-456d-972b-e7401b062e46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:15.180901 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-633dab1d-bd79-456d-972b-e7401b062e46 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135477 May 12 06:44:15.181453 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 12 06:44:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:44:15.193551 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-f9b77ced-0e40-46f6-afcf-1413bc85adef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:15.269933 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-f9b77ced-0e40-46f6-afcf-1413bc85adef admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080044 May 12 06:44:15.270602 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1335 bytes} [Thu May 12 06:44:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:44:17.523912 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-633dab1d-bd79-456d-972b-e7401b062e46 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:17.524942 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-633dab1d-bd79-456d-972b-e7401b062e46 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 May 12 06:44:17.525335 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:17.583581 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-099ea6ac-ae2c-4ebe-b1ae-2f05b05373e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "disk": 20, "name": "ds4G", "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:17.660073 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-099ea6ac-ae2c-4ebe-b1ae-2f05b05373e7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.129105 May 12 06:44:17.661123 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 12 06:44:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:44:17.673354 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-f86ffb1c-1996-4087-b551-e7271e29ccbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:17.752484 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-f86ffb1c-1996-4087-b551-e7271e29ccbc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082784 May 12 06:44:17.753171 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1335 bytes} [Thu May 12 06:44:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:44:20.012475 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-099ea6ac-ae2c-4ebe-b1ae-2f05b05373e7 admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:20.013491 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-099ea6ac-ae2c-4ebe-b1ae-2f05b05373e7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 12 06:44:20.014070 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:20.078866 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-89501fc9-1a77-416c-b166-c7f276813cd7 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:20.101931 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-89501fc9-1a77-416c-b166-c7f276813cd7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081944 May 12 06:44:20.102873 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1291 bytes} [Thu May 12 06:44:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:44:22.518971 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-099ea6ac-ae2c-4ebe-b1ae-2f05b05373e7 admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:22.520036 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-099ea6ac-ae2c-4ebe-b1ae-2f05b05373e7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 12 06:44:22.520440 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:44:22.591947 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-b7724d95-c644-45c5-ac28-f4694e28550a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:22.668230 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-b7724d95-c644-45c5-ac28-f4694e28550a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.141974 May 12 06:44:22.669435 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 12 06:44:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:44:22.681964 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-095718a3-b387-4d5b-b169-0cb0fbcd40c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:22.751145 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-095718a3-b387-4d5b-b169-0cb0fbcd40c1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073039 May 12 06:44:22.751985 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1332 bytes} [Thu May 12 06:44:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:44:25.062439 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-b7724d95-c644-45c5-ac28-f4694e28550a admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:25.063559 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-b7724d95-c644-45c5-ac28-f4694e28550a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 May 12 06:44:25.064015 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:25.127078 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-46aa5465-dcaa-4da6-8463-cbc3aab54476 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "swap": 0, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:25.209070 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-46aa5465-dcaa-4da6-8463-cbc3aab54476 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.139162 May 12 06:44:25.209720 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 12 06:44:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:44:25.221210 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-77148747-f670-41fc-be35-c1c53164da82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:25.300466 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-77148747-f670-41fc-be35-c1c53164da82 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082833 May 12 06:44:25.300969 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1332 bytes} [Thu May 12 06:44:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:44:27.672809 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-46aa5465-dcaa-4da6-8463-cbc3aab54476 admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:27.673831 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-46aa5465-dcaa-4da6-8463-cbc3aab54476 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 12 06:44:27.674274 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:27.732416 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-62e202ec-be58-4479-8f04-f463b779505b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "id": "3"}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:27.816102 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-62e202ec-be58-4479-8f04-f463b779505b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.135987 May 12 06:44:27.823341 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 12 06:44:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:44:27.829264 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-0b7cb145-da5a-4420-914d-1a9fba657beb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:27.974766 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-0b7cb145-da5a-4420-914d-1a9fba657beb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.149033 May 12 06:44:27.975429 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1332 bytes} [Thu May 12 06:44:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:44:30.226573 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-62e202ec-be58-4479-8f04-f463b779505b admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:30.228457 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-62e202ec-be58-4479-8f04-f463b779505b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002316 May 12 06:44:30.228866 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:30.284169 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-94619c66-a5c0-48cd-8907-e59a264479b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:30.387568 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-94619c66-a5c0-48cd-8907-e59a264479b7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.151617 May 12 06:44:30.388146 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 12 06:44:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:44:30.399641 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-38f7351c-4662-4be8-97a3-b969bfafe4cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:30.487827 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-38f7351c-4662-4be8-97a3-b969bfafe4cf admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091779 May 12 06:44:30.488417 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1332 bytes} [Thu May 12 06:44:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:44:32.819315 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-94619c66-a5c0-48cd-8907-e59a264479b7 admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:32.828442 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-94619c66-a5c0-48cd-8907-e59a264479b7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 May 12 06:44:32.828442 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:44:32.883293 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-8e08fe82-ec9a-4693-a38f-22684daf6a94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "swap": 0, "vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:32.988535 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-8e08fe82-ec9a-4693-a38f-22684daf6a94 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.158563 May 12 06:44:32.989680 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 12 06:44:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:44:33.010630 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-fc18a039-db87-43f9-bcdb-098a01b0c226 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:44:33.089024 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-fc18a039-db87-43f9-bcdb-098a01b0c226 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083574 May 12 06:44:33.089959 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1332 bytes} [Thu May 12 06:44:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:44:57.221275 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-8e08fe82-ec9a-4693-a38f-22684daf6a94 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:57.222277 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-8e08fe82-ec9a-4693-a38f-22684daf6a94 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 12 06:44:57.222667 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:44:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:57.278504 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-df0d5dd0-145c-45eb-95dd-929d76c8f0f5 admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:57.297265 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-df0d5dd0-145c-45eb-95dd-929d76c8f0f5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068805 May 12 06:44:57.297803 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1291 bytes} [Thu May 12 06:44:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:44:58.291276 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-8e08fe82-ec9a-4693-a38f-22684daf6a94 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:58.293089 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-8e08fe82-ec9a-4693-a38f-22684daf6a94 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002222 May 12 06:44:58.293489 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:44:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:58.498860 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-bc7f2031-df6d-4586-8d9d-e8a8dbb6656f admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:58.504384 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.wsgi [None req-bc7f2031-df6d-4586-8d9d-e8a8dbb6656f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-bc7f2031-df6d-4586-8d9d-e8a8dbb6656f admin admin] Request method failure captured: May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Accept: application/json May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Accept-Encoding: gzip, deflate May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Connection: keep-alive May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Content-Length: 0 May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Host: 10.222.0.25 May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Openstack-Api-Version: compute 2.90 May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Openstack-System-Scope: None May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: User-Agent: python-novaclient May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Auth-Token: gAAAAABifKzqsPOHI8FmdEefiPyY2v-AA8OUTLVaQt36z30dsV_xXntYJX5Kp0qGmXdu2Osnzfw_Z_NWYsVuiII4jj5agUC-idkAozfHw0t-eIGAhxneErC2R2GY5CXpDXCMezE_Jotain-R0MSR58viJj66MUuf1EFDT1nP6aSUE8D10pjU7lE May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Domain-Id: None May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Domain-Name: None May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Identity-Status: Confirmed May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Is-Admin-Project: True May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Openstack-Nova-Api-Version: 2.90 May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Domain-Id: default May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Domain-Name: Default May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Name: admin May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Role: reader,admin,member May 12 06:44:58.507507 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Roles: reader,admin,member May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce2018cacb6f4eb3a54694e57a783679", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce2018cacb6f4eb3a54694e57a783679"}]}] May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Tenant: admin May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Tenant-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Tenant-Name: admin May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User: admin May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Domain-Id: default May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Domain-Name: Default May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Id: 79cb9f096a814d81a7a9552741bc1a1f May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Name: admin May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: method: > May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: exception: Flavor 42 could not be found. May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: action_args: {'id': '42'} May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:44:58.509200 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:44:58.510470 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:44:58.511980 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-bc7f2031-df6d-4586-8d9d-e8a8dbb6656f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:44:58.513278 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-bc7f2031-df6d-4586-8d9d-e8a8dbb6656f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060943 May 12 06:44:58.513278 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Thu May 12 06:44:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 06:44:58.518472 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-dbdfe491-875e-43f4-9797-a86565d88a94 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:58.540300 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-dbdfe491-875e-43f4-9797-a86565d88a94 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025324 May 12 06:44:58.540822 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Thu May 12 06:44:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:44:58.554523 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-6af12e38-ffb3-400e-b98c-0f32790f3eff admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:58.575154 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-6af12e38-ffb3-400e-b98c-0f32790f3eff admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024127 May 12 06:44:58.575678 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Thu May 12 06:44:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:44:58.584547 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-8720c75f-71be-43a2-a404-2178c3a4caa4 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:58.590420 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.wsgi [None req-8720c75f-71be-43a2-a404-2178c3a4caa4 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-8720c75f-71be-43a2-a404-2178c3a4caa4 admin admin] Request method failure captured: May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Accept: application/json May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Accept-Encoding: gzip, deflate May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Connection: keep-alive May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Content-Length: 0 May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Host: 10.222.0.25 May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Openstack-Api-Version: compute 2.90 May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Openstack-System-Scope: None May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: User-Agent: python-novaclient May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Auth-Token: gAAAAABifKzqsPOHI8FmdEefiPyY2v-AA8OUTLVaQt36z30dsV_xXntYJX5Kp0qGmXdu2Osnzfw_Z_NWYsVuiII4jj5agUC-idkAozfHw0t-eIGAhxneErC2R2GY5CXpDXCMezE_Jotain-R0MSR58viJj66MUuf1EFDT1nP6aSUE8D10pjU7lE May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Domain-Id: None May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Domain-Name: None May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Identity-Status: Confirmed May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Is-Admin-Project: True May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Openstack-Nova-Api-Version: 2.90 May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Domain-Id: default May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Domain-Name: Default May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Name: admin May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Role: reader,admin,member May 12 06:44:58.593647 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Roles: reader,admin,member May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce2018cacb6f4eb3a54694e57a783679", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce2018cacb6f4eb3a54694e57a783679"}]}] May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Tenant: admin May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Tenant-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Tenant-Name: admin May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User: admin May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Domain-Id: default May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Domain-Name: Default May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Id: 79cb9f096a814d81a7a9552741bc1a1f May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Name: admin May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: method: > May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: exception: Flavor 42 could not be found. May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: action_args: {'id': '42'} May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:44:58.595222 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:44:58.596187 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:44:58.597254 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-8720c75f-71be-43a2-a404-2178c3a4caa4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:44:58.598299 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-8720c75f-71be-43a2-a404-2178c3a4caa4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013890 May 12 06:44:58.598299 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Thu May 12 06:44:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 06:44:59.480483 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-6af12e38-ffb3-400e-b98c-0f32790f3eff admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:59.481486 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-6af12e38-ffb3-400e-b98c-0f32790f3eff admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 12 06:44:59.481879 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:44:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:44:59.666109 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-854415ee-a183-459c-bbb1-593bd97516f4 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:59.672107 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.wsgi [None req-854415ee-a183-459c-bbb1-593bd97516f4 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-854415ee-a183-459c-bbb1-593bd97516f4 admin admin] Request method failure captured: May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Accept: application/json May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Accept-Encoding: gzip, deflate May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Connection: keep-alive May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Content-Length: 0 May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Host: 10.222.0.25 May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Openstack-Api-Version: compute 2.90 May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Openstack-System-Scope: None May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: User-Agent: python-novaclient May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Auth-Token: gAAAAABifKzr_LNTALJVedLQIhVo-_1eW3sg2p8gwz-nkeEIP1BHexR-P0XIkdbIYrlNtVm08c0BrCYOTZ1-adCNI1_heac1wWOoNTIuGQLJLVdh7qUTZe8BJlgH04si9cPYSywifMm3qSab3WBcNFAErI_RKmb7Zx2qJOZWyQu1BURruwOL7zI May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Domain-Id: None May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Domain-Name: None May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Identity-Status: Confirmed May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Is-Admin-Project: True May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Openstack-Nova-Api-Version: 2.90 May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Domain-Id: default May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Domain-Name: Default May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Name: admin May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Role: reader,admin,member May 12 06:44:59.673603 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Roles: reader,admin,member May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce2018cacb6f4eb3a54694e57a783679", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce2018cacb6f4eb3a54694e57a783679"}]}] May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Tenant: admin May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Tenant-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Tenant-Name: admin May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User: admin May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Domain-Id: default May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Domain-Name: Default May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Id: 79cb9f096a814d81a7a9552741bc1a1f May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Name: admin May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: method: > May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: exception: Flavor 84 could not be found. May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: action_args: {'id': '84'} May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:44:59.675141 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:44:59.676231 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:44:59.677597 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-854415ee-a183-459c-bbb1-593bd97516f4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:44:59.678850 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-854415ee-a183-459c-bbb1-593bd97516f4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058610 May 12 06:44:59.678850 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Thu May 12 06:44:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 12 06:44:59.686161 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-20330f1c-ee6a-44b4-ae63-22cae7a6899f admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:59.699574 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-20330f1c-ee6a-44b4-ae63-22cae7a6899f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018487 May 12 06:44:59.700072 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Thu May 12 06:44:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:44:59.709177 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-d4b7bded-db8f-4698-853d-0d3c11acd24e admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:59.722457 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-d4b7bded-db8f-4698-853d-0d3c11acd24e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016720 May 12 06:44:59.722966 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Thu May 12 06:44:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:44:59.732185 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-5ad1d599-6aba-4105-ba1c-5502034ebf90 admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:44:59.737171 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.wsgi [None req-5ad1d599-6aba-4105-ba1c-5502034ebf90 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-5ad1d599-6aba-4105-ba1c-5502034ebf90 admin admin] Request method failure captured: May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Accept: application/json May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Accept-Encoding: gzip, deflate May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Connection: keep-alive May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Content-Length: 0 May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Host: 10.222.0.25 May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Openstack-Api-Version: compute 2.90 May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Openstack-System-Scope: None May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: User-Agent: python-novaclient May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Auth-Token: gAAAAABifKzr_LNTALJVedLQIhVo-_1eW3sg2p8gwz-nkeEIP1BHexR-P0XIkdbIYrlNtVm08c0BrCYOTZ1-adCNI1_heac1wWOoNTIuGQLJLVdh7qUTZe8BJlgH04si9cPYSywifMm3qSab3WBcNFAErI_RKmb7Zx2qJOZWyQu1BURruwOL7zI May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Domain-Id: None May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Domain-Name: None May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Identity-Status: Confirmed May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Is-Admin-Project: True May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Openstack-Nova-Api-Version: 2.90 May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Domain-Id: default May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Domain-Name: Default May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Name: admin May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Role: reader,admin,member May 12 06:44:59.738660 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Roles: reader,admin,member May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce2018cacb6f4eb3a54694e57a783679", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce2018cacb6f4eb3a54694e57a783679"}]}] May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Tenant: admin May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Tenant-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Tenant-Name: admin May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User: admin May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Domain-Id: default May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Domain-Name: Default May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Id: 79cb9f096a814d81a7a9552741bc1a1f May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Name: admin May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: method: > May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: exception: Flavor 84 could not be found. May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: action_args: {'id': '84'} May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:44:59.740243 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:44:59.741226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:44:59.742275 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-5ad1d599-6aba-4105-ba1c-5502034ebf90 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:44:59.743359 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-5ad1d599-6aba-4105-ba1c-5502034ebf90 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011682 May 12 06:44:59.743359 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Thu May 12 06:44:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 06:45:00.619467 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-d4b7bded-db8f-4698-853d-0d3c11acd24e admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:45:00.620550 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-d4b7bded-db8f-4698-853d-0d3c11acd24e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 May 12 06:45:00.620954 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:45:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:45:00.804800 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-9ccb22b6-d232-4d22-86af-dcc7e0a5d048 admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:45:00.810861 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.wsgi [None req-9ccb22b6-d232-4d22-86af-dcc7e0a5d048 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-9ccb22b6-d232-4d22-86af-dcc7e0a5d048 admin admin] Request method failure captured: May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Accept: application/json May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Accept-Encoding: gzip, deflate May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Connection: keep-alive May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Content-Length: 0 May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Host: 10.222.0.25 May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Openstack-Api-Version: compute 2.90 May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Openstack-System-Scope: None May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: User-Agent: python-novaclient May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Auth-Token: gAAAAABifKzsVMCdSSLnCLKnBM7XdDaL6i7JjvWKcqhLWQMQ_FojbkILZnpBEwVwYY23dcKZfQGFnmo5FJB7_1jXu_lkIwtCelK5L3crVb4-aTGX1RUZoKNWJeHpd7L20JsF2aSJJZ6Nx20WCP3xjkUKSeR9swbrhkIMpsu9OuVKLM7-2stUpvk May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Domain-Id: None May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Domain-Name: None May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Identity-Status: Confirmed May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Is-Admin-Project: True May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Openstack-Nova-Api-Version: 2.90 May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Domain-Id: default May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Domain-Name: Default May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Project-Name: admin May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Role: reader,admin,member May 12 06:45:00.812399 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Roles: reader,admin,member May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce2018cacb6f4eb3a54694e57a783679", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce2018cacb6f4eb3a54694e57a783679"}]}] May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Tenant: admin May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Tenant-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-Tenant-Name: admin May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User: admin May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Domain-Id: default May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Domain-Name: Default May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Id: 79cb9f096a814d81a7a9552741bc1a1f May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: X-User-Name: admin May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: method: > May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: exception: Flavor 451 could not be found. May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: action_args: {'id': '451'} May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:45:00.813823 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:45:00.814645 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: ERROR nova.api.openstack.wsgi May 12 06:45:00.815806 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-9ccb22b6-d232-4d22-86af-dcc7e0a5d048 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:45:00.816873 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-9ccb22b6-d232-4d22-86af-dcc7e0a5d048 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059025 May 12 06:45:00.816873 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Thu May 12 06:45:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 06:45:00.823985 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-813326c7-52fd-4b3a-9710-5105c540ea2e admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:45:00.837322 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-813326c7-52fd-4b3a-9710-5105c540ea2e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017569 May 12 06:45:00.837851 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Thu May 12 06:45:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:45:00.847211 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:45:00.860608 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016996 May 12 06:45:00.861201 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Thu May 12 06:45:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:45:00.870853 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-2209e153-42f2-4fa8-a1e2-44fc60a81250 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:45:00.875994 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.wsgi [None req-2209e153-42f2-4fa8-a1e2-44fc60a81250 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-2209e153-42f2-4fa8-a1e2-44fc60a81250 admin admin] Request method failure captured: May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Accept: application/json May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Accept-Encoding: gzip, deflate May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Connection: keep-alive May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Content-Length: 0 May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Host: 10.222.0.25 May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Openstack-Api-Version: compute 2.90 May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Openstack-System-Scope: None May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: User-Agent: python-novaclient May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Auth-Token: gAAAAABifKzsVMCdSSLnCLKnBM7XdDaL6i7JjvWKcqhLWQMQ_FojbkILZnpBEwVwYY23dcKZfQGFnmo5FJB7_1jXu_lkIwtCelK5L3crVb4-aTGX1RUZoKNWJeHpd7L20JsF2aSJJZ6Nx20WCP3xjkUKSeR9swbrhkIMpsu9OuVKLM7-2stUpvk May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Domain-Id: None May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Domain-Name: None May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Identity-Status: Confirmed May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Is-Admin-Project: True May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Openstack-Nova-Api-Version: 2.90 May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Domain-Id: default May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Domain-Name: Default May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Project-Name: admin May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Role: reader,admin,member May 12 06:45:00.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Roles: reader,admin,member May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce2018cacb6f4eb3a54694e57a783679", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2018cacb6f4eb3a54694e57a783679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce2018cacb6f4eb3a54694e57a783679"}]}] May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Tenant: admin May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Tenant-Id: ce2018cacb6f4eb3a54694e57a783679 May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-Tenant-Name: admin May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User: admin May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Domain-Id: default May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Domain-Name: Default May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Id: 79cb9f096a814d81a7a9552741bc1a1f May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: X-User-Name: admin May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: method: > May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: exception: Flavor 451 could not be found. May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: action_args: {'id': '451'} May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:45:00.878898 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:45:00.879803 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: ERROR nova.api.openstack.wsgi May 12 06:45:00.890801 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-2209e153-42f2-4fa8-a1e2-44fc60a81250 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:45:00.891872 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-2209e153-42f2-4fa8-a1e2-44fc60a81250 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011997 May 12 06:45:00.891872 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Thu May 12 06:45:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 06:45:01.755054 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:45:01.756089 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 12 06:45:01.756480 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:45:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:45:01.942045 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-03ca2734-f71f-4e51-9f6a-151da4c6ff18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:45:02.015536 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-03ca2734-f71f-4e51-9f6a-151da4c6ff18 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.123978 May 12 06:45:02.016373 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Thu May 12 06:45:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:45:02.954664 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:45:02.955780 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 May 12 06:45:02.956181 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:45:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:45:03.141822 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-a6f26006-1af3-4f5b-bc31-7c4a263cc442 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:45:03.367454 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-a6f26006-1af3-4f5b-bc31-7c4a263cc442 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.275069 May 12 06:45:03.368042 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Thu May 12 06:45:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:45:04.248220 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:45:04.249245 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 12 06:45:04.249639 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:45:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:45:04.436510 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-a9978f7d-e4e2-4ba8-af6d-73d2e58167b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:45:04.511732 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-a9978f7d-e4e2-4ba8-af6d-73d2e58167b3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.125916 May 12 06:45:04.512217 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Thu May 12 06:45:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:45:05.395920 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:45:05.396916 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 12 06:45:05.397313 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:45:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:45:05.582125 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-f07f58fe-12a8-4fa5-85de-19e4b1f167f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:45:05.642884 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-f07f58fe-12a8-4fa5-85de-19e4b1f167f7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.111345 May 12 06:45:05.643421 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Thu May 12 06:45:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:45:06.521130 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:45:06.522124 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 May 12 06:45:06.522516 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:45:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:45:06.710490 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-9e9d6397-2571-4abe-b4b5-08a96c966be0 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:45:06.730255 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-9e9d6397-2571-4abe-b4b5-08a96c966be0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070903 May 12 06:45:06.730778 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Thu May 12 06:45:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:46:08.693484 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:46:08.694525 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-f1916902-658f-4546-b6ff-a9f8cab266ec admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 12 06:46:08.694933 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 12 06:46:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:46:08.753297 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-60a85c87-4187-47fc-aa1e-42bcc1528fa4 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:46:08.772487 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-60a85c87-4187-47fc-aa1e-42bcc1528fa4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071259 May 12 06:46:08.773024 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1291 bytes} [Thu May 12 06:46:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:46:08.795727 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-cb4ca7f2-fba5-49dd-a94f-e21c0484e7f8 admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:46:08.803322 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-cb4ca7f2-fba5-49dd-a94f-e21c0484e7f8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011934 May 12 06:46:08.803873 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1282 bytes} [Thu May 12 06:46:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:46:08.814679 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-8ca4f36b-f6be-40c8-9fad-0b1e95340600 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:46:08.822094 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-8ca4f36b-f6be-40c8-9fad-0b1e95340600 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010899 May 12 06:46:08.822610 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1285 bytes} [Thu May 12 06:46:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:46:08.833770 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-1a9534f9-73d4-46f0-a777-6e3aee7a29aa admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:46:08.843793 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-1a9534f9-73d4-46f0-a777-6e3aee7a29aa admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012862 May 12 06:46:08.843793 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1285 bytes} [Thu May 12 06:46:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:46:08.854735 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-389883c6-b2d4-47e6-a5c9-5b7bbb3959fd admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:46:08.862213 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-389883c6-b2d4-47e6-a5c9-5b7bbb3959fd admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010962 May 12 06:46:08.862733 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1282 bytes} [Thu May 12 06:46:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:49:35.707805 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-1a9534f9-73d4-46f0-a777-6e3aee7a29aa admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:49:35.708829 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-1a9534f9-73d4-46f0-a777-6e3aee7a29aa admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 12 06:49:35.709230 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:49:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:49:35.980644 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-3c6ec732-ae36-48a7-aa45-3409897e4431 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:49:35.981821 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:49:35.981821 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: warnings.warn(msg) May 12 06:49:35.983041 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-3c6ec732-ae36-48a7-aa45-3409897e4431 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:49:35.983624 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-3c6ec732-ae36-48a7-aa45-3409897e4431 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:49:35.984457 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-3c6ec732-ae36-48a7-aa45-3409897e4431 admin admin] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:49:35.984885 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-3c6ec732-ae36-48a7-aa45-3409897e4431 admin admin] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:49:36.018444 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-3c6ec732-ae36-48a7-aa45-3409897e4431 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154728 May 12 06:49:36.019025 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Thu May 12 06:49:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:49:36.922830 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-1a9534f9-73d4-46f0-a777-6e3aee7a29aa admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:49:36.923867 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-1a9534f9-73d4-46f0-a777-6e3aee7a29aa admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 12 06:49:36.924311 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:49:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:49:37.112657 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-abc4cc14-53ac-4e84-8c90-4b83284a0303 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:49:37.113852 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:49:37.113852 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: warnings.warn(msg) May 12 06:49:37.115020 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-abc4cc14-53ac-4e84-8c90-4b83284a0303 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:49:37.115455 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-abc4cc14-53ac-4e84-8c90-4b83284a0303 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:49:37.116257 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-abc4cc14-53ac-4e84-8c90-4b83284a0303 admin admin] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:49:37.116680 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-abc4cc14-53ac-4e84-8c90-4b83284a0303 admin admin] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:49:37.135120 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-abc4cc14-53ac-4e84-8c90-4b83284a0303 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.072988 May 12 06:49:37.135654 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Thu May 12 06:49:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:49:48.424292 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-1a9534f9-73d4-46f0-a777-6e3aee7a29aa admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:49:48.425374 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-1a9534f9-73d4-46f0-a777-6e3aee7a29aa admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 May 12 06:49:48.425776 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:49:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:49:48.612233 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-118de86e-6512-4590-95cc-513f13ba13d2 admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:49:48.613408 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:49:48.613408 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: warnings.warn(msg) May 12 06:49:48.614584 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-118de86e-6512-4590-95cc-513f13ba13d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:49:48.615025 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-118de86e-6512-4590-95cc-513f13ba13d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:49:48.615870 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-118de86e-6512-4590-95cc-513f13ba13d2 admin admin] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:49:48.616297 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-118de86e-6512-4590-95cc-513f13ba13d2 admin admin] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:49:48.640671 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-118de86e-6512-4590-95cc-513f13ba13d2 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079051 May 12 06:49:48.641188 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Thu May 12 06:49:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:49:49.533226 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: DEBUG nova.api.openstack.wsgi [None req-1a9534f9-73d4-46f0-a777-6e3aee7a29aa admin admin] Calling method '>' {{(pid=109676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:49:49.534225 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: INFO nova.api.openstack.requestlog [None req-1a9534f9-73d4-46f0-a777-6e3aee7a29aa admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 12 06:49:49.534626 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: [pid: 109676|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Thu May 12 06:49:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:49:49.721188 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG nova.api.openstack.wsgi [None req-1859fc8d-7483-4971-9e49-9c646a27ad6f admin admin] Calling method '>' {{(pid=109675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:49:49.722394 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:49:49.722394 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: warnings.warn(msg) May 12 06:49:49.723606 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-1859fc8d-7483-4971-9e49-9c646a27ad6f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:49:49.724087 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-1859fc8d-7483-4971-9e49-9c646a27ad6f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:49:49.724877 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-1859fc8d-7483-4971-9e49-9c646a27ad6f admin admin] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:49:49.725308 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: DEBUG oslo_concurrency.lockutils [None req-1859fc8d-7483-4971-9e49-9c646a27ad6f admin admin] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:49:49.747036 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: INFO nova.api.openstack.requestlog [None req-1859fc8d-7483-4971-9e49-9c646a27ad6f admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075973 May 12 06:49:49.747511 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: [pid: 109675|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Thu May 12 06:49:49 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:50:47.453877 dv-cinder-766064-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 06:50:47.454740 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: Thu May 12 06:50:47 2022 - graceful shutdown triggered... May 12 06:50:47.455196 dv-cinder-766064-5-iscsi devstack@n-api.service[109675]: Gracefully killing worker 1 (pid: 109675)... May 12 06:50:47.455618 dv-cinder-766064-5-iscsi devstack@n-api.service[109676]: Gracefully killing worker 2 (pid: 109676)... May 12 06:50:48.455318 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: worker 1 buried after 1 seconds May 12 06:50:48.455318 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: worker 2 buried after 1 seconds May 12 06:50:48.455318 dv-cinder-766064-5-iscsi devstack@n-api.service[109674]: goodbye to uWSGI. May 12 06:50:48.456793 dv-cinder-766064-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 06:50:48.457388 dv-cinder-766064-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 06:50:48.460102 dv-cinder-766064-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 06:50:48.479115 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 06:50:48.499253 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 06:50:48 2022] *** May 12 06:50:48.499253 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 06:50:48.499253 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 06:50:48.499253 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: nodename: dv-cinder-766064-5-iscsi May 12 06:50:48.499253 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: machine: x86_64 May 12 06:50:48.499253 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: clock source: unix May 12 06:50:48.499253 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: pcre jit disabled May 12 06:50:48.499253 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: detected number of CPU cores: 4 May 12 06:50:48.499253 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: current working directory: / May 12 06:50:48.499253 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: detected binary path: /usr/bin/uwsgi-core May 12 06:50:48.499253 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: your processes number limit is 47680 May 12 06:50:48.500126 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: your memory page size is 4096 bytes May 12 06:50:48.500126 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: detected max file descriptor number: 2048 May 12 06:50:48.500126 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: lock engine: pthread robust mutexes May 12 06:50:48.500126 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: thunder lock: enabled May 12 06:50:48.500126 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 06:50:48.500126 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 06:50:48.546771 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: Python main interpreter initialized at 0x55a6baaa99c0 May 12 06:50:48.546771 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: python threads support enabled May 12 06:50:48.546771 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: your server socket listen backlog is limited to 100 connections May 12 06:50:48.546771 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: your mercy for graceful operations on workers is 90 seconds May 12 06:50:48.547223 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: mapped 403077 bytes (393 KB) for 2 cores May 12 06:50:48.547223 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: *** Operational MODE: preforking *** May 12 06:50:48.547480 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: *** uWSGI is running in multiple interpreter mode *** May 12 06:50:48.547480 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: spawned uWSGI master process (pid: 124002) May 12 06:50:48.547707 dv-cinder-766064-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 06:50:48.548407 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: spawned uWSGI worker 1 (pid: 124024, cores: 1) May 12 06:50:48.548604 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: spawned uWSGI worker 2 (pid: 124025, cores: 1) May 12 06:50:48.549694 dv-cinder-766064-5-iscsi devstack@n-api.service[124002]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 06:50:49.757045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 06:50:49.764018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 06:50:50.548334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:50:50.548334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: from cryptography.utils import int_from_bytes May 12 06:50:50.548630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:50:50.548630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: from cryptography.utils import int_from_bytes May 12 06:50:50.556860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:50:50.556860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: from cryptography.utils import int_from_bytes May 12 06:50:50.557179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:50:50.557179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: from cryptography.utils import int_from_bytes May 12 06:50:52.975375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 06:50:52.976078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 06:50:52.976183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 06:50:52.976476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 06:50:52.976712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 06:50:52.977104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.977435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.977760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.978081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.978412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.978731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.979082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.979463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.979814 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.980079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.980398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.980722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-766064-5-iscsi {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.981045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.981357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.982306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.982541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.982850 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.983173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.983479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.984006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.985353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 06:50:52.985754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.985840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 06:50:52.985923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.986144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 06:50:52.986281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.986532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 06:50:52.986644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.986817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 06:50:52.986939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.987164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.987294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.987497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.987612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.987849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.987976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.988186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.988297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.988495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.988608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.988826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.988953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-766064-5-iscsi {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.989153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.989371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.989484 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.989803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.989930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.990118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.990230 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.990412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.990722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-766064-5-iscsi {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.990844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.991059 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.991286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.991529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.991768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.992017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.992238 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.992475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.992696 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.992696 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.993149 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.993369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.993593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.993787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.993996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.994165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.994321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.994629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.994629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.994950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.995152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.995152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.995448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.995610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.995840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.995991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.996147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.996339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.996552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.996716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.996889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.996889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.997188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.997343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.997497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-766064-5-iscsi {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.997658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.997805 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.997951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.998107 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.998263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.998423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.998578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.998725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.998883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.998883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.999185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.999347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.999507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.999660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.999878 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:52.999878 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.000185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.000342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.004475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.004692 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.004859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.005018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.005018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.005326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.005483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.005640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.006461 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.006461 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.006771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.006929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.007087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.007247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.007414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.007829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.007829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.008152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.009234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.009234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.009545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.009719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.009870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.010026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.010026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.010325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.010486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.010645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.010858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.011065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.011216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.011802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.011973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.012130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.012286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.012448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.013633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.014360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.014493 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.014618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.014742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.014868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.014993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.015367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.015493 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.015661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.021006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.021180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.021332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.021595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.022091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.022251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.022399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.022399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.022715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.022943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.023102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.023250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.023407 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.023555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.023733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.023908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.023908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.024207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.024363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.024512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.024677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.024677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.024971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.025125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.025298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.025635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.025635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.025949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.026106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.026261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.026419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.026419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.026726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.026873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.027027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.028022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.028022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.029408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.029566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.029725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.029883 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.030052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.030208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.030371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.030523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.030680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.030835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.030996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.031144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.031299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.031448 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.031608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.031797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.032530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.032939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.033189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.033343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.033501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.033688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.033851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.034008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.034168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.034323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.034485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.034640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.034794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.034963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.034963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.035258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.035411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.035579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.035894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.035894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.036336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.036484 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.036630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.036784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.036784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.037083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.037260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.037425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.037585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.037744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.037891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.037891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.038294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.038453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.039677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.039866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.039866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.040172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.040321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.040488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.040645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.040645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.040940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.041094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.041250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.041432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.041716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.041716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.043297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.043463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.043615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.043804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.043976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.044135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.045062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.045168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.045269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.045359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.045454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.045549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.045640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.045726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.045822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.045919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.046007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.046102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.046206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.046305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.046402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.046499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.046592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.046950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.047058 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.047058 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.047236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.047332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.047419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.047512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:50:53.047605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.047605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.051794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.051925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.052032 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.052131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.052226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.052324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.052419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.052513 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.052513 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.052679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.052776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.052876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.052962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.053066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.053162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.053303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.053445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.053536 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.053621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.053711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.053803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.053894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.054013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.054100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.054209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.054311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.054405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.054497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.054582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.054747 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.054843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.054928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.055018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.055102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.055193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.055290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.055375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.055465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.055556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.055641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.055741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.055849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.055937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.056027 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.056119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.056204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.056297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.056391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.056483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.056574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.056666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.056750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.056864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.057623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.057728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.057823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.057965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.058097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.058271 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.058409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.058535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.058679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.058826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.058976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.059132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.059272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.059413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.059546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.059678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.059863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.060024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.060024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.060288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.060419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.060562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.060716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.060869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.061003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.061162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.061298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.061430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.061589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.061753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.061906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.062055 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.062208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.062363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.062512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.062654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.062808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.062961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.063078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.063167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.063263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.063403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.063535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.063671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.063831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.063931 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.064018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.064101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.064185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.064267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.064357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.064463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.064557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.064643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.064809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.064903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.064976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.065069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.065162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.065248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.065375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.065467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.065549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.065549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.065697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.065770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.065849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.065928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.066017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.066097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.066178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.066257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.066363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.066444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.066533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.066613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.066684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.066684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.066935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.067020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.067103 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.067187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.067266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.067338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.067417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.067491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.067574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.067574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.067953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068653 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.068949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.069987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070570 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.070975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.071119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.071204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.071286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.071368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.071465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.071551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.071551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.071738 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.071821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.071901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.071980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.072065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.072149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.072254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.072386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.072481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.072575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.072660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.072749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.072843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.072934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.073031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.073122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.073207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.073290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.073420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.073562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.073666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.073791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.073909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.074917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.075083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.075175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.075268 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.075268 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.075417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.075508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.075602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.075752 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.075909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076694 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.076924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.077014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.077105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.077196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.077292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.077383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.077475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.077475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.077627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.077717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.077813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.077914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.078009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.078094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.078177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.078269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.078517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.078640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.078732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.078811 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.078896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.078982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.079067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.079150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.079240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.079330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.079423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.079517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.079609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.079609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.079609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.079609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.079925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.080967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.081096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.081219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.081297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.081297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.081457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.081558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.081643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.081733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.081826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.081917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.082009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.082102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.082212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.082300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.082381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.082473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.082564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.082661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.082745 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.082836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.082926 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.083018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.083109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.083202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.083294 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.083379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.083462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.083595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.083755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.083880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.084087 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.084183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.084268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.084361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.084502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.084655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.084835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.084985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.085165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.085295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.085479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.085602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.085794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.085928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.086127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.086227 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.086447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.086548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.086769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.086869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.087082 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.087183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.087396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.087487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.087770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.087868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.088081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.088185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.088397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.088549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.088718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.088816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.089031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.089138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.089347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.089440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.089660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.089758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.089972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.090072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.090289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.090388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.090600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.090724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.090912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.091521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.091762 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.091866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.092077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.092172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.092391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.092492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.092703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.092796 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.093023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.093115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.093334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.093454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.093646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.093749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.093952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.094081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.094256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.094359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.094564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.094656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.094881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.094980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.095206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.095476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.095813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.095913 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.096156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.096264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.096480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.096573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.096803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.096895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.097129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.097301 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.097457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.097556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.097791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.097883 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.098125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.098230 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.098434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.098535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.098750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.098856 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.099060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.099153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.099366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.099459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.099675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.099821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.100007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.100113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.100316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.100426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.100628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.100748 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.100934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.101075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.101236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.101327 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.101540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.101643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.101845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.101952 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.102150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.102252 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.102458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.102557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.102761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.102865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.103074 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.103177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.103379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.103473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.103710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.103865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.104019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.104145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.104325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.104429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.104630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.104724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.104939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.105039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.105251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.105352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.105571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.105664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.105899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.106000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.106223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.106324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.106564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.106706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.107484 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.107582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.107832 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.107948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.108147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.108248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.108469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.108568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.108779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.108919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.109085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.109177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.109393 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.109492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.109700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.109805 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.110004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.110097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.110311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.110403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.110621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.110720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.110930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.111068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.111241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.111344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.111544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.111637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.111877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.111982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.112179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.112278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.112490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.112591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.112797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.112888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.113101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.113201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.113404 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.113505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.113712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.113803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.114018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.114126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.114322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.114442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.114629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.114729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.114929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.115034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.115244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.115344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.115548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.115641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.115879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.115993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.116182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.116283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.116490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.116589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.116797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.116901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.117099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.117193 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.117412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.117503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.117722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.117815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.118025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.118118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.118328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.118428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.118636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.118731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.118940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.119074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.119244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.119337 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.119552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.119647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.119896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.119989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.120211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.120314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.120514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.120609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.120825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.120926 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.121130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.121239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.121432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.121528 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.121734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.121835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.122041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.122150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.122421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.122522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.122723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.122816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.123028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.123134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.123330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.123499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.123633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.123754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.123968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.124071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.124276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.124412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.124582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.124686 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.124887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.124988 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.125194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.125288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.125504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.125604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.125822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.125963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.126150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.126249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.126470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.126569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.126786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.126881 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.127104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.127197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.127416 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.127517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.127752 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.127865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.128068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.128205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.128373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.128466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.128688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.128780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.130009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.130105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.130199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.130300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.130388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.130480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.130573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.130658 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.130750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.130849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.130943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.131030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.131122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.131207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.131287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.131368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.131496 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.131597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.131747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.131850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.132014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.132121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.132324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.132419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.132636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.132729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.132945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.133038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.133254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.133353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.133562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.133679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.133874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.133976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.134186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.134287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.134496 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.134643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.134804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.134906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.135123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.135216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.135429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.135531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.135761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.135870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.136074 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.136157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.136925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.137044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.137044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.137190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.137190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.137328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.137408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.137489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.137594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.137679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.137942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.138036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.138258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.138378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.138562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.138654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.138875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.138995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.139307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.139408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.139621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.139743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.139962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.140055 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.140275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.140368 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.140585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.140677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.140903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.140995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.141216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.141308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.141521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.141622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.141838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.141972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.142239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.142339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.142553 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.142645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.142868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.142969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.143174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.143267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.143477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.143570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.143810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.143919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.144131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.144225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.144435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.144549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.144742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.144861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.145050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.145144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.145356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.145455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.145663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.145768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.145981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.146082 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.146305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.146396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.146695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.146799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.147002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.147095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.147334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.147433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.147730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.147825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.148047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.148151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.148371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.148471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.148693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.148795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.149017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.149116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.149325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.149418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.149638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.149803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.149945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.150071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.150259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.150647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.150647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.150840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.150934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.151019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.151180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.151275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.151483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.151577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.151825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.151936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.152150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.152255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.152463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.152564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.152783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.152888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.153111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.153204 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.154016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.154119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.154336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.154444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.154661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.154920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.155018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.155112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.155288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.155392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.155592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.155707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.155945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.156061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.156266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.156446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.156579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.156673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.156889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.156990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.157219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.157313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.157532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.157627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.157851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.157950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.158159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.158253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.158463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.158565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.158766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.158859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.159074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.159166 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.159375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.159473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.159745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.159855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.160035 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.160129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.160353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.160452 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.160673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.160780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.160979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.161083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.161294 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.161394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.161600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.161700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.161903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.161996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.162206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.162297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.162510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.162617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.162819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.162919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.163143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.163236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.163463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.163566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.164084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.164176 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.164413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.164551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.164725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.164819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.165055 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.165196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.165381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.165488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.165699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.165798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.166015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.166110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.166344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.166515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.166677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.166780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.166940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.167042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.167252 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.167346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.167555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.167649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.167883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.167986 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.168187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.168290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.168494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.168596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.168797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.168890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.169119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.169751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.169963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.170063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.170277 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.170378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.170605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.170708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.170917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.171050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.171248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.171342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.171551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.171654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.171880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.171976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.172185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.172286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.172507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.172606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.172820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.172913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.173152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.173252 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.173472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.173574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.173792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.173899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.174117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.174217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.174427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.174526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.174755 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.174851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.175099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.175207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.175386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.175488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.175721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.175829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.176043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.176150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.176365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.176500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.176683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.176800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.176999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.177117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.177308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.177401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.177622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.177714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.177940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.178044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.178257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.178350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.178580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.178798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.179119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.179272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.179431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.179578 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.179770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.179912 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.180087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.180231 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.180405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.180547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.180718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.180860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.181018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.181185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.181330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.181433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.181642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.181738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.181952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.182063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.182269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.182361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.182588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.182694 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.182910 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.183046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.183237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.183330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.183550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.183652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.183886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.183992 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.184201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.184303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.184519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.184630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.184863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.184967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.185209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.185329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.185518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.185626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.185832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.185938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.186148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.186332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.186464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.186567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.186780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.186886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.187093 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.187206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.187403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.187508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.187758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.187864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.188086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.188199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.188406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.188511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.188716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.188809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.189029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.189137 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.189348 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.189443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.189679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.189781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.190001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.190105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.190316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.190418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.190629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.190731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.190945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.191041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.191270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.191466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.191804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.191901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.192134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.192230 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.192457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.192557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.192779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.192881 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.193096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.193190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.193414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.193507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.193737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.193837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.194043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.194135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.194356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.194457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.194666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.194772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.194976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.195079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.195320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.195440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.195592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.195714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.195923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.196018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.196229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.196331 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.196559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.196698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.196858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.196953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.197173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.197390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.197720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.197815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.198047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.198139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.198375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.198469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.198702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.198796 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.199136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.199254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.199344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.199429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.199631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.199757 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.199963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.200067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.200270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.200892 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.201116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.201221 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.201428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.201522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.201734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.201836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.202038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.202139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.202349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.202448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.202657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.202758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.202960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.203052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.203270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.203362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.203573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.203678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.203911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.204005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.204216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.204315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.204522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.204617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.204829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.204930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.205142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.205251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.205481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.205596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.205749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.205843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.206056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.206155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.206355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.206448 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.206665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.206804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.206967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.207067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.207276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.207370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.207578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.207678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.207912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.208017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.208214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.208321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.208520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.208614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.208834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.208940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.209191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.209323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.209502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.209610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.209801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.209918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.210109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.210205 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.210419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.210513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.210791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.210915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.211120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.211226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.211431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.211569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.211779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.211889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.212111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.212204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.212448 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.212644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.212977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.213077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.213301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.213446 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.213635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.213735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.213966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.214060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.214275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.214370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.214587 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.214688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.214894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.214988 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.215204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.215307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.215543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.215663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.215846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.215943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.216715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.216816 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.217035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.217206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.217343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.217436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.217651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.217745 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.217961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.218064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.218270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.218371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.218580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.218681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.218889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.218983 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.219197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.219331 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.219505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.219598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.219838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.219935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.220179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.220285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.220501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.220595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.220820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.220921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.221137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.221230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.221456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.221559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.221768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.221872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.222077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.222177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.222387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.222496 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.222695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.222790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.223017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.223110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.223333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.223439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.223645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.223779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.223972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.224075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.224296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.224389 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.224697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.224790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.225017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.225110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.225339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.225486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.225638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.225737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.225961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.226066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.226277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.226373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.226588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.226688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.226907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.227008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.227216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.227309 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.227543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.227634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.227903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.228009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.228231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.228332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.228555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.228649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.228859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.228962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.229165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.229259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.229468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.229562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.229777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.229884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.230091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.230190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.230397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.230489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.230702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.230796 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.231002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.231096 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.231308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.231400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.231621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.231735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.231955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.232051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.232260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.232400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.232564 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.232659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.232872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.232973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.233173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.233267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.233475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.233576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.233778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.233881 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.234084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.234186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.234384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.234477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.234685 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.234786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.234989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.235089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.235289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.235381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.235593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.235741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.235920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.236080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.236222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.236323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.236523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.236616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.236827 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.236927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.237166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.237278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.237476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.237567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.237796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.237890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.238107 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.238200 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.238425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.238518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.238734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.238836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.239049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.239141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.239365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.239457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.239676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.239806 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.240007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.240101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.240333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.240440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.240642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.240734 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.240955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.241051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.241266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.241367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.241576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.241681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.241886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.241980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.242198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.242303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.242516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.242615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.242840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.242931 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.243145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.243248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.243468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.243568 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.243809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.243916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.244135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.244230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.244451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.244545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.244763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.244856 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.245081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.245174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.245392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.245490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.245703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.245804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.246009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.246112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.246315 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.246427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.246627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.246730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.246943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.247044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.247277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.247381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.247603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.247724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.247948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.248040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.248271 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.248373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.248595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.248697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.248924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.249023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.249240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.249339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.249580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.249720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.249906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.250008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.250219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.250319 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.250532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.250626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.250837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.250938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.251082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 06:50:53.251176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:50:53.251507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 06:50:53.274841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_db.sqlalchemy.engines [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:50:53.276502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_db.sqlalchemy.engines [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:50:53.340291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.context [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58(cell1) {{(pid=124025) load_cells /opt/stack/nova/nova/context.py:464}} May 12 06:50:53.343341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.context [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58(cell1) {{(pid=124024) load_cells /opt/stack/nova/nova/context.py:464}} May 12 06:50:53.345338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:50:53.346935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:50:53.347782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:50:53.348868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:50:53.349740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:50:53.351007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:50:53.352149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:50:53.354905 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:50:53.361223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_db.sqlalchemy.engines [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:50:53.363104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_db.sqlalchemy.engines [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:50:53.366015 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_db.sqlalchemy.engines [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:50:53.368213 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_db.sqlalchemy.engines [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:50:53.520600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_db.sqlalchemy.engines [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:50:53.530244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_db.sqlalchemy.engines [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:50:53.839587 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: WARNING keystonemiddleware.auth_token [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 06:50:53.847751 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: WARNING keystonemiddleware.auth_token [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 06:50:53.851956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: WARNING keystonemiddleware.auth_token [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 06:50:53.860071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: WARNING keystonemiddleware.auth_token [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 06:50:54.194952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: WARNING keystonemiddleware.auth_token [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 06:50:54.201743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: WARNING keystonemiddleware.auth_token [None req-701a4e00-155e-4413-a63e-b15b628ee5f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 06:50:54.206938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6baaa99c0 pid: 124025 (default app) May 12 06:50:54.208179 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: WARNING keystonemiddleware.auth_token [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 06:50:54.214409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: WARNING keystonemiddleware.auth_token [None req-b431edb7-61ab-48d1-99dc-5a5d069e3e52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 06:50:54.220609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6baaa99c0 pid: 124024 (default app) May 12 06:51:37.852440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dd495ca6-c04a-437f-8bda-b0a6c4dae32e tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Action: 'create', calling method: .version_select at 0x7f89dc334280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-682315665", "metadata": {"Type": "work"}}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dd495ca6-c04a-437f-8bda-b0a6c4dae32e tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Request method failure captured: May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 121 May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK54R4RK2rk263nIdrng1baUH6dYRoP6v2w4o4FPseGtQWS8wOXv8U1nvFRxirnMhecfg-vcYxG-dVRYBkTzD-f5AOZtAmAE4mnMs_ZJw23BZyj314eeh3zOmACQVZ4bnbZkXxDtcIvL4sg7vvalLGO-VDxJDZxnwNIi4scSAGj29Q4 May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 06:51:37.871856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99ca6d9d066495aba5384420764c3d3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99ca6d9d066495aba5384420764c3d3"}]}] May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-VolumesNegativeTest-1806616041 May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 9b5f04c541a1451a93e200bf9b6a4a3e May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-682315665", "metadata": {"Type": "work"}}} May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: May 12 06:51:37.873613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-682315665', 'metadata': {'Type': 'work'}}}} May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise error May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi '#$%' May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:51:37.874633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 06:51:37.878220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 06:51:37.879469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 06:51:37.879469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:51:37.879469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dd495ca6-c04a-437f-8bda-b0a6c4dae32e tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:51:37.879469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dd495ca6-c04a-437f-8bda-b0a6c4dae32e tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.492895 May 12 06:51:37.879469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Thu May 12 06:51:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1495 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 06:51:38.305575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0678804f-c12a-46b2-befa-5641d7df7731 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Action: 'create', calling method: .version_select at 0x7f89dc35cee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-478363785", "metadata": {"Type": "work"}}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0678804f-c12a-46b2-befa-5641d7df7731 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Request method failure captured: May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 119 May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK54R4RK2rk263nIdrng1baUH6dYRoP6v2w4o4FPseGtQWS8wOXv8U1nvFRxirnMhecfg-vcYxG-dVRYBkTzD-f5AOZtAmAE4mnMs_ZJw23BZyj314eeh3zOmACQVZ4bnbZkXxDtcIvL4sg7vvalLGO-VDxJDZxnwNIi4scSAGj29Q4 May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 06:51:38.316224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99ca6d9d066495aba5384420764c3d3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99ca6d9d066495aba5384420764c3d3"}]}] May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-VolumesNegativeTest-1806616041 May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 9b5f04c541a1451a93e200bf9b6a4a3e May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-478363785", "metadata": {"Type": "work"}}} May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: May 12 06:51:38.317826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-478363785', 'metadata': {'Type': 'work'}}}} May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise error May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi '0' May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:51:38.318795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 06:51:38.320452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 06:51:38.322459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 06:51:38.322459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.330400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0678804f-c12a-46b2-befa-5641d7df7731 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:51:38.330400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0678804f-c12a-46b2-befa-5641d7df7731 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.446987 May 12 06:51:38.333189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1155 bytes} [Thu May 12 06:51:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 453 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 06:51:38.340012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2747da97-aefb-4d6b-94b6-94923cf454c6 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Action: 'create', calling method: .version_select at 0x7f89dc21c1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2088242824", "metadata": {"Type": "work"}}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2747da97-aefb-4d6b-94b6-94923cf454c6 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Request method failure captured: May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 119 May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK54R4RK2rk263nIdrng1baUH6dYRoP6v2w4o4FPseGtQWS8wOXv8U1nvFRxirnMhecfg-vcYxG-dVRYBkTzD-f5AOZtAmAE4mnMs_ZJw23BZyj314eeh3zOmACQVZ4bnbZkXxDtcIvL4sg7vvalLGO-VDxJDZxnwNIi4scSAGj29Q4 May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 06:51:38.343178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99ca6d9d066495aba5384420764c3d3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99ca6d9d066495aba5384420764c3d3"}]}] May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-VolumesNegativeTest-1806616041 May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 9b5f04c541a1451a93e200bf9b6a4a3e May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2088242824", "metadata": {"Type": "work"}}} May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: May 12 06:51:38.344552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2088242824', 'metadata': {'Type': 'work'}}}} May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise error May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi '' May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:51:38.345344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 06:51:38.347191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 06:51:38.348834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 06:51:38.348834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:38.349710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2747da97-aefb-4d6b-94b6-94923cf454c6 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:51:38.350538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2747da97-aefb-4d6b-94b6-94923cf454c6 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015088 May 12 06:51:38.351089 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1155 bytes} [Thu May 12 06:51:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 06:51:38.366676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8200ac85-3422-4801-89b4-71d6528ad3c3 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Calling method '.version_select at 0x7f89dc35ce50>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:38.557023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1689806814", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "networks": [{"uuid": "9d9063ed-c270-49fd-9007-5dee5f3ff599"}]}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:51:39.042778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.network.neutron [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] validate_networks() for [('9d9063ed-c270-49fd-9007-5dee5f3ff599', None, None, None, None, None)] {{(pid=124025) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:51:39.378124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-8200ac85-3422-4801-89b4-71d6528ad3c3 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] HTTP exception thrown: Volume tempest-invalid-69388025 could not be found. May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8200ac85-3422-4801-89b4-71d6528ad3c3 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Request method failure captured: May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-69388025 HTTP/1.1 May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK54R4RK2rk263nIdrng1baUH6dYRoP6v2w4o4FPseGtQWS8wOXv8U1nvFRxirnMhecfg-vcYxG-dVRYBkTzD-f5AOZtAmAE4mnMs_ZJw23BZyj314eeh3zOmACQVZ4bnbZkXxDtcIvL4sg7vvalLGO-VDxJDZxnwNIi4scSAGj29Q4 May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 06:51:39.382205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99ca6d9d066495aba5384420764c3d3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99ca6d9d066495aba5384420764c3d3"}]}] May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-VolumesNegativeTest-1806616041 May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 9b5f04c541a1451a93e200bf9b6a4a3e May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Volume tempest-invalid-69388025 could not be found. May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': 'tempest-invalid-69388025'} May 12 06:51:39.383489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-69388025 could not be found. (HTTP 404) (Request-ID: req-77f42df7-4f37-4329-a9d5-515d6f1b2575) May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:39.384416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 06:51:39.386211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-69388025 could not be found. May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:51:39.388373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-69388025 could not be found. May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-69388025 could not be found. May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8200ac85-3422-4801-89b4-71d6528ad3c3 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Returning 404 to user: Volume tempest-invalid-69388025 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8200ac85-3422-4801-89b4-71d6528ad3c3 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-69388025" status: 404 len: 97 microversion: 2.1 time: 1.021032 May 12 06:51:39.390755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1211 bytes} [Thu May 12 06:51:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-69388025 => generated 97 bytes in 1022 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 12 06:51:39.395163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-14d856c2-497b-4e96-bff9-9632bfa95760 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004329 May 12 06:51:39.395672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 4/5] 10.222.0.25 () {58 vars in 1139 bytes} [Thu May 12 06:51:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 12 06:51:39.412336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c10cbd0e-2d88-4a6d-9d62-fde0bd5d2ef7 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008648 May 12 06:51:39.412887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 5/6] 10.222.0.25 () {58 vars in 1136 bytes} [Thu May 12 06:51:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 06:51:39.422426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a6c69a08-ae23-4d0a-a2e0-ae1a9ac63d41 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Calling method '.version_select at 0x7f89dc165c10>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:39.563011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-a6c69a08-ae23-4d0a-a2e0-ae1a9ac63d41 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] HTTP exception thrown: Volume 32e49266-6d53-42d4-93bb-1404922a44f9 could not be found. May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a6c69a08-ae23-4d0a-a2e0-ae1a9ac63d41 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Request method failure captured: May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/os-volumes/32e49266-6d53-42d4-93bb-1404922a44f9 HTTP/1.1 May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK54R4RK2rk263nIdrng1baUH6dYRoP6v2w4o4FPseGtQWS8wOXv8U1nvFRxirnMhecfg-vcYxG-dVRYBkTzD-f5AOZtAmAE4mnMs_ZJw23BZyj314eeh3zOmACQVZ4bnbZkXxDtcIvL4sg7vvalLGO-VDxJDZxnwNIi4scSAGj29Q4 May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 06:51:39.565559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99ca6d9d066495aba5384420764c3d3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99ca6d9d066495aba5384420764c3d3"}]}] May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-VolumesNegativeTest-1806616041 May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 9b5f04c541a1451a93e200bf9b6a4a3e May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Volume 32e49266-6d53-42d4-93bb-1404922a44f9 could not be found. May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '32e49266-6d53-42d4-93bb-1404922a44f9'} May 12 06:51:39.566911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32e49266-6d53-42d4-93bb-1404922a44f9 could not be found. (HTTP 404) (Request-ID: req-4f141806-8e95-4b75-83a2-a1ff06c208ec) May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:39.567746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 06:51:39.568921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32e49266-6d53-42d4-93bb-1404922a44f9 could not be found. May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 06:51:39.570056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32e49266-6d53-42d4-93bb-1404922a44f9 could not be found. May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32e49266-6d53-42d4-93bb-1404922a44f9 could not be found. May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a6c69a08-ae23-4d0a-a2e0-ae1a9ac63d41 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Returning 404 to user: Volume 32e49266-6d53-42d4-93bb-1404922a44f9 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a6c69a08-ae23-4d0a-a2e0-ae1a9ac63d41 tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/32e49266-6d53-42d4-93bb-1404922a44f9" status: 404 len: 109 microversion: 2.1 time: 0.148710 May 12 06:51:39.571270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 6/7] 10.222.0.25 () {58 vars in 1247 bytes} [Thu May 12 06:51:39 2022] DELETE /compute/v2.1/os-volumes/32e49266-6d53-42d4-93bb-1404922a44f9 => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 06:51:39.584541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bc2243e6-dce8-4466-940d-7c370e86c3ea tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Calling method '.version_select at 0x7f89dc183940>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:40.041585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-bc2243e6-dce8-4466-940d-7c370e86c3ea tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] HTTP exception thrown: Volume 5c79b22f-1ffd-4f2a-9ced-dc33437a3b46 could not be found. May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bc2243e6-dce8-4466-940d-7c370e86c3ea tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Request method failure captured: May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/os-volumes/5c79b22f-1ffd-4f2a-9ced-dc33437a3b46 HTTP/1.1 May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK54R4RK2rk263nIdrng1baUH6dYRoP6v2w4o4FPseGtQWS8wOXv8U1nvFRxirnMhecfg-vcYxG-dVRYBkTzD-f5AOZtAmAE4mnMs_ZJw23BZyj314eeh3zOmACQVZ4bnbZkXxDtcIvL4sg7vvalLGO-VDxJDZxnwNIi4scSAGj29Q4 May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 06:51:40.044729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99ca6d9d066495aba5384420764c3d3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99ca6d9d066495aba5384420764c3d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99ca6d9d066495aba5384420764c3d3"}]}] May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-VolumesNegativeTest-1806616041 May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: c99ca6d9d066495aba5384420764c3d3 May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-VolumesNegativeTest-1806616041 May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 9b5f04c541a1451a93e200bf9b6a4a3e May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-VolumesNegativeTest-1806616041-project May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Volume 5c79b22f-1ffd-4f2a-9ced-dc33437a3b46 could not be found. May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '5c79b22f-1ffd-4f2a-9ced-dc33437a3b46'} May 12 06:51:40.046358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c79b22f-1ffd-4f2a-9ced-dc33437a3b46 could not be found. (HTTP 404) (Request-ID: req-b3027875-8c5b-45db-b149-d8f9d95d17b9) May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:40.047361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 06:51:40.048834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c79b22f-1ffd-4f2a-9ced-dc33437a3b46 could not be found. May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 06:51:40.050611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:51:40.051941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c79b22f-1ffd-4f2a-9ced-dc33437a3b46 could not be found. May 12 06:51:40.051941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:40.051941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:51:40.051941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:40.051941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:51:40.051941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:51:40.051941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:51:40.051941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:51:40.051941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:51:40.051941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c79b22f-1ffd-4f2a-9ced-dc33437a3b46 could not be found. May 12 06:51:40.051941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:51:40.054110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bc2243e6-dce8-4466-940d-7c370e86c3ea tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] Returning 404 to user: Volume 5c79b22f-1ffd-4f2a-9ced-dc33437a3b46 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:51:40.055244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bc2243e6-dce8-4466-940d-7c370e86c3ea tempest-VolumesNegativeTest-1806616041 tempest-VolumesNegativeTest-1806616041-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/5c79b22f-1ffd-4f2a-9ced-dc33437a3b46" status: 404 len: 109 microversion: 2.1 time: 0.482521 May 12 06:51:40.056752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 7/8] 10.222.0.25 () {58 vars in 1244 bytes} [Thu May 12 06:51:39 2022] GET /compute/v2.1/os-volumes/5c79b22f-1ffd-4f2a-9ced-dc33437a3b46 => generated 109 bytes in 484 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 06:51:40.563983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Flavor limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:51:40.563983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Image limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:51:40.563983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Flavor pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:51:40.563983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Image pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:51:40.792426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:51:40.792426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:40.792426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:40.792426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:40.794265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:40.794265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Getting quotas for project a3b3fff43ea54c74bb52d76d2264d008. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:51:40.794265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Getting quotas for user 0a93626f8db64b7193772320bfb3ed5a and project a3b3fff43ea54c74bb52d76d2264d008. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:51:40.794265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Going to run 1 instances... {{(pid=124025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:51:40.803946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:51:41.006060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b536affc-6e40-44c2-bf7c-7186a1c1063a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.813569 May 12 06:51:41.009918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 2/9] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 06:51:41.019776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8cdeaa7b-3440-4faa-b81d-96a25ebd475f tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:41.020636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8cdeaa7b-3440-4faa-b81d-96a25ebd475f tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:41.274384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8cdeaa7b-3440-4faa-b81d-96a25ebd475f tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:41.319744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8cdeaa7b-3440-4faa-b81d-96a25ebd475f tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1215 microversion: 2.1 time: 0.303513 May 12 06:51:41.334216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 8/10] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:41 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1215 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:51:42.349536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d9b4399d-df8d-4071-a865-5208f1e51431 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:42.350862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d9b4399d-df8d-4071-a865-5208f1e51431 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:42.502836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d9b4399d-df8d-4071-a865-5208f1e51431 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:42.524596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d9b4399d-df8d-4071-a865-5208f1e51431 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1215 microversion: 2.1 time: 0.177541 May 12 06:51:42.527289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 3/11] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:42 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:51:43.544120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3715a0cf-3ea6-4b33-821f-5e42521e6797 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:43.545483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3715a0cf-3ea6-4b33-821f-5e42521e6797 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:43.704759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3715a0cf-3ea6-4b33-821f-5e42521e6797 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:43.713743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3715a0cf-3ea6-4b33-821f-5e42521e6797 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1215 microversion: 2.1 time: 0.173088 May 12 06:51:43.720501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 9/12] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:43 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:51:44.737178 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9ac6b9b5-e536-45f0-8c70-795d72a0430a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:44.738434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9ac6b9b5-e536-45f0-8c70-795d72a0430a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:44.752013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ac6b9b5-e536-45f0-8c70-795d72a0430a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:44.760697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ac6b9b5-e536-45f0-8c70-795d72a0430a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:44.761930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ac6b9b5-e536-45f0-8c70-795d72a0430a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:44.764838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ac6b9b5-e536-45f0-8c70-795d72a0430a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:45.054147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9ac6b9b5-e536-45f0-8c70-795d72a0430a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:45.073045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9ac6b9b5-e536-45f0-8c70-795d72a0430a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1211 microversion: 2.1 time: 0.340296 May 12 06:51:45.086508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 4/13] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:44 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1211 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:51:46.093763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-98295bb4-12f7-4728-9a90-005d89b23088 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:46.094380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-98295bb4-12f7-4728-9a90-005d89b23088 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:46.111446 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98295bb4-12f7-4728-9a90-005d89b23088 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:46.111927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98295bb4-12f7-4728-9a90-005d89b23088 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:46.112704 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98295bb4-12f7-4728-9a90-005d89b23088 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:46.113138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98295bb4-12f7-4728-9a90-005d89b23088 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:47.020711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-98295bb4-12f7-4728-9a90-005d89b23088 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:47.030289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-98295bb4-12f7-4728-9a90-005d89b23088 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1211 microversion: 2.1 time: 0.940432 May 12 06:51:47.035815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 10/14] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:46 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1211 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:51:48.065244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4471e7da-cd2c-4824-98c4-ae84f4701cdd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:48.066030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4471e7da-cd2c-4824-98c4-ae84f4701cdd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:48.086541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4471e7da-cd2c-4824-98c4-ae84f4701cdd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:48.090454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4471e7da-cd2c-4824-98c4-ae84f4701cdd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:48.095070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4471e7da-cd2c-4824-98c4-ae84f4701cdd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:48.096026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4471e7da-cd2c-4824-98c4-ae84f4701cdd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:48.353774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4471e7da-cd2c-4824-98c4-ae84f4701cdd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:48.367492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4471e7da-cd2c-4824-98c4-ae84f4701cdd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1267 microversion: 2.1 time: 0.315487 May 12 06:51:48.372439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 5/15] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:48 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1267 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:51:49.407221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c8d891c7-b113-4cc6-8689-dc90345ce9d1 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:49.410610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c8d891c7-b113-4cc6-8689-dc90345ce9d1 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:49.433161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8d891c7-b113-4cc6-8689-dc90345ce9d1 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:49.443252 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8d891c7-b113-4cc6-8689-dc90345ce9d1 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:49.453935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8d891c7-b113-4cc6-8689-dc90345ce9d1 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:49.453935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8d891c7-b113-4cc6-8689-dc90345ce9d1 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:49.621617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c8d891c7-b113-4cc6-8689-dc90345ce9d1 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:49.629942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c8d891c7-b113-4cc6-8689-dc90345ce9d1 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1267 microversion: 2.1 time: 0.248608 May 12 06:51:49.631808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 6/16] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:49 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:51:49.822623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a451bd45-794a-4317-b17d-900393116ef2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Action: 'create', calling method: .version_select at 0x7f89dc0bff70>, body: {"keypair": {"name": "tempest-keypair-213658667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCt5Mtn3JaVQdZ11QL8oLK/2lV56EgnOuns6k4RBt/PwgWYpj/SELrXKzmmdOkwrfg4GOfw6Qap28waKO0PQl0AVfRhjQqhr+6/RTgIMASmP/AOsISklEzuiQL4UB5zLBw=="}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:51:49.893390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-a451bd45-794a-4317-b17d-900393116ef2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:51:49.908036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-a451bd45-794a-4317-b17d-900393116ef2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for user d77bf80654c24c8c8336ce395f789ccb and project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:51:50.092711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a451bd45-794a-4317-b17d-900393116ef2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.889756 May 12 06:51:50.093502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 11/17] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 12 06:51:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:51:50.649641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6eb7b3d8-7b5c-4de0-9436-d2bdd5ab8632 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:50.651797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6eb7b3d8-7b5c-4de0-9436-d2bdd5ab8632 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:50.657862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6eb7b3d8-7b5c-4de0-9436-d2bdd5ab8632 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:50.658637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6eb7b3d8-7b5c-4de0-9436-d2bdd5ab8632 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:50.661207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6eb7b3d8-7b5c-4de0-9436-d2bdd5ab8632 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:50.661850 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6eb7b3d8-7b5c-4de0-9436-d2bdd5ab8632 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:50.848228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6eb7b3d8-7b5c-4de0-9436-d2bdd5ab8632 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:50.864538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6eb7b3d8-7b5c-4de0-9436-d2bdd5ab8632 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1267 microversion: 2.1 time: 0.218467 May 12 06:51:50.865963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 7/18] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:50 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:51:51.883707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-edd03fce-3199-4512-9de3-1afdb4c1de6b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:51.884336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-edd03fce-3199-4512-9de3-1afdb4c1de6b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:51.893806 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edd03fce-3199-4512-9de3-1afdb4c1de6b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:51.905013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edd03fce-3199-4512-9de3-1afdb4c1de6b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:51.906011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edd03fce-3199-4512-9de3-1afdb4c1de6b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:51.908871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edd03fce-3199-4512-9de3-1afdb4c1de6b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:52.119616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-edd03fce-3199-4512-9de3-1afdb4c1de6b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:52.129556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-edd03fce-3199-4512-9de3-1afdb4c1de6b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1273 microversion: 2.1 time: 0.250915 May 12 06:51:52.131028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 12/19] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:51 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:51:52.471926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-78e3d7ba-c397-4c06-8d69-13f5fd8fec98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Action: 'create', calling method: .version_select at 0x7f89daff40d0>, body: {"keypair": {"name": "tempest-keypair-1108455361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRTTBAKxZgFX64dJHXLpQk2DoL57v9JW7LBdRcwV0J59o1FuSIRLKePEQ2tu4Tq5XqUEyYQp4EqlL00IvM6DOBKTPQj64RUmjn5p/UCJBXxNu8955aL7un57tIAd81lQg=="}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:51:52.529801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-78e3d7ba-c397-4c06-8d69-13f5fd8fec98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Getting quotas for project 91ccbfb303dc40a7a2313fe5e6ab3332. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:51:52.541192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-78e3d7ba-c397-4c06-8d69-13f5fd8fec98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Getting quotas for user 9f11c63feb0740aeb5283907c8b61680 and project 91ccbfb303dc40a7a2313fe5e6ab3332. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:51:52.548263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1574957982", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:51:52.662711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.network.neutron [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] validate_networks() for [('4489a095-1a64-45d5-bdcd-998cb94b654c', None, None, None, None, None)] {{(pid=124024) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:51:52.716034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-78e3d7ba-c397-4c06-8d69-13f5fd8fec98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.762674 May 12 06:51:52.716649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 8/20] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 12 06:51:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:51:53.157939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-667b611c-be5c-42b0-8621-909027adf6ac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:53.158586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-667b611c-be5c-42b0-8621-909027adf6ac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:53.169030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-667b611c-be5c-42b0-8621-909027adf6ac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:53.169686 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-667b611c-be5c-42b0-8621-909027adf6ac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:53.170631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-667b611c-be5c-42b0-8621-909027adf6ac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:53.172535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-667b611c-be5c-42b0-8621-909027adf6ac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:53.407090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-667b611c-be5c-42b0-8621-909027adf6ac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:53.419185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-667b611c-be5c-42b0-8621-909027adf6ac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1273 microversion: 2.1 time: 0.266088 May 12 06:51:53.419808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 9/21] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:53 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:51:54.438896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0227a0e9-2e28-4ae1-b8c8-38603c96146b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:54.440549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0227a0e9-2e28-4ae1-b8c8-38603c96146b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:54.458066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0227a0e9-2e28-4ae1-b8c8-38603c96146b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:54.460692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0227a0e9-2e28-4ae1-b8c8-38603c96146b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:54.462487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0227a0e9-2e28-4ae1-b8c8-38603c96146b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:54.467279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0227a0e9-2e28-4ae1-b8c8-38603c96146b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:54.835976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0227a0e9-2e28-4ae1-b8c8-38603c96146b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:54.867221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0227a0e9-2e28-4ae1-b8c8-38603c96146b tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1273 microversion: 2.1 time: 0.433464 May 12 06:51:54.874901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 10/22] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:54 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1273 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:51:55.891598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-97e77a6d-3192-4dee-8275-2a29003550e3 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:55.893368 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-97e77a6d-3192-4dee-8275-2a29003550e3 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:55.907396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97e77a6d-3192-4dee-8275-2a29003550e3 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:55.914874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97e77a6d-3192-4dee-8275-2a29003550e3 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:55.918474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97e77a6d-3192-4dee-8275-2a29003550e3 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:55.920498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97e77a6d-3192-4dee-8275-2a29003550e3 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:56.171332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Flavor limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:51:56.171332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Image limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:51:56.172056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Flavor pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:51:56.172146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Image pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:51:56.172555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:51:56.193614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:56.194086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:56.194910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:51:56.195353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:51:56.255340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Getting quotas for project b772df3ea0d9417188aab057dce4d320. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:51:56.263728 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Getting quotas for user 13ef78da38e941b3a09f1de838581d54 and project b772df3ea0d9417188aab057dce4d320. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:51:56.287732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Going to run 1 instances... {{(pid=124024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:51:56.313908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:51:56.540509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8a3fd21f-30b8-46f4-8f5e-80cb32e709bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.345599 May 12 06:51:56.546483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 13/23] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:51:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 4352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 06:51:56.560589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-326249469", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "940de373-828a-40b3-8a07-fc0aff461153"}], "security_groups": [{"name": "tempest-securitygroup--818144519"}], "key_name": "tempest-keypair-213658667", "user_data": "}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:51:56.627346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97e77a6d-3192-4dee-8275-2a29003550e3 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:56.636798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-97e77a6d-3192-4dee-8275-2a29003550e3 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.750141 May 12 06:51:56.671676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 11/24] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:55 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:51:56.689708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-538d9c53-02f3-4e90-aeda-ebbc2952d53c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:51:56.695269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-538d9c53-02f3-4e90-aeda-ebbc2952d53c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:51:56.953538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.network.neutron [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] validate_networks() for [('940de373-828a-40b3-8a07-fc0aff461153', None, None, None, None, None)] {{(pid=124024) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:51:56.999559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-538d9c53-02f3-4e90-aeda-ebbc2952d53c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:51:57.010695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-538d9c53-02f3-4e90-aeda-ebbc2952d53c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1222 microversion: 2.1 time: 0.336642 May 12 06:51:57.021671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:51:56 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1222 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:51:57.511761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-881214262", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:51:57.728534 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.network.neutron [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] validate_networks() for [('4489a095-1a64-45d5-bdcd-998cb94b654c', None, None, None, None, None)] {{(pid=124025) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:52:00.783750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Flavor limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:52:00.784313 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Image limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:52:00.784975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Flavor pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:52:00.785771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Image pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:52:00.786014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:52:00.807185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:00.809538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:00.811461 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:00.812168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:00.850772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:52:00.873517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for user d77bf80654c24c8c8336ce395f789ccb and project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:52:00.891027 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Going to run 1 instances... {{(pid=124024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:52:00.902531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:52:00.937637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Flavor limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:52:00.938687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Image limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:52:00.939327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Flavor pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:52:00.940101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Image pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:52:00.942532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:52:00.981930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:00.984333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:00.986253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:00.996429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:01.042625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-afe86beb-6e3f-4adc-8bb2-9ec77c25820b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.493479 May 12 06:52:01.043258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 14/26] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:51:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 4496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 06:52:01.050853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2a6560a2-c025-42ae-8620-9120f52f78d2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:01.052457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2a6560a2-c025-42ae-8620-9120f52f78d2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:01.065370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Getting quotas for project b772df3ea0d9417188aab057dce4d320. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:52:01.067739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a6560a2-c025-42ae-8620-9120f52f78d2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:01.068902 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a6560a2-c025-42ae-8620-9120f52f78d2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:01.069564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a6560a2-c025-42ae-8620-9120f52f78d2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:01.070409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a6560a2-c025-42ae-8620-9120f52f78d2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:01.075083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Getting quotas for user 13ef78da38e941b3a09f1de838581d54 and project b772df3ea0d9417188aab057dce4d320. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:52:01.104680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Going to run 1 instances... {{(pid=124025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:52:01.107292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:52:01.329144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2d6773d7-e129-4997-aad4-17e1ae857113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.829777 May 12 06:52:01.332950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 13/27] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:51:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 3835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 06:52:01.370443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-833306429", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da0f96e3-1311-43e5-90e2-f64c5fdcda1b"}], "security_groups": [{"name": "tempest-securitygroup--292403456"}], "key_name": "tempest-keypair-1108455361", "user_data": "}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:01.915392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.network.neutron [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] validate_networks() for [('da0f96e3-1311-43e5-90e2-f64c5fdcda1b', None, None, None, None, None)] {{(pid=124025) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:52:02.193126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2a6560a2-c025-42ae-8620-9120f52f78d2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:02.209468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2a6560a2-c025-42ae-8620-9120f52f78d2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 1.164503 May 12 06:52:02.222840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 15/28] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:01 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:02.225568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0b11da3e-0bf4-4589-ad65-492c5b81329c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:02.226386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0b11da3e-0bf4-4589-ad65-492c5b81329c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:02.388307 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0b11da3e-0bf4-4589-ad65-492c5b81329c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:02.395048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0b11da3e-0bf4-4589-ad65-492c5b81329c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1240 microversion: 2.1 time: 0.173678 May 12 06:52:02.395644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 16/29] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:02 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1240 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:02.411920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d752bbcc-5408-4aac-9ede-877495d1b9ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:02.413540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d752bbcc-5408-4aac-9ede-877495d1b9ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:02.927126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d752bbcc-5408-4aac-9ede-877495d1b9ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:02.944538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d752bbcc-5408-4aac-9ede-877495d1b9ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1221 microversion: 2.1 time: 0.541128 May 12 06:52:02.958624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 17/30] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:02 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1221 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:03.226910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-23638ee2-061b-4bc3-947e-bc4fcad40a8a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:03.231006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-23638ee2-061b-4bc3-947e-bc4fcad40a8a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:03.241532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23638ee2-061b-4bc3-947e-bc4fcad40a8a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:03.242478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23638ee2-061b-4bc3-947e-bc4fcad40a8a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:03.248159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23638ee2-061b-4bc3-947e-bc4fcad40a8a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:03.249832 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23638ee2-061b-4bc3-947e-bc4fcad40a8a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:03.572972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Flavor limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:52:03.572972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Image limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:52:03.573710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Flavor pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:52:03.574077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Image pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:52:03.574667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:52:03.613353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:03.613353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:03.613353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:03.623292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:03.712942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Getting quotas for project 91ccbfb303dc40a7a2313fe5e6ab3332. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:52:03.723001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Getting quotas for user 9f11c63feb0740aeb5283907c8b61680 and project 91ccbfb303dc40a7a2313fe5e6ab3332. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:52:03.786461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Going to run 1 instances... {{(pid=124025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:52:03.795196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:52:04.024902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c7172472-1149-41a0-947e-85c15a1878b5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.687736 May 12 06:52:04.026599 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 14/31] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:52:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 2693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 06:52:04.043733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ab616777-337d-4860-8c23-acaf2d7ba005 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:04.043733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ab616777-337d-4860-8c23-acaf2d7ba005 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:04.043733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab616777-337d-4860-8c23-acaf2d7ba005 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:04.043733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab616777-337d-4860-8c23-acaf2d7ba005 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:04.044878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab616777-337d-4860-8c23-acaf2d7ba005 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:04.045760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab616777-337d-4860-8c23-acaf2d7ba005 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:04.404131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ab616777-337d-4860-8c23-acaf2d7ba005 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:04.418851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ab616777-337d-4860-8c23-acaf2d7ba005 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1292 microversion: 2.1 time: 0.390379 May 12 06:52:04.464282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 15/32] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:04 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1292 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:04.615542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-23638ee2-061b-4bc3-947e-bc4fcad40a8a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:04.635915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-23638ee2-061b-4bc3-947e-bc4fcad40a8a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 1.413238 May 12 06:52:04.644088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 18/33] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:03 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:04.681025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b30da704-fafe-4064-9bcb-e3c183608e1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:04.686133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b30da704-fafe-4064-9bcb-e3c183608e1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:04.708593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b30da704-fafe-4064-9bcb-e3c183608e1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:04.723874 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b30da704-fafe-4064-9bcb-e3c183608e1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:04.727841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b30da704-fafe-4064-9bcb-e3c183608e1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:04.728618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b30da704-fafe-4064-9bcb-e3c183608e1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:04.928389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b30da704-fafe-4064-9bcb-e3c183608e1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:04.937211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b30da704-fafe-4064-9bcb-e3c183608e1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1273 microversion: 2.1 time: 0.291616 May 12 06:52:04.952063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 19/34] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:04 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1273 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:04.979124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a0797220-3c1b-4853-9a8b-2d6ce4e7aa01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:04.979124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a0797220-3c1b-4853-9a8b-2d6ce4e7aa01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:05.069050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-f6d58afd-efc6-42e5-a834-6755a9483492 req-b74ae6e6-1a8e-4bb6-87bd-b783435316bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff2372e-1d0c-451a-9133-670b69144366", "tag": "fc53d3cb-2af6-4766-84ac-ed178ee084d1"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:05.094009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-f6d58afd-efc6-42e5-a834-6755a9483492 req-b74ae6e6-1a8e-4bb6-87bd-b783435316bd service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:05.096022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-f6d58afd-efc6-42e5-a834-6755a9483492 req-b74ae6e6-1a8e-4bb6-87bd-b783435316bd service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:05.162456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-f6d58afd-efc6-42e5-a834-6755a9483492 req-b74ae6e6-1a8e-4bb6-87bd-b783435316bd service nova] Creating event network-changed:fc53d3cb-2af6-4766-84ac-ed178ee084d1 for instance 1ff2372e-1d0c-451a-9133-670b69144366 on hv-cinder-76606 May 12 06:52:05.163712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-f6d58afd-efc6-42e5-a834-6755a9483492 req-b74ae6e6-1a8e-4bb6-87bd-b783435316bd service nova] Acquired lock "compute-rpcapi-router" {{(pid=124025) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 06:52:05.168447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e71ea7c2-b90d-45f7-a102-da325ddc0648 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:05.169530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e71ea7c2-b90d-45f7-a102-da325ddc0648 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:05.173693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e71ea7c2-b90d-45f7-a102-da325ddc0648 None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:05.174500 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e71ea7c2-b90d-45f7-a102-da325ddc0648 None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:05.195595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.compute.rpcapi [None req-e71ea7c2-b90d-45f7-a102-da325ddc0648 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 06:52:05.199566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e71ea7c2-b90d-45f7-a102-da325ddc0648 None None] Releasing lock "compute-rpcapi-router" {{(pid=124025) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 06:52:05.245285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e71ea7c2-b90d-45f7-a102-da325ddc0648 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.772063 May 12 06:52:05.246117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 16/35] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:05.247725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a0797220-3c1b-4853-9a8b-2d6ce4e7aa01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:05.259843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a0797220-3c1b-4853-9a8b-2d6ce4e7aa01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1237 microversion: 2.1 time: 0.304853 May 12 06:52:05.273028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 20/36] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:04 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1237 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:05.486598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f33aa7fc-bc31-4114-9ffd-c96753f51180 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:05.486598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f33aa7fc-bc31-4114-9ffd-c96753f51180 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:05.504282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f33aa7fc-bc31-4114-9ffd-c96753f51180 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:05.506116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f33aa7fc-bc31-4114-9ffd-c96753f51180 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:05.507850 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f33aa7fc-bc31-4114-9ffd-c96753f51180 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:05.509124 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f33aa7fc-bc31-4114-9ffd-c96753f51180 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:05.668043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5d75a522-25ae-4a08-a2d9-fd7557f9dd98 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:05.668739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5d75a522-25ae-4a08-a2d9-fd7557f9dd98 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:05.689433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5d75a522-25ae-4a08-a2d9-fd7557f9dd98 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:05.689879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5d75a522-25ae-4a08-a2d9-fd7557f9dd98 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:05.690686 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5d75a522-25ae-4a08-a2d9-fd7557f9dd98 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:05.691131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5d75a522-25ae-4a08-a2d9-fd7557f9dd98 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:05.871594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f33aa7fc-bc31-4114-9ffd-c96753f51180 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:05.886474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f33aa7fc-bc31-4114-9ffd-c96753f51180 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1298 microversion: 2.1 time: 0.407423 May 12 06:52:05.886474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 17/37] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:05 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1298 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:05.968991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-23961969-485a-457d-af3d-0a9580c3a6a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:05.969610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-23961969-485a-457d-af3d-0a9580c3a6a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:05.992687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23961969-485a-457d-af3d-0a9580c3a6a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:05.993217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23961969-485a-457d-af3d-0a9580c3a6a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:05.993985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23961969-485a-457d-af3d-0a9580c3a6a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:05.995015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23961969-485a-457d-af3d-0a9580c3a6a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:06.188348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-23961969-485a-457d-af3d-0a9580c3a6a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:06.199261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-23961969-485a-457d-af3d-0a9580c3a6a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1279 microversion: 2.1 time: 0.233948 May 12 06:52:06.201064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 18/38] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:05 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1279 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:06.279818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-01cb8d2f-93f1-47f7-a07f-9485643e9a4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:06.280699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-01cb8d2f-93f1-47f7-a07f-9485643e9a4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:06.291200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01cb8d2f-93f1-47f7-a07f-9485643e9a4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:06.294304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01cb8d2f-93f1-47f7-a07f-9485643e9a4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:06.295388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01cb8d2f-93f1-47f7-a07f-9485643e9a4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:06.296798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01cb8d2f-93f1-47f7-a07f-9485643e9a4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:06.368454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5d75a522-25ae-4a08-a2d9-fd7557f9dd98 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:06.391298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5d75a522-25ae-4a08-a2d9-fd7557f9dd98 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.735849 May 12 06:52:06.392022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 21/39] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:05 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:06.592914 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-01cb8d2f-93f1-47f7-a07f-9485643e9a4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:06.600393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-01cb8d2f-93f1-47f7-a07f-9485643e9a4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1241 microversion: 2.1 time: 0.326331 May 12 06:52:06.604337 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 19/40] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:06 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1241 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:06.903673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1590ec0b-4ba0-4e29-a04f-cdb1ed778d07 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:06.904308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1590ec0b-4ba0-4e29-a04f-cdb1ed778d07 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:06.921041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1590ec0b-4ba0-4e29-a04f-cdb1ed778d07 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:06.922383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1590ec0b-4ba0-4e29-a04f-cdb1ed778d07 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:06.923928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1590ec0b-4ba0-4e29-a04f-cdb1ed778d07 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:06.925306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1590ec0b-4ba0-4e29-a04f-cdb1ed778d07 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:07.101881 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1590ec0b-4ba0-4e29-a04f-cdb1ed778d07 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:07.112258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1590ec0b-4ba0-4e29-a04f-cdb1ed778d07 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1298 microversion: 2.1 time: 0.212767 May 12 06:52:07.116989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 22/41] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:06 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1298 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:07.218415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e80b41e1-b8a5-4a35-818d-e9f9802603f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:07.219717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e80b41e1-b8a5-4a35-818d-e9f9802603f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:07.231615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e80b41e1-b8a5-4a35-818d-e9f9802603f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:07.236798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e80b41e1-b8a5-4a35-818d-e9f9802603f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:07.238459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e80b41e1-b8a5-4a35-818d-e9f9802603f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:07.239058 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e80b41e1-b8a5-4a35-818d-e9f9802603f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:07.417160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-21fc78ab-7873-4f40-855b-198dd58ac733 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:07.417779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-21fc78ab-7873-4f40-855b-198dd58ac733 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:07.428658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e80b41e1-b8a5-4a35-818d-e9f9802603f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:07.438565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e80b41e1-b8a5-4a35-818d-e9f9802603f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1279 microversion: 2.1 time: 0.223947 May 12 06:52:07.449821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21fc78ab-7873-4f40-855b-198dd58ac733 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:07.450551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 20/42] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:07 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1279 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:07.450802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21fc78ab-7873-4f40-855b-198dd58ac733 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:07.462579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21fc78ab-7873-4f40-855b-198dd58ac733 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:07.464178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21fc78ab-7873-4f40-855b-198dd58ac733 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:07.618357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d53ca88b-c418-4417-bdf3-88fdf3f8f593 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:07.618899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d53ca88b-c418-4417-bdf3-88fdf3f8f593 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:07.625292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d53ca88b-c418-4417-bdf3-88fdf3f8f593 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:07.625746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d53ca88b-c418-4417-bdf3-88fdf3f8f593 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:07.627821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d53ca88b-c418-4417-bdf3-88fdf3f8f593 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:07.628267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d53ca88b-c418-4417-bdf3-88fdf3f8f593 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:07.778984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d53ca88b-c418-4417-bdf3-88fdf3f8f593 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:07.790607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d53ca88b-c418-4417-bdf3-88fdf3f8f593 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1289 microversion: 2.1 time: 0.173889 May 12 06:52:07.791778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 21/43] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:07 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1289 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:07.982646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-21fc78ab-7873-4f40-855b-198dd58ac733 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:08.002611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-21fc78ab-7873-4f40-855b-198dd58ac733 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.588416 May 12 06:52:08.002611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 23/44] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:07 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:08.133156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e3f2a432-be6b-4b12-92fc-1e66fe332983 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:08.134415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e3f2a432-be6b-4b12-92fc-1e66fe332983 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:08.146793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3f2a432-be6b-4b12-92fc-1e66fe332983 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:08.146793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3f2a432-be6b-4b12-92fc-1e66fe332983 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:08.146793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3f2a432-be6b-4b12-92fc-1e66fe332983 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:08.146793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3f2a432-be6b-4b12-92fc-1e66fe332983 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:08.323510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e3f2a432-be6b-4b12-92fc-1e66fe332983 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:08.336215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e3f2a432-be6b-4b12-92fc-1e66fe332983 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1298 microversion: 2.1 time: 0.206571 May 12 06:52:08.358417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 22/45] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:08 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1298 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:08.461363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1d8a9083-5bf1-4531-ad71-4653c7ddb119 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:08.463558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1d8a9083-5bf1-4531-ad71-4653c7ddb119 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:08.476430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d8a9083-5bf1-4531-ad71-4653c7ddb119 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:08.476430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d8a9083-5bf1-4531-ad71-4653c7ddb119 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:08.476430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d8a9083-5bf1-4531-ad71-4653c7ddb119 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:08.476430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d8a9083-5bf1-4531-ad71-4653c7ddb119 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:08.587437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1d8a9083-5bf1-4531-ad71-4653c7ddb119 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:08.595927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1d8a9083-5bf1-4531-ad71-4653c7ddb119 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1279 microversion: 2.1 time: 0.141994 May 12 06:52:08.598938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 24/46] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:08 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1279 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:08.808790 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-eebdf1b4-aecc-49ba-8f92-6aa671bde396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:08.809405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-eebdf1b4-aecc-49ba-8f92-6aa671bde396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:08.825746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eebdf1b4-aecc-49ba-8f92-6aa671bde396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:08.826202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eebdf1b4-aecc-49ba-8f92-6aa671bde396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:08.827000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eebdf1b4-aecc-49ba-8f92-6aa671bde396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:08.827439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eebdf1b4-aecc-49ba-8f92-6aa671bde396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:09.000095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-eebdf1b4-aecc-49ba-8f92-6aa671bde396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:09.019710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-eebdf1b4-aecc-49ba-8f92-6aa671bde396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1295 microversion: 2.1 time: 0.207971 May 12 06:52:09.027483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 23/47] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:08 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1295 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:09.027956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-13ea22c2-f018-47c8-94c4-a84ea096e24a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:09.030640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-13ea22c2-f018-47c8-94c4-a84ea096e24a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:09.045714 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13ea22c2-f018-47c8-94c4-a84ea096e24a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:09.046244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13ea22c2-f018-47c8-94c4-a84ea096e24a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:09.046962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13ea22c2-f018-47c8-94c4-a84ea096e24a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:09.047381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13ea22c2-f018-47c8-94c4-a84ea096e24a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:09.355988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-636970f6-9b6f-49a2-b44b-4e13457a2b59 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:09.399644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-636970f6-9b6f-49a2-b44b-4e13457a2b59 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:09.399644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-636970f6-9b6f-49a2-b44b-4e13457a2b59 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:09.399644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-636970f6-9b6f-49a2-b44b-4e13457a2b59 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:09.399644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-636970f6-9b6f-49a2-b44b-4e13457a2b59 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:09.400284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-636970f6-9b6f-49a2-b44b-4e13457a2b59 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:09.400425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-13ea22c2-f018-47c8-94c4-a84ea096e24a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:09.400425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-13ea22c2-f018-47c8-94c4-a84ea096e24a tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.365675 May 12 06:52:09.400425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 25/48] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:09 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:09.847374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-98142a30-df73-4723-9fe4-4b9b6efcda87 req-67d269aa-c575-4228-a001-21d4fb5374d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15", "tag": "1c97b15f-78b6-4633-9ef7-e577a30995a1"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:09.864024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-98142a30-df73-4723-9fe4-4b9b6efcda87 req-67d269aa-c575-4228-a001-21d4fb5374d2 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:09.864463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-98142a30-df73-4723-9fe4-4b9b6efcda87 req-67d269aa-c575-4228-a001-21d4fb5374d2 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:09.921793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-98142a30-df73-4723-9fe4-4b9b6efcda87 req-67d269aa-c575-4228-a001-21d4fb5374d2 service nova] Creating event network-changed:1c97b15f-78b6-4633-9ef7-e577a30995a1 for instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 on hv-cinder-76606 May 12 06:52:09.922362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-98142a30-df73-4723-9fe4-4b9b6efcda87 req-67d269aa-c575-4228-a001-21d4fb5374d2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124024) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 06:52:09.923537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c4cc3ea-31f7-4040-8e32-28c18244baf8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:09.925435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-636970f6-9b6f-49a2-b44b-4e13457a2b59 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:09.928678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c4cc3ea-31f7-4040-8e32-28c18244baf8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:09.930145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c4cc3ea-31f7-4040-8e32-28c18244baf8 None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:09.931272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c4cc3ea-31f7-4040-8e32-28c18244baf8 None None] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:09.937838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-636970f6-9b6f-49a2-b44b-4e13457a2b59 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.587047 May 12 06:52:09.939042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 24/49] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:09 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:09.960318 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d1558a21-700b-4466-bb67-e434433b07fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:09.962303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d1558a21-700b-4466-bb67-e434433b07fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:09.966594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.compute.rpcapi [None req-0c4cc3ea-31f7-4040-8e32-28c18244baf8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 06:52:09.967977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c4cc3ea-31f7-4040-8e32-28c18244baf8 None None] Releasing lock "compute-rpcapi-router" {{(pid=124024) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 06:52:09.979280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d1558a21-700b-4466-bb67-e434433b07fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:09.979795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d1558a21-700b-4466-bb67-e434433b07fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:09.980602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d1558a21-700b-4466-bb67-e434433b07fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:09.981049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d1558a21-700b-4466-bb67-e434433b07fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:10.033305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0c4cc3ea-31f7-4040-8e32-28c18244baf8 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.574609 May 12 06:52:10.033861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 26/50] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:52:10.046060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-81502ff5-cccf-4f11-8588-9341010e27de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:10.046865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-81502ff5-cccf-4f11-8588-9341010e27de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:10.064248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81502ff5-cccf-4f11-8588-9341010e27de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:10.077107 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81502ff5-cccf-4f11-8588-9341010e27de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:10.078162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81502ff5-cccf-4f11-8588-9341010e27de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:10.079948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81502ff5-cccf-4f11-8588-9341010e27de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:10.184999 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-81502ff5-cccf-4f11-8588-9341010e27de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:10.196601 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d1558a21-700b-4466-bb67-e434433b07fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:10.200841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-81502ff5-cccf-4f11-8588-9341010e27de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1295 microversion: 2.1 time: 0.151796 May 12 06:52:10.216181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d1558a21-700b-4466-bb67-e434433b07fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1279 microversion: 2.1 time: 0.275786 May 12 06:52:10.216639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 27/51] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:10 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1295 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:10.217878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 25/52] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:09 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:10.406143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0540cca6-3c6a-4cc9-ad3a-58f40ef5b366 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:10.414315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0540cca6-3c6a-4cc9-ad3a-58f40ef5b366 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:10.414315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0540cca6-3c6a-4cc9-ad3a-58f40ef5b366 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:10.414315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0540cca6-3c6a-4cc9-ad3a-58f40ef5b366 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:10.415434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0540cca6-3c6a-4cc9-ad3a-58f40ef5b366 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:10.415936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0540cca6-3c6a-4cc9-ad3a-58f40ef5b366 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:10.714157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0540cca6-3c6a-4cc9-ad3a-58f40ef5b366 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:10.725840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0540cca6-3c6a-4cc9-ad3a-58f40ef5b366 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.322860 May 12 06:52:10.726930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 28/53] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:10 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:10.955435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7b6380aa-74d4-49d4-9a5a-814da6283671 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:10.956997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7b6380aa-74d4-49d4-9a5a-814da6283671 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:10.968318 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b6380aa-74d4-49d4-9a5a-814da6283671 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:10.969367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b6380aa-74d4-49d4-9a5a-814da6283671 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:10.971468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b6380aa-74d4-49d4-9a5a-814da6283671 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:10.973944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b6380aa-74d4-49d4-9a5a-814da6283671 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:11.223941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1e017320-1475-43a1-a68d-fd30968243e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:11.224809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1e017320-1475-43a1-a68d-fd30968243e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:11.231348 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e017320-1475-43a1-a68d-fd30968243e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:11.239526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e017320-1475-43a1-a68d-fd30968243e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:11.239526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e017320-1475-43a1-a68d-fd30968243e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:11.239526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e017320-1475-43a1-a68d-fd30968243e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:11.401600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7b6380aa-74d4-49d4-9a5a-814da6283671 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:11.408420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7b6380aa-74d4-49d4-9a5a-814da6283671 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.456670 May 12 06:52:11.409822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 26/54] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:10 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:11.419376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2484d553-4a49-41fd-9dde-46623b0cc4fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:11.420998 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2484d553-4a49-41fd-9dde-46623b0cc4fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:11.429390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2484d553-4a49-41fd-9dde-46623b0cc4fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:11.430897 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2484d553-4a49-41fd-9dde-46623b0cc4fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:11.432085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2484d553-4a49-41fd-9dde-46623b0cc4fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:11.432730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2484d553-4a49-41fd-9dde-46623b0cc4fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:11.519629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1e017320-1475-43a1-a68d-fd30968243e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:11.530312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1e017320-1475-43a1-a68d-fd30968243e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.312680 May 12 06:52:11.544620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 29/55] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:11 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:11.736031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2484d553-4a49-41fd-9dde-46623b0cc4fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:11.746426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a1857884-3928-45ed-83bb-2da599ac03cb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:11.746426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a1857884-3928-45ed-83bb-2da599ac03cb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:11.748926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2484d553-4a49-41fd-9dde-46623b0cc4fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.337603 May 12 06:52:11.750195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 27/56] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:11 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:11.762438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a1857884-3928-45ed-83bb-2da599ac03cb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:11.775759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a1857884-3928-45ed-83bb-2da599ac03cb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:11.782867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a1857884-3928-45ed-83bb-2da599ac03cb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:11.783340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a1857884-3928-45ed-83bb-2da599ac03cb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:12.102172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-3cb1810b-2abe-49f9-bcdf-7b67823db1b3 req-7bdc3c8f-7fd3-4ac0-906c-17b6cdc8a14d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0baa16c3-ab5a-4e93-a65d-1e038d4af279", "tag": "ef0e8620-aa0e-40bc-834f-7d8adc3412c6"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:12.113091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a1857884-3928-45ed-83bb-2da599ac03cb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:12.121972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a1857884-3928-45ed-83bb-2da599ac03cb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.383027 May 12 06:52:12.131499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 30/57] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:11 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:12.141275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-3cb1810b-2abe-49f9-bcdf-7b67823db1b3 req-7bdc3c8f-7fd3-4ac0-906c-17b6cdc8a14d service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:12.148562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-3cb1810b-2abe-49f9-bcdf-7b67823db1b3 req-7bdc3c8f-7fd3-4ac0-906c-17b6cdc8a14d service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:12.175344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-3cb1810b-2abe-49f9-bcdf-7b67823db1b3 req-7bdc3c8f-7fd3-4ac0-906c-17b6cdc8a14d service nova] Creating event network-changed:ef0e8620-aa0e-40bc-834f-7d8adc3412c6 for instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 on hv-cinder-76606 May 12 06:52:12.183815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-3cb1810b-2abe-49f9-bcdf-7b67823db1b3 req-7bdc3c8f-7fd3-4ac0-906c-17b6cdc8a14d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088025 May 12 06:52:12.187898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 28/58] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:52:12.439043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ef515554-8778-446f-bb13-d1d33c63dc1c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:12.443872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ef515554-8778-446f-bb13-d1d33c63dc1c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:12.452623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef515554-8778-446f-bb13-d1d33c63dc1c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:12.454379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-4fe6928c-f5b0-469d-a75b-b23a3a50458d req-6b441818-2142-4c9a-acb4-7d69288824dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f4aebcd-2d12-4d12-941a-12261cb855af", "tag": "7fada614-d793-49ad-98bb-6d8332ab507a"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:12.462569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef515554-8778-446f-bb13-d1d33c63dc1c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:12.463588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef515554-8778-446f-bb13-d1d33c63dc1c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:12.465732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef515554-8778-446f-bb13-d1d33c63dc1c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:12.468717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-4fe6928c-f5b0-469d-a75b-b23a3a50458d req-6b441818-2142-4c9a-acb4-7d69288824dc service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:12.468717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-4fe6928c-f5b0-469d-a75b-b23a3a50458d req-6b441818-2142-4c9a-acb4-7d69288824dc service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:12.496058 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-4fe6928c-f5b0-469d-a75b-b23a3a50458d req-6b441818-2142-4c9a-acb4-7d69288824dc service nova] Creating event network-changed:7fada614-d793-49ad-98bb-6d8332ab507a for instance 7f4aebcd-2d12-4d12-941a-12261cb855af on hv-cinder-76606 May 12 06:52:12.515737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-4fe6928c-f5b0-469d-a75b-b23a3a50458d req-6b441818-2142-4c9a-acb4-7d69288824dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065250 May 12 06:52:12.516960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 29/59] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:12.548538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a4ee7d75-f173-4ace-9627-5931d8d350b6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:12.549510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a4ee7d75-f173-4ace-9627-5931d8d350b6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:12.557715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4ee7d75-f173-4ace-9627-5931d8d350b6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:12.561460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4ee7d75-f173-4ace-9627-5931d8d350b6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:12.564897 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4ee7d75-f173-4ace-9627-5931d8d350b6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:12.565404 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4ee7d75-f173-4ace-9627-5931d8d350b6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:12.748871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ef515554-8778-446f-bb13-d1d33c63dc1c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:12.758761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ef515554-8778-446f-bb13-d1d33c63dc1c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.331479 May 12 06:52:12.766870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 31/60] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:12 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:12.778845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a0d3e3b2-336d-4cfc-b33c-b937bbfae8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:12.780135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a0d3e3b2-336d-4cfc-b33c-b937bbfae8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:12.786840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0d3e3b2-336d-4cfc-b33c-b937bbfae8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:12.787618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0d3e3b2-336d-4cfc-b33c-b937bbfae8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:12.790099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0d3e3b2-336d-4cfc-b33c-b937bbfae8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:12.790736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0d3e3b2-336d-4cfc-b33c-b937bbfae8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:12.863148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a4ee7d75-f173-4ace-9627-5931d8d350b6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:12.886635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a4ee7d75-f173-4ace-9627-5931d8d350b6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.342187 May 12 06:52:12.893462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 30/61] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:12 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:13.105661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a0d3e3b2-336d-4cfc-b33c-b937bbfae8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:13.119296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a0d3e3b2-336d-4cfc-b33c-b937bbfae8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.350185 May 12 06:52:13.119909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 32/62] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:12 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:13.139224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3e979b38-e270-474d-8abf-241a2781201e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:13.140487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3e979b38-e270-474d-8abf-241a2781201e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:13.148502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e979b38-e270-474d-8abf-241a2781201e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:13.148502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e979b38-e270-474d-8abf-241a2781201e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:13.149984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e979b38-e270-474d-8abf-241a2781201e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:13.150571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e979b38-e270-474d-8abf-241a2781201e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:13.435613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3e979b38-e270-474d-8abf-241a2781201e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:13.444370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3e979b38-e270-474d-8abf-241a2781201e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.309497 May 12 06:52:13.445494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 31/63] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:13 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:13.777793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1c29fb3a-2dcd-48c8-b31d-da295db3bf2a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:13.779079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1c29fb3a-2dcd-48c8-b31d-da295db3bf2a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:13.787487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c29fb3a-2dcd-48c8-b31d-da295db3bf2a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:13.788267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c29fb3a-2dcd-48c8-b31d-da295db3bf2a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:13.789046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c29fb3a-2dcd-48c8-b31d-da295db3bf2a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:13.789709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c29fb3a-2dcd-48c8-b31d-da295db3bf2a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:13.903890 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aef70728-fccb-4e79-b117-28598f84a146 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:13.904509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-aef70728-fccb-4e79-b117-28598f84a146 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:13.910727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aef70728-fccb-4e79-b117-28598f84a146 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:13.911092 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aef70728-fccb-4e79-b117-28598f84a146 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:13.911908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aef70728-fccb-4e79-b117-28598f84a146 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:13.912508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aef70728-fccb-4e79-b117-28598f84a146 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:14.253535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1c29fb3a-2dcd-48c8-b31d-da295db3bf2a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:14.261564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1c29fb3a-2dcd-48c8-b31d-da295db3bf2a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.489044 May 12 06:52:14.270280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 33/64] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:13 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:14.275405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f23ff8bd-a640-473a-8a07-9e35ecd08997 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:14.276168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f23ff8bd-a640-473a-8a07-9e35ecd08997 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:14.278489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-aef70728-fccb-4e79-b117-28598f84a146 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:14.282547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f23ff8bd-a640-473a-8a07-9e35ecd08997 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:14.287916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f23ff8bd-a640-473a-8a07-9e35ecd08997 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:14.287916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f23ff8bd-a640-473a-8a07-9e35ecd08997 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:14.287916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f23ff8bd-a640-473a-8a07-9e35ecd08997 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:14.294419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aef70728-fccb-4e79-b117-28598f84a146 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.394327 May 12 06:52:14.307451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:13 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:14.319196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-a61a91a8-5f2b-418c-af28-ea6e63f3a61a req-9a0a8277-5e03-4af0-a93a-d9196c3f325f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23874ce-55b2-4fd4-8d8a-17c33e01daf4", "tag": "61a6481b-18ae-40a4-80a4-4c8a3ac311e1"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:14.342769 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-a61a91a8-5f2b-418c-af28-ea6e63f3a61a req-9a0a8277-5e03-4af0-a93a-d9196c3f325f service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:14.343222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-a61a91a8-5f2b-418c-af28-ea6e63f3a61a req-9a0a8277-5e03-4af0-a93a-d9196c3f325f service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:14.374677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-a61a91a8-5f2b-418c-af28-ea6e63f3a61a req-9a0a8277-5e03-4af0-a93a-d9196c3f325f service nova] Creating event network-changed:61a6481b-18ae-40a4-80a4-4c8a3ac311e1 for instance e23874ce-55b2-4fd4-8d8a-17c33e01daf4 on hv-cinder-76606 May 12 06:52:14.382241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-a61a91a8-5f2b-418c-af28-ea6e63f3a61a req-9a0a8277-5e03-4af0-a93a-d9196c3f325f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073231 May 12 06:52:14.389305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 33/66] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:14.462486 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2f83f564-d715-4b0e-b824-69bc29834d66 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:14.463416 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2f83f564-d715-4b0e-b824-69bc29834d66 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:14.467839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f23ff8bd-a640-473a-8a07-9e35ecd08997 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:14.470527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f83f564-d715-4b0e-b824-69bc29834d66 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:14.471775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f83f564-d715-4b0e-b824-69bc29834d66 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:14.472856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f83f564-d715-4b0e-b824-69bc29834d66 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:14.481365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f83f564-d715-4b0e-b824-69bc29834d66 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:14.481670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f23ff8bd-a640-473a-8a07-9e35ecd08997 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.209888 May 12 06:52:14.487618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 34/67] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:14 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:14.675125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2f83f564-d715-4b0e-b824-69bc29834d66 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:14.683937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2f83f564-d715-4b0e-b824-69bc29834d66 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.225627 May 12 06:52:14.684834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 34/68] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:14 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:15.281008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1d1bb1e3-e952-4b63-a1fe-e16251cba23b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:15.281625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1d1bb1e3-e952-4b63-a1fe-e16251cba23b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:15.289181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d1bb1e3-e952-4b63-a1fe-e16251cba23b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:15.289637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d1bb1e3-e952-4b63-a1fe-e16251cba23b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:15.290410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d1bb1e3-e952-4b63-a1fe-e16251cba23b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:15.290848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d1bb1e3-e952-4b63-a1fe-e16251cba23b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:15.313142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7289e4ab-5b32-4c69-8d37-5920808c4ffa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:15.313794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7289e4ab-5b32-4c69-8d37-5920808c4ffa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:15.319599 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7289e4ab-5b32-4c69-8d37-5920808c4ffa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:15.320085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7289e4ab-5b32-4c69-8d37-5920808c4ffa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:15.321462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7289e4ab-5b32-4c69-8d37-5920808c4ffa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:15.321902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7289e4ab-5b32-4c69-8d37-5920808c4ffa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:15.501029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1d1bb1e3-e952-4b63-a1fe-e16251cba23b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:15.508880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1d1bb1e3-e952-4b63-a1fe-e16251cba23b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.231049 May 12 06:52:15.509713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 35/69] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:15 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:15.513865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7ad5a2d6-e4a0-4f03-85b0-2343e72744c9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:15.514468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7ad5a2d6-e4a0-4f03-85b0-2343e72744c9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:15.519979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ad5a2d6-e4a0-4f03-85b0-2343e72744c9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:15.520433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ad5a2d6-e4a0-4f03-85b0-2343e72744c9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:15.521196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ad5a2d6-e4a0-4f03-85b0-2343e72744c9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:15.521631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ad5a2d6-e4a0-4f03-85b0-2343e72744c9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:15.526174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7289e4ab-5b32-4c69-8d37-5920808c4ffa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:15.533750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7289e4ab-5b32-4c69-8d37-5920808c4ffa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.224435 May 12 06:52:15.537354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 35/70] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:15 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:15.668417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7ad5a2d6-e4a0-4f03-85b0-2343e72744c9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:15.690323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7ad5a2d6-e4a0-4f03-85b0-2343e72744c9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.179843 May 12 06:52:15.690898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 36/71] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:15 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:15.700294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8a5ab41b-b568-4472-96c0-6b46827f94df tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:15.700906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8a5ab41b-b568-4472-96c0-6b46827f94df tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:15.706701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a5ab41b-b568-4472-96c0-6b46827f94df tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:15.707150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a5ab41b-b568-4472-96c0-6b46827f94df tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:15.707967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a5ab41b-b568-4472-96c0-6b46827f94df tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:15.708406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a5ab41b-b568-4472-96c0-6b46827f94df tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:15.840723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8a5ab41b-b568-4472-96c0-6b46827f94df tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:15.848073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8a5ab41b-b568-4472-96c0-6b46827f94df tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.151496 May 12 06:52:15.848642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 36/72] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:15 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:16.526661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0fd64dcc-cf0c-4ff9-a105-4fc59df7a72c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:16.527279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0fd64dcc-cf0c-4ff9-a105-4fc59df7a72c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:16.533163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0fd64dcc-cf0c-4ff9-a105-4fc59df7a72c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:16.533666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0fd64dcc-cf0c-4ff9-a105-4fc59df7a72c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:16.534385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0fd64dcc-cf0c-4ff9-a105-4fc59df7a72c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:16.534822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0fd64dcc-cf0c-4ff9-a105-4fc59df7a72c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:16.551676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-758b5396-ce99-4df0-9c3c-805181a1209a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:16.552573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-758b5396-ce99-4df0-9c3c-805181a1209a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:16.558952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-758b5396-ce99-4df0-9c3c-805181a1209a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:16.559675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-758b5396-ce99-4df0-9c3c-805181a1209a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:16.560482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-758b5396-ce99-4df0-9c3c-805181a1209a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:16.560971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-758b5396-ce99-4df0-9c3c-805181a1209a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:16.779052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0fd64dcc-cf0c-4ff9-a105-4fc59df7a72c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:16.786936 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-758b5396-ce99-4df0-9c3c-805181a1209a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:16.788229 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0fd64dcc-cf0c-4ff9-a105-4fc59df7a72c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.265678 May 12 06:52:16.789616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 37/73] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:16 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:16.794315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6c87c2d8-ce20-4ca0-855c-d7005e439bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:16.795007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6c87c2d8-ce20-4ca0-855c-d7005e439bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:16.800921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6c87c2d8-ce20-4ca0-855c-d7005e439bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:16.801447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6c87c2d8-ce20-4ca0-855c-d7005e439bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:16.802264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-758b5396-ce99-4df0-9c3c-805181a1209a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.254137 May 12 06:52:16.802374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6c87c2d8-ce20-4ca0-855c-d7005e439bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:16.802842 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6c87c2d8-ce20-4ca0-855c-d7005e439bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:16.803186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 37/74] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:16 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:16.865583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5a152a6d-c541-457c-a11c-55816343a0d4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:16.866658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5a152a6d-c541-457c-a11c-55816343a0d4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:16.872663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a152a6d-c541-457c-a11c-55816343a0d4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:16.873120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a152a6d-c541-457c-a11c-55816343a0d4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:16.873905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a152a6d-c541-457c-a11c-55816343a0d4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:16.874346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a152a6d-c541-457c-a11c-55816343a0d4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:16.974970 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6c87c2d8-ce20-4ca0-855c-d7005e439bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:16.983141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6c87c2d8-ce20-4ca0-855c-d7005e439bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.192446 May 12 06:52:16.984114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 38/75] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:16 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:17.020068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5a152a6d-c541-457c-a11c-55816343a0d4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:17.027785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5a152a6d-c541-457c-a11c-55816343a0d4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.166009 May 12 06:52:17.028358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 38/76] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:16 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:17.807000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e01897c5-12f9-4f93-82d9-b7e3bed31770 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:17.808309 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e01897c5-12f9-4f93-82d9-b7e3bed31770 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:17.813746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e01897c5-12f9-4f93-82d9-b7e3bed31770 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:17.814205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e01897c5-12f9-4f93-82d9-b7e3bed31770 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:17.814979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e01897c5-12f9-4f93-82d9-b7e3bed31770 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:17.815597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e01897c5-12f9-4f93-82d9-b7e3bed31770 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:17.826050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6bbe9170-1023-4ed1-87af-cb1e9dc7d5f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:17.826050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6bbe9170-1023-4ed1-87af-cb1e9dc7d5f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:17.829858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bbe9170-1023-4ed1-87af-cb1e9dc7d5f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:17.830380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bbe9170-1023-4ed1-87af-cb1e9dc7d5f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:17.831389 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bbe9170-1023-4ed1-87af-cb1e9dc7d5f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:17.831933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bbe9170-1023-4ed1-87af-cb1e9dc7d5f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:17.998010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e01897c5-12f9-4f93-82d9-b7e3bed31770 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:18.005887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e01897c5-12f9-4f93-82d9-b7e3bed31770 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.203413 May 12 06:52:18.015274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 39/77] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:17 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:18.015274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-09f3e8a1-c0cc-4422-a924-575e89349c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:18.015274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-09f3e8a1-c0cc-4422-a924-575e89349c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:18.017326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09f3e8a1-c0cc-4422-a924-575e89349c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:18.017780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09f3e8a1-c0cc-4422-a924-575e89349c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:18.020429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6bbe9170-1023-4ed1-87af-cb1e9dc7d5f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:18.020541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09f3e8a1-c0cc-4422-a924-575e89349c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:18.020541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09f3e8a1-c0cc-4422-a924-575e89349c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:18.026054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6bbe9170-1023-4ed1-87af-cb1e9dc7d5f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.210180 May 12 06:52:18.026723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 39/78] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:17 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:18.045080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7e94a692-588f-4cc8-94d8-03f12fec5192 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:18.045770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7e94a692-588f-4cc8-94d8-03f12fec5192 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:18.051635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7e94a692-588f-4cc8-94d8-03f12fec5192 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:18.052115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7e94a692-588f-4cc8-94d8-03f12fec5192 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:18.052878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7e94a692-588f-4cc8-94d8-03f12fec5192 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:18.057397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7e94a692-588f-4cc8-94d8-03f12fec5192 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:18.200660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-09f3e8a1-c0cc-4422-a924-575e89349c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:18.209841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-09f3e8a1-c0cc-4422-a924-575e89349c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.202018 May 12 06:52:18.210589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 40/79] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:18 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:18.237358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7e94a692-588f-4cc8-94d8-03f12fec5192 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:18.245582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7e94a692-588f-4cc8-94d8-03f12fec5192 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.204479 May 12 06:52:18.246158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 40/80] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:18 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:19.022849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2df90098-a7c4-4c2c-87de-7bc13a7d6ad3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:19.023467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2df90098-a7c4-4c2c-87de-7bc13a7d6ad3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:19.029990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2df90098-a7c4-4c2c-87de-7bc13a7d6ad3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:19.030440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2df90098-a7c4-4c2c-87de-7bc13a7d6ad3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:19.031212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2df90098-a7c4-4c2c-87de-7bc13a7d6ad3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:19.031649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2df90098-a7c4-4c2c-87de-7bc13a7d6ad3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:19.043005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-98f7fdfa-799b-4fe2-9412-21da2ed53b01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:19.043622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-98f7fdfa-799b-4fe2-9412-21da2ed53b01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:19.049544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98f7fdfa-799b-4fe2-9412-21da2ed53b01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:19.049991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98f7fdfa-799b-4fe2-9412-21da2ed53b01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:19.050763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98f7fdfa-799b-4fe2-9412-21da2ed53b01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:19.051201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98f7fdfa-799b-4fe2-9412-21da2ed53b01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:19.226542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2df90098-a7c4-4c2c-87de-7bc13a7d6ad3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:19.229603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-98f7fdfa-799b-4fe2-9412-21da2ed53b01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:19.233900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2df90098-a7c4-4c2c-87de-7bc13a7d6ad3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.214849 May 12 06:52:19.234465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 41/81] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:19 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:19.238809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-eab5c7c1-ee63-4bbb-bf0e-38f0633dae68 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:19.239409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-eab5c7c1-ee63-4bbb-bf0e-38f0633dae68 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:19.242301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-98f7fdfa-799b-4fe2-9412-21da2ed53b01 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.203436 May 12 06:52:19.244259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 41/82] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:19 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:19.245374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab5c7c1-ee63-4bbb-bf0e-38f0633dae68 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:19.245821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab5c7c1-ee63-4bbb-bf0e-38f0633dae68 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:19.246582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab5c7c1-ee63-4bbb-bf0e-38f0633dae68 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:19.247013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab5c7c1-ee63-4bbb-bf0e-38f0633dae68 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:19.262045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cfbbbc04-e9ca-4ee9-a99d-7f4df43c828c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:19.262654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cfbbbc04-e9ca-4ee9-a99d-7f4df43c828c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:19.268608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfbbbc04-e9ca-4ee9-a99d-7f4df43c828c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:19.269060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfbbbc04-e9ca-4ee9-a99d-7f4df43c828c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:19.269831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfbbbc04-e9ca-4ee9-a99d-7f4df43c828c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:19.270266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfbbbc04-e9ca-4ee9-a99d-7f4df43c828c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:19.434763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eab5c7c1-ee63-4bbb-bf0e-38f0633dae68 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:19.442109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-eab5c7c1-ee63-4bbb-bf0e-38f0633dae68 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.206677 May 12 06:52:19.442677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 42/83] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:19 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:19.447517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cfbbbc04-e9ca-4ee9-a99d-7f4df43c828c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:19.454062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cfbbbc04-e9ca-4ee9-a99d-7f4df43c828c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.195777 May 12 06:52:19.454615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 42/84] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:19 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:20.251253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5837c737-c5d9-4d12-999e-25bd8cd0b17e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:20.251909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5837c737-c5d9-4d12-999e-25bd8cd0b17e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:20.257875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5837c737-c5d9-4d12-999e-25bd8cd0b17e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:20.258325 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5837c737-c5d9-4d12-999e-25bd8cd0b17e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:20.259098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5837c737-c5d9-4d12-999e-25bd8cd0b17e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:20.259743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5837c737-c5d9-4d12-999e-25bd8cd0b17e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:20.260719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-90aa9dfa-2e27-4e68-b4c8-dd42fa92f539 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:20.261530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-90aa9dfa-2e27-4e68-b4c8-dd42fa92f539 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:20.267823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90aa9dfa-2e27-4e68-b4c8-dd42fa92f539 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:20.268556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90aa9dfa-2e27-4e68-b4c8-dd42fa92f539 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:20.269468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90aa9dfa-2e27-4e68-b4c8-dd42fa92f539 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:20.270153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90aa9dfa-2e27-4e68-b4c8-dd42fa92f539 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:20.464039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5837c737-c5d9-4d12-999e-25bd8cd0b17e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:20.473026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-90aa9dfa-2e27-4e68-b4c8-dd42fa92f539 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:20.481970 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5837c737-c5d9-4d12-999e-25bd8cd0b17e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.233438 May 12 06:52:20.484443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-90aa9dfa-2e27-4e68-b4c8-dd42fa92f539 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.228074 May 12 06:52:20.485345 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 43/85] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:20 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:20.498064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 43/86] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:20 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:20.503283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-52fd871c-f5eb-42c5-856e-d7358c20c785 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:20.515173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d43df5d6-6416-4292-ace5-421cde369615 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:20.515173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d43df5d6-6416-4292-ace5-421cde369615 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:20.515512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-52fd871c-f5eb-42c5-856e-d7358c20c785 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:20.515612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d43df5d6-6416-4292-ace5-421cde369615 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:20.520108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d43df5d6-6416-4292-ace5-421cde369615 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:20.521167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d43df5d6-6416-4292-ace5-421cde369615 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:20.521609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52fd871c-f5eb-42c5-856e-d7358c20c785 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:20.521951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d43df5d6-6416-4292-ace5-421cde369615 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:20.522189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52fd871c-f5eb-42c5-856e-d7358c20c785 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:20.523064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52fd871c-f5eb-42c5-856e-d7358c20c785 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:20.524283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52fd871c-f5eb-42c5-856e-d7358c20c785 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:20.728886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-52fd871c-f5eb-42c5-856e-d7358c20c785 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:20.732177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d43df5d6-6416-4292-ace5-421cde369615 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:20.737312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-52fd871c-f5eb-42c5-856e-d7358c20c785 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.237965 May 12 06:52:20.737979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 44/87] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:20 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:20.739554 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d43df5d6-6416-4292-ace5-421cde369615 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.244471 May 12 06:52:20.740218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 44/88] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:20 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:21.501427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6ccc9fe9-572d-4760-8dcb-15f3e52a56dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:21.502043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6ccc9fe9-572d-4760-8dcb-15f3e52a56dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:21.508712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6ccc9fe9-572d-4760-8dcb-15f3e52a56dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:21.509167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6ccc9fe9-572d-4760-8dcb-15f3e52a56dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:21.509932 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6ccc9fe9-572d-4760-8dcb-15f3e52a56dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:21.510369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6ccc9fe9-572d-4760-8dcb-15f3e52a56dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:21.522029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f4c7ce56-716e-47bc-b105-ef38bdce8407 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:21.522823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f4c7ce56-716e-47bc-b105-ef38bdce8407 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:21.528650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f4c7ce56-716e-47bc-b105-ef38bdce8407 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:21.529095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f4c7ce56-716e-47bc-b105-ef38bdce8407 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:21.529849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f4c7ce56-716e-47bc-b105-ef38bdce8407 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:21.530281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f4c7ce56-716e-47bc-b105-ef38bdce8407 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:21.699463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6ccc9fe9-572d-4760-8dcb-15f3e52a56dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:21.706313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f4c7ce56-716e-47bc-b105-ef38bdce8407 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:21.707197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6ccc9fe9-572d-4760-8dcb-15f3e52a56dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.209095 May 12 06:52:21.713319 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 45/89] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:21 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:21.713537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f4c7ce56-716e-47bc-b105-ef38bdce8407 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.195237 May 12 06:52:21.714098 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 45/90] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:21 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:21.754123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ca2576a6-6b9f-4deb-8dba-20c7dcdb9586 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:21.754891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ca2576a6-6b9f-4deb-8dba-20c7dcdb9586 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:21.756049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8e70010a-28b4-404f-902f-1e3a0d8e21d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:21.756650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8e70010a-28b4-404f-902f-1e3a0d8e21d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:21.761146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca2576a6-6b9f-4deb-8dba-20c7dcdb9586 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:21.761669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca2576a6-6b9f-4deb-8dba-20c7dcdb9586 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:21.762306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e70010a-28b4-404f-902f-1e3a0d8e21d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:21.762577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca2576a6-6b9f-4deb-8dba-20c7dcdb9586 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:21.762755 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e70010a-28b4-404f-902f-1e3a0d8e21d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:21.763152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca2576a6-6b9f-4deb-8dba-20c7dcdb9586 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:21.763514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e70010a-28b4-404f-902f-1e3a0d8e21d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:21.763974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e70010a-28b4-404f-902f-1e3a0d8e21d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:21.951729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8e70010a-28b4-404f-902f-1e3a0d8e21d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:21.954534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ca2576a6-6b9f-4deb-8dba-20c7dcdb9586 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:21.959068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8e70010a-28b4-404f-902f-1e3a0d8e21d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.206537 May 12 06:52:21.959823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 46/91] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:21 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:21.962136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ca2576a6-6b9f-4deb-8dba-20c7dcdb9586 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.211713 May 12 06:52:21.962718 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 46/92] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:21 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:22.723787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-499f674c-e276-49c9-bfe6-a68c39c4df22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:22.724396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-499f674c-e276-49c9-bfe6-a68c39c4df22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:22.730101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-febe9ce7-5964-403c-9553-d9897c798ac6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:22.730526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-499f674c-e276-49c9-bfe6-a68c39c4df22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:22.730737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-499f674c-e276-49c9-bfe6-a68c39c4df22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:22.731281 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-febe9ce7-5964-403c-9553-d9897c798ac6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:22.731495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-499f674c-e276-49c9-bfe6-a68c39c4df22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:22.731955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-499f674c-e276-49c9-bfe6-a68c39c4df22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:22.737057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-febe9ce7-5964-403c-9553-d9897c798ac6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:22.737500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-febe9ce7-5964-403c-9553-d9897c798ac6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:22.738269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-febe9ce7-5964-403c-9553-d9897c798ac6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:22.738702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-febe9ce7-5964-403c-9553-d9897c798ac6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:22.916889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-499f674c-e276-49c9-bfe6-a68c39c4df22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:22.919871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-febe9ce7-5964-403c-9553-d9897c798ac6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:22.924717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-499f674c-e276-49c9-bfe6-a68c39c4df22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.204745 May 12 06:52:22.925299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 47/93] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:22 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:22.934099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-febe9ce7-5964-403c-9553-d9897c798ac6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.201235 May 12 06:52:22.934099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 47/94] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:22 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:22.975898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a965c631-0d35-4544-9e44-66859b1d805e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:22.976632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a965c631-0d35-4544-9e44-66859b1d805e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:22.979582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ad8df94e-b301-4f9c-a43f-c465fd0aadd9 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:22.980275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ad8df94e-b301-4f9c-a43f-c465fd0aadd9 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:22.983374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a965c631-0d35-4544-9e44-66859b1d805e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:22.983850 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a965c631-0d35-4544-9e44-66859b1d805e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:22.984625 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a965c631-0d35-4544-9e44-66859b1d805e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:22.985060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a965c631-0d35-4544-9e44-66859b1d805e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:22.986051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad8df94e-b301-4f9c-a43f-c465fd0aadd9 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:22.986517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad8df94e-b301-4f9c-a43f-c465fd0aadd9 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:22.987289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad8df94e-b301-4f9c-a43f-c465fd0aadd9 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:22.987917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad8df94e-b301-4f9c-a43f-c465fd0aadd9 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:23.178709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a965c631-0d35-4544-9e44-66859b1d805e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:23.182857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ad8df94e-b301-4f9c-a43f-c465fd0aadd9 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:23.186770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a965c631-0d35-4544-9e44-66859b1d805e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.214349 May 12 06:52:23.187342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 48/95] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:22 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:23.190878 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ad8df94e-b301-4f9c-a43f-c465fd0aadd9 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.216618 May 12 06:52:23.191440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 48/96] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:22 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:23.829046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-8eef3dfc-c528-470e-ac5f-c502d13fb42d req-3f09de91-9720-4ce8-b706-0d631aed77b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff2372e-1d0c-451a-9133-670b69144366", "name": "network-vif-plugged", "status": "completed", "tag": "fc53d3cb-2af6-4766-84ac-ed178ee084d1"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:23.837419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-8eef3dfc-c528-470e-ac5f-c502d13fb42d req-3f09de91-9720-4ce8-b706-0d631aed77b8 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:23.837860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-8eef3dfc-c528-470e-ac5f-c502d13fb42d req-3f09de91-9720-4ce8-b706-0d631aed77b8 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:23.848658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-8eef3dfc-c528-470e-ac5f-c502d13fb42d req-3f09de91-9720-4ce8-b706-0d631aed77b8 service nova] Creating event network-vif-plugged:fc53d3cb-2af6-4766-84ac-ed178ee084d1 for instance 1ff2372e-1d0c-451a-9133-670b69144366 on hv-cinder-76606 May 12 06:52:23.854135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-8eef3dfc-c528-470e-ac5f-c502d13fb42d req-3f09de91-9720-4ce8-b706-0d631aed77b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094597 May 12 06:52:23.854715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 49/97] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:23.943477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-99188c2c-95cc-45f8-9ae3-7ce725bae050 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:23.944991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-99188c2c-95cc-45f8-9ae3-7ce725bae050 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:23.945142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8dafba24-b3a0-47be-bd62-e054dc360936 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:23.947177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8dafba24-b3a0-47be-bd62-e054dc360936 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:23.954794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99188c2c-95cc-45f8-9ae3-7ce725bae050 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:23.954965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8dafba24-b3a0-47be-bd62-e054dc360936 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:23.955263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99188c2c-95cc-45f8-9ae3-7ce725bae050 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:23.955382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8dafba24-b3a0-47be-bd62-e054dc360936 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:23.956495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8dafba24-b3a0-47be-bd62-e054dc360936 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:23.956943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8dafba24-b3a0-47be-bd62-e054dc360936 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:23.957853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99188c2c-95cc-45f8-9ae3-7ce725bae050 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:23.958541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99188c2c-95cc-45f8-9ae3-7ce725bae050 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:24.189101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-99188c2c-95cc-45f8-9ae3-7ce725bae050 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:24.201050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-99188c2c-95cc-45f8-9ae3-7ce725bae050 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.262260 May 12 06:52:24.201685 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8dafba24-b3a0-47be-bd62-e054dc360936 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:24.202627 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 49/98] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:23 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:24.208097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-42e815e8-25d3-423a-8b89-6f56c86326c6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:24.208940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-42e815e8-25d3-423a-8b89-6f56c86326c6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:24.217656 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42e815e8-25d3-423a-8b89-6f56c86326c6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:24.218311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42e815e8-25d3-423a-8b89-6f56c86326c6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:24.219613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42e815e8-25d3-423a-8b89-6f56c86326c6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:24.220130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42e815e8-25d3-423a-8b89-6f56c86326c6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:24.222542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8dafba24-b3a0-47be-bd62-e054dc360936 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.281620 May 12 06:52:24.231718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 50/99] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:23 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:24.231718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c9669cd8-7236-4ac7-adcb-a55168b69766 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:24.231718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c9669cd8-7236-4ac7-adcb-a55168b69766 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:24.238797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9669cd8-7236-4ac7-adcb-a55168b69766 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:24.239250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9669cd8-7236-4ac7-adcb-a55168b69766 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:24.240075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9669cd8-7236-4ac7-adcb-a55168b69766 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:24.240509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9669cd8-7236-4ac7-adcb-a55168b69766 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:24.451263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-42e815e8-25d3-423a-8b89-6f56c86326c6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:24.465590 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-42e815e8-25d3-423a-8b89-6f56c86326c6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.255363 May 12 06:52:24.465773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c9669cd8-7236-4ac7-adcb-a55168b69766 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:24.470318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 50/100] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:24 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:24.472431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c9669cd8-7236-4ac7-adcb-a55168b69766 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.247524 May 12 06:52:24.473151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 51/101] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:24 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:25.218130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-735a6d69-fc31-4806-8e66-3159cebd4a2b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:25.218817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-735a6d69-fc31-4806-8e66-3159cebd4a2b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:25.227289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-735a6d69-fc31-4806-8e66-3159cebd4a2b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:25.227937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-735a6d69-fc31-4806-8e66-3159cebd4a2b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:25.228950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-735a6d69-fc31-4806-8e66-3159cebd4a2b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:25.229657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-735a6d69-fc31-4806-8e66-3159cebd4a2b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:25.241515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fcf13f55-3896-4716-8a7b-219f2705a32a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:25.243257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fcf13f55-3896-4716-8a7b-219f2705a32a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:25.254177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcf13f55-3896-4716-8a7b-219f2705a32a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:25.257346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcf13f55-3896-4716-8a7b-219f2705a32a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:25.259240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcf13f55-3896-4716-8a7b-219f2705a32a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:25.259702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcf13f55-3896-4716-8a7b-219f2705a32a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:25.447679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-735a6d69-fc31-4806-8e66-3159cebd4a2b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:25.455961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-735a6d69-fc31-4806-8e66-3159cebd4a2b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.241530 May 12 06:52:25.456564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 51/102] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:25 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:25.478184 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fcf13f55-3896-4716-8a7b-219f2705a32a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:25.479959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-55b46d05-3eb2-4292-9dd5-a6061130bf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:25.480576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-55b46d05-3eb2-4292-9dd5-a6061130bf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:25.486444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55b46d05-3eb2-4292-9dd5-a6061130bf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:25.486596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fcf13f55-3896-4716-8a7b-219f2705a32a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.249700 May 12 06:52:25.486893 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55b46d05-3eb2-4292-9dd5-a6061130bf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:25.487141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 52/103] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:25 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:25.495911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55b46d05-3eb2-4292-9dd5-a6061130bf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:25.495911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55b46d05-3eb2-4292-9dd5-a6061130bf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:25.496130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dd538454-6806-4fee-abb6-68d246134bfb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:25.496130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dd538454-6806-4fee-abb6-68d246134bfb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:25.500293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd538454-6806-4fee-abb6-68d246134bfb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:25.500966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd538454-6806-4fee-abb6-68d246134bfb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:25.501506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd538454-6806-4fee-abb6-68d246134bfb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:25.502151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd538454-6806-4fee-abb6-68d246134bfb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:25.699650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-55b46d05-3eb2-4292-9dd5-a6061130bf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:25.707597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-55b46d05-3eb2-4292-9dd5-a6061130bf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.231619 May 12 06:52:25.712925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dd538454-6806-4fee-abb6-68d246134bfb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:25.713229 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 52/104] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:25 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:25.716162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dd538454-6806-4fee-abb6-68d246134bfb tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.227677 May 12 06:52:25.716704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 53/105] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:25 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:25.876339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-51c17a49-3891-40c8-a5a8-0c86c9d28411 req-8ccb9968-49c6-48a9-9d4a-8f75a00c6a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15", "name": "network-vif-plugged", "status": "completed", "tag": "1c97b15f-78b6-4633-9ef7-e577a30995a1"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:25.890178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-51c17a49-3891-40c8-a5a8-0c86c9d28411 req-8ccb9968-49c6-48a9-9d4a-8f75a00c6a87 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:25.890178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-51c17a49-3891-40c8-a5a8-0c86c9d28411 req-8ccb9968-49c6-48a9-9d4a-8f75a00c6a87 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:25.902886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-51c17a49-3891-40c8-a5a8-0c86c9d28411 req-8ccb9968-49c6-48a9-9d4a-8f75a00c6a87 service nova] Creating event network-vif-plugged:1c97b15f-78b6-4633-9ef7-e577a30995a1 for instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 on hv-cinder-76606 May 12 06:52:25.908164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-51c17a49-3891-40c8-a5a8-0c86c9d28411 req-8ccb9968-49c6-48a9-9d4a-8f75a00c6a87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035570 May 12 06:52:25.908911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 53/106] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:26.474882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c4450aeb-4b2e-4e6c-9cee-3bd4b21657e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:26.476151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c4450aeb-4b2e-4e6c-9cee-3bd4b21657e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:26.486714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c4450aeb-4b2e-4e6c-9cee-3bd4b21657e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:26.487163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c4450aeb-4b2e-4e6c-9cee-3bd4b21657e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:26.488038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c4450aeb-4b2e-4e6c-9cee-3bd4b21657e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:26.488469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c4450aeb-4b2e-4e6c-9cee-3bd4b21657e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:26.512531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3d5d6e3c-0ebf-438b-adc4-e0d3e040a722 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:26.513293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3d5d6e3c-0ebf-438b-adc4-e0d3e040a722 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:26.519645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d5d6e3c-0ebf-438b-adc4-e0d3e040a722 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:26.520435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d5d6e3c-0ebf-438b-adc4-e0d3e040a722 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:26.521585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d5d6e3c-0ebf-438b-adc4-e0d3e040a722 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:26.522221 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d5d6e3c-0ebf-438b-adc4-e0d3e040a722 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:26.686054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c4450aeb-4b2e-4e6c-9cee-3bd4b21657e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:26.695000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c4450aeb-4b2e-4e6c-9cee-3bd4b21657e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.224891 May 12 06:52:26.695754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 54/107] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:26 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:26.720349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3d5d6e3c-0ebf-438b-adc4-e0d3e040a722 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:26.725078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ff89501a-955c-4353-be55-5285357e18a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:26.725915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ff89501a-955c-4353-be55-5285357e18a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:26.728140 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3d5d6e3c-0ebf-438b-adc4-e0d3e040a722 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.225911 May 12 06:52:26.734955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff89501a-955c-4353-be55-5285357e18a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:26.735666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff89501a-955c-4353-be55-5285357e18a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:26.736681 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff89501a-955c-4353-be55-5285357e18a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:26.737325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff89501a-955c-4353-be55-5285357e18a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:26.737671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 54/108] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:26 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:26.744702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-84a2657c-fe88-4394-a3e4-0c11bd9e4ed4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:26.745314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-84a2657c-fe88-4394-a3e4-0c11bd9e4ed4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:26.751386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84a2657c-fe88-4394-a3e4-0c11bd9e4ed4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:26.751858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84a2657c-fe88-4394-a3e4-0c11bd9e4ed4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:26.752785 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84a2657c-fe88-4394-a3e4-0c11bd9e4ed4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:26.753250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84a2657c-fe88-4394-a3e4-0c11bd9e4ed4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:26.950123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-84a2657c-fe88-4394-a3e4-0c11bd9e4ed4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:26.964659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-84a2657c-fe88-4394-a3e4-0c11bd9e4ed4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1315 microversion: 2.1 time: 0.225883 May 12 06:52:26.965249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 55/109] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:26 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:26.965679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ff89501a-955c-4353-be55-5285357e18a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:26.980290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ff89501a-955c-4353-be55-5285357e18a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.259487 May 12 06:52:26.984934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 55/110] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:26 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:27.712820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a2804176-6149-4b82-97d4-fb9212592a4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:27.713998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a2804176-6149-4b82-97d4-fb9212592a4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:27.720175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2804176-6149-4b82-97d4-fb9212592a4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:27.720566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2804176-6149-4b82-97d4-fb9212592a4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:27.721340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2804176-6149-4b82-97d4-fb9212592a4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:27.721780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2804176-6149-4b82-97d4-fb9212592a4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:27.744965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f6f21ede-fa78-4b9c-b9d7-683faa633558 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:27.745717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f6f21ede-fa78-4b9c-b9d7-683faa633558 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:27.752085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6f21ede-fa78-4b9c-b9d7-683faa633558 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:27.752729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6f21ede-fa78-4b9c-b9d7-683faa633558 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:27.753559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6f21ede-fa78-4b9c-b9d7-683faa633558 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:27.754246 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6f21ede-fa78-4b9c-b9d7-683faa633558 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:27.912095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a2804176-6149-4b82-97d4-fb9212592a4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:27.924048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a2804176-6149-4b82-97d4-fb9212592a4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.215598 May 12 06:52:27.935141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 56/111] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:27 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:27.944429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f6f21ede-fa78-4b9c-b9d7-683faa633558 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:27.948953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f6f21ede-fa78-4b9c-b9d7-683faa633558 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.207741 May 12 06:52:27.959391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 56/112] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:27 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:27.967436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-991ecccf-558b-402e-b04f-f9e07f1e5a39 req-f3d00336-4ff0-4db6-b583-44410b41d1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baa16c3-ab5a-4e93-a65d-1e038d4af279", "name": "network-vif-plugged", "status": "completed", "tag": "ef0e8620-aa0e-40bc-834f-7d8adc3412c6"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:27.978438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-991ecccf-558b-402e-b04f-f9e07f1e5a39 req-f3d00336-4ff0-4db6-b583-44410b41d1f6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:27.978881 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-991ecccf-558b-402e-b04f-f9e07f1e5a39 req-f3d00336-4ff0-4db6-b583-44410b41d1f6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:27.985326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4873c95a-cb5e-4ce6-9d03-1296358524c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:27.988272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4873c95a-cb5e-4ce6-9d03-1296358524c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:27.997717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-991ecccf-558b-402e-b04f-f9e07f1e5a39 req-f3d00336-4ff0-4db6-b583-44410b41d1f6 service nova] Creating event network-vif-plugged:ef0e8620-aa0e-40bc-834f-7d8adc3412c6 for instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 on hv-cinder-76606 May 12 06:52:28.006329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4873c95a-cb5e-4ce6-9d03-1296358524c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:28.006805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4873c95a-cb5e-4ce6-9d03-1296358524c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:28.007715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4873c95a-cb5e-4ce6-9d03-1296358524c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:28.010491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4873c95a-cb5e-4ce6-9d03-1296358524c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:28.012184 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-991ecccf-558b-402e-b04f-f9e07f1e5a39 req-f3d00336-4ff0-4db6-b583-44410b41d1f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045920 May 12 06:52:28.020976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 57/113] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:28.029359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f61f3ae3-2133-4ac5-8780-994bf485b639 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:28.035410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f61f3ae3-2133-4ac5-8780-994bf485b639 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:28.044068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f61f3ae3-2133-4ac5-8780-994bf485b639 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:28.044619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f61f3ae3-2133-4ac5-8780-994bf485b639 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:28.045497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f61f3ae3-2133-4ac5-8780-994bf485b639 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:28.046153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f61f3ae3-2133-4ac5-8780-994bf485b639 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:28.213562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4873c95a-cb5e-4ce6-9d03-1296358524c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:28.221095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4873c95a-cb5e-4ce6-9d03-1296358524c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1501 microversion: 2.1 time: 0.242486 May 12 06:52:28.221674 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 57/114] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:27 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1501 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:28.250734 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f61f3ae3-2133-4ac5-8780-994bf485b639 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:28.258245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f61f3ae3-2133-4ac5-8780-994bf485b639 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.236279 May 12 06:52:28.258820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 58/115] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:28 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:28.942257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e195c732-276c-49f9-be15-810dd6571470 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:28.943593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e195c732-276c-49f9-be15-810dd6571470 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:28.955547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e195c732-276c-49f9-be15-810dd6571470 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:28.957158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e195c732-276c-49f9-be15-810dd6571470 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:28.963844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e195c732-276c-49f9-be15-810dd6571470 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:28.964494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e195c732-276c-49f9-be15-810dd6571470 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:28.968887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f08e582b-ad58-4069-a699-3c4cbc2724fc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:28.970360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f08e582b-ad58-4069-a699-3c4cbc2724fc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:28.977857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f08e582b-ad58-4069-a699-3c4cbc2724fc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:28.978803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f08e582b-ad58-4069-a699-3c4cbc2724fc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:28.983556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f08e582b-ad58-4069-a699-3c4cbc2724fc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:28.983556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f08e582b-ad58-4069-a699-3c4cbc2724fc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:29.188082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e195c732-276c-49f9-be15-810dd6571470 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:29.190649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f08e582b-ad58-4069-a699-3c4cbc2724fc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:29.191479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e195c732-276c-49f9-be15-810dd6571470 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.253607 May 12 06:52:29.194062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 58/116] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:28 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:29.206048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f08e582b-ad58-4069-a699-3c4cbc2724fc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.242830 May 12 06:52:29.224372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 59/117] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:28 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:29.275557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-49131aee-dd61-410c-8477-44f5ddf659d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:29.276191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-49131aee-dd61-410c-8477-44f5ddf659d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:29.282300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49131aee-dd61-410c-8477-44f5ddf659d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:29.282747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49131aee-dd61-410c-8477-44f5ddf659d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:29.283548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49131aee-dd61-410c-8477-44f5ddf659d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:29.284180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49131aee-dd61-410c-8477-44f5ddf659d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:29.418863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-49131aee-dd61-410c-8477-44f5ddf659d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:29.426068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-49131aee-dd61-410c-8477-44f5ddf659d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.155432 May 12 06:52:29.426575 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 59/118] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:29 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:30.035473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-73e1b583-89ee-4146-ac9e-fce957a73120 req-72bec2d6-28d9-4f45-9666-763dc54a3cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23874ce-55b2-4fd4-8d8a-17c33e01daf4", "name": "network-vif-plugged", "status": "completed", "tag": "61a6481b-18ae-40a4-80a4-4c8a3ac311e1"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:30.044011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-73e1b583-89ee-4146-ac9e-fce957a73120 req-72bec2d6-28d9-4f45-9666-763dc54a3cb2 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:30.044541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-73e1b583-89ee-4146-ac9e-fce957a73120 req-72bec2d6-28d9-4f45-9666-763dc54a3cb2 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:30.055508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-73e1b583-89ee-4146-ac9e-fce957a73120 req-72bec2d6-28d9-4f45-9666-763dc54a3cb2 service nova] Creating event network-vif-plugged:61a6481b-18ae-40a4-80a4-4c8a3ac311e1 for instance e23874ce-55b2-4fd4-8d8a-17c33e01daf4 on hv-cinder-76606 May 12 06:52:30.071717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-73e1b583-89ee-4146-ac9e-fce957a73120 req-72bec2d6-28d9-4f45-9666-763dc54a3cb2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037486 May 12 06:52:30.079731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 60/119] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:30.216996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-21245653-eb6b-427f-b163-cc649bb975d5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:30.226424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-401149a4-fc42-4b94-82fb-b38e9cc1d5de tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:30.226424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-401149a4-fc42-4b94-82fb-b38e9cc1d5de tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:30.227155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-21245653-eb6b-427f-b163-cc649bb975d5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:30.232355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-401149a4-fc42-4b94-82fb-b38e9cc1d5de tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:30.233023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-401149a4-fc42-4b94-82fb-b38e9cc1d5de tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:30.234070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-401149a4-fc42-4b94-82fb-b38e9cc1d5de tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:30.234515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-401149a4-fc42-4b94-82fb-b38e9cc1d5de tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:30.242145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21245653-eb6b-427f-b163-cc649bb975d5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:30.242847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21245653-eb6b-427f-b163-cc649bb975d5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:30.243637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21245653-eb6b-427f-b163-cc649bb975d5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:30.244111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21245653-eb6b-427f-b163-cc649bb975d5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:30.669701 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-401149a4-fc42-4b94-82fb-b38e9cc1d5de tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:30.674201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-21245653-eb6b-427f-b163-cc649bb975d5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:30.686574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-21245653-eb6b-427f-b163-cc649bb975d5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.479906 May 12 06:52:30.687290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 60/120] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:30 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:30.692193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1077aefe-d7a5-4759-a3c9-7b3990a89e07 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:30.694729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1077aefe-d7a5-4759-a3c9-7b3990a89e07 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:30.698927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1077aefe-d7a5-4759-a3c9-7b3990a89e07 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:30.699489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1077aefe-d7a5-4759-a3c9-7b3990a89e07 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:30.700425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1077aefe-d7a5-4759-a3c9-7b3990a89e07 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:30.700956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1077aefe-d7a5-4759-a3c9-7b3990a89e07 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:30.708154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-401149a4-fc42-4b94-82fb-b38e9cc1d5de tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1365 microversion: 2.1 time: 0.487805 May 12 06:52:30.708950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 61/121] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:30 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1365 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:30.714092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d1d3619a-b367-4890-bf4e-e1cedea10b7c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef494f05-dc4b-4f54-a1f5-e040090b134d"}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:30.715367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d1d3619a-b367-4890-bf4e-e1cedea10b7c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:30.722151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1d3619a-b367-4890-bf4e-e1cedea10b7c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:30.722812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1d3619a-b367-4890-bf4e-e1cedea10b7c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:30.723598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1d3619a-b367-4890-bf4e-e1cedea10b7c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:30.724147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1d3619a-b367-4890-bf4e-e1cedea10b7c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:30.905708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1077aefe-d7a5-4759-a3c9-7b3990a89e07 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:30.913466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1077aefe-d7a5-4759-a3c9-7b3990a89e07 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.224661 May 12 06:52:30.914822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 61/122] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:30 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:31.704122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1dde4e73-6493-4668-aae6-008a28328b1d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:31.704862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1dde4e73-6493-4668-aae6-008a28328b1d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:31.711248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dde4e73-6493-4668-aae6-008a28328b1d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:31.711712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dde4e73-6493-4668-aae6-008a28328b1d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:31.712493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dde4e73-6493-4668-aae6-008a28328b1d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:31.712925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dde4e73-6493-4668-aae6-008a28328b1d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:31.842548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1dde4e73-6493-4668-aae6-008a28328b1d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:31.850226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1dde4e73-6493-4668-aae6-008a28328b1d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.149983 May 12 06:52:31.850796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 62/123] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:31 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:31.855839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-37d1b69e-e5c2-4a56-a096-77706ef2f803 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:31.855839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-37d1b69e-e5c2-4a56-a096-77706ef2f803 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:31.861441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37d1b69e-e5c2-4a56-a096-77706ef2f803 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:31.861885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37d1b69e-e5c2-4a56-a096-77706ef2f803 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:31.862646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37d1b69e-e5c2-4a56-a096-77706ef2f803 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:31.863080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37d1b69e-e5c2-4a56-a096-77706ef2f803 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:32.011133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-37d1b69e-e5c2-4a56-a096-77706ef2f803 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:32.019162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-37d1b69e-e5c2-4a56-a096-77706ef2f803 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1554 microversion: 2.1 time: 0.167361 May 12 06:52:32.019757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 63/124] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:31 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:32.035216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f9145e36-d4bb-400e-9275-d8b31dc70c7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:32.035846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f9145e36-d4bb-400e-9275-d8b31dc70c7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:32.041938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9145e36-d4bb-400e-9275-d8b31dc70c7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:32.042282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9145e36-d4bb-400e-9275-d8b31dc70c7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:32.043041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9145e36-d4bb-400e-9275-d8b31dc70c7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:32.043477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9145e36-d4bb-400e-9275-d8b31dc70c7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:32.198356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f9145e36-d4bb-400e-9275-d8b31dc70c7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:32.214601 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f9145e36-d4bb-400e-9275-d8b31dc70c7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1321 microversion: 2.1 time: 0.183035 May 12 06:52:32.215191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 64/125] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:32 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:32.226493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fc120bff-3950-4c5a-8294-7e263742b8a0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:32.227959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fc120bff-3950-4c5a-8294-7e263742b8a0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:32.234562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fc120bff-3950-4c5a-8294-7e263742b8a0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:32.235144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fc120bff-3950-4c5a-8294-7e263742b8a0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:32.235966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fc120bff-3950-4c5a-8294-7e263742b8a0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:32.236473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fc120bff-3950-4c5a-8294-7e263742b8a0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:32.311898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d1d3619a-b367-4890-bf4e-e1cedea10b7c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "POST /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.601502 May 12 06:52:32.313503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 62/126] 10.222.0.25 () {60 vars in 1322 bytes} [Thu May 12 06:52:30 2022] POST /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366/os-volume_attachments => generated 194 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:32.324778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-b4256c5b-8d1e-48e2-9f5d-fecbd16a006b req-b3cf51ff-76b4-403c-adf4-465ae61be10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f4aebcd-2d12-4d12-941a-12261cb855af", "name": "network-vif-plugged", "status": "completed", "tag": "7fada614-d793-49ad-98bb-6d8332ab507a"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:32.342848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-b4256c5b-8d1e-48e2-9f5d-fecbd16a006b req-b3cf51ff-76b4-403c-adf4-465ae61be10a service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:32.343357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-b4256c5b-8d1e-48e2-9f5d-fecbd16a006b req-b3cf51ff-76b4-403c-adf4-465ae61be10a service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:32.364157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-b4256c5b-8d1e-48e2-9f5d-fecbd16a006b req-b3cf51ff-76b4-403c-adf4-465ae61be10a service nova] Creating event network-vif-plugged:7fada614-d793-49ad-98bb-6d8332ab507a for instance 7f4aebcd-2d12-4d12-941a-12261cb855af on hv-cinder-76606 May 12 06:52:32.373397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-b4256c5b-8d1e-48e2-9f5d-fecbd16a006b req-b3cf51ff-76b4-403c-adf4-465ae61be10a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058320 May 12 06:52:32.374170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 63/127] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:32.385465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fc120bff-3950-4c5a-8294-7e263742b8a0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169111 May 12 06:52:32.386124 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 65/128] 10.222.0.25 () {58 vars in 1274 bytes} [Thu May 12 06:52:32 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:32.867967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2df422ab-509e-4f0c-aa1d-f8ef64ce1524 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:32.868593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2df422ab-509e-4f0c-aa1d-f8ef64ce1524 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:32.881973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2df422ab-509e-4f0c-aa1d-f8ef64ce1524 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:32.882753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2df422ab-509e-4f0c-aa1d-f8ef64ce1524 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:32.884370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2df422ab-509e-4f0c-aa1d-f8ef64ce1524 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:32.884823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2df422ab-509e-4f0c-aa1d-f8ef64ce1524 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:33.181036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2df422ab-509e-4f0c-aa1d-f8ef64ce1524 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:33.188624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2df422ab-509e-4f0c-aa1d-f8ef64ce1524 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.325267 May 12 06:52:33.189207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 64/129] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:32 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:33.231885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-19f43202-c240-4078-a8d7-27c2a916acb3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:33.232543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-19f43202-c240-4078-a8d7-27c2a916acb3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:33.240900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-19f43202-c240-4078-a8d7-27c2a916acb3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:33.241718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-19f43202-c240-4078-a8d7-27c2a916acb3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:33.243197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-19f43202-c240-4078-a8d7-27c2a916acb3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:33.243796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-19f43202-c240-4078-a8d7-27c2a916acb3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:33.389167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-19f43202-c240-4078-a8d7-27c2a916acb3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:33.398977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-19f43202-c240-4078-a8d7-27c2a916acb3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1515 microversion: 2.1 time: 0.170755 May 12 06:52:33.411460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 66/130] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:33 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:33.419560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4644065a-26f7-4b83-893a-b527f48eb563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:33.421816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4644065a-26f7-4b83-893a-b527f48eb563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:33.427624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4644065a-26f7-4b83-893a-b527f48eb563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:33.428293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4644065a-26f7-4b83-893a-b527f48eb563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:33.429829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4644065a-26f7-4b83-893a-b527f48eb563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:33.430429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4644065a-26f7-4b83-893a-b527f48eb563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:33.454906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-4644065a-26f7-4b83-893a-b527f48eb563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'flavor' on Instance uuid e23874ce-55b2-4fd4-8d8a-17c33e01daf4 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:52:33.965705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4644065a-26f7-4b83-893a-b527f48eb563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4/action" status: 200 len: 32 microversion: 2.1 time: 0.550984 May 12 06:52:33.966827 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 65/131] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 06:52:33 2022] POST /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4/action => generated 32 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 06:52:33.975966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-125329e0-4a19-401e-bea3-b71707cc460e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:33.977432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-125329e0-4a19-401e-bea3-b71707cc460e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:33.983997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-125329e0-4a19-401e-bea3-b71707cc460e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:33.984569 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-125329e0-4a19-401e-bea3-b71707cc460e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:33.985627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-125329e0-4a19-401e-bea3-b71707cc460e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:33.986330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-125329e0-4a19-401e-bea3-b71707cc460e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:34.208250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-10ff29ee-c821-46a7-897d-ba80ad1335da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:34.209378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-10ff29ee-c821-46a7-897d-ba80ad1335da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:34.217634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10ff29ee-c821-46a7-897d-ba80ad1335da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:34.220268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10ff29ee-c821-46a7-897d-ba80ad1335da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:34.221151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10ff29ee-c821-46a7-897d-ba80ad1335da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:34.221751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10ff29ee-c821-46a7-897d-ba80ad1335da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:34.232233 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-125329e0-4a19-401e-bea3-b71707cc460e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:34.242860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-125329e0-4a19-401e-bea3-b71707cc460e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.270290 May 12 06:52:34.243451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 67/132] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:33 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:34.400472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-5356a345-a48b-4f0a-8563-27bc7e23eb42 req-0e8c6b3b-cf3f-41d8-8410-9618846b23fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0baa16c3-ab5a-4e93-a65d-1e038d4af279", "tag": "ef0e8620-aa0e-40bc-834f-7d8adc3412c6"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:34.415428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-5356a345-a48b-4f0a-8563-27bc7e23eb42 req-0e8c6b3b-cf3f-41d8-8410-9618846b23fc service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:34.416506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-5356a345-a48b-4f0a-8563-27bc7e23eb42 req-0e8c6b3b-cf3f-41d8-8410-9618846b23fc service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:34.429211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-5356a345-a48b-4f0a-8563-27bc7e23eb42 req-0e8c6b3b-cf3f-41d8-8410-9618846b23fc service nova] Creating event network-changed:ef0e8620-aa0e-40bc-834f-7d8adc3412c6 for instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 on hv-cinder-76606 May 12 06:52:34.437037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-5356a345-a48b-4f0a-8563-27bc7e23eb42 req-0e8c6b3b-cf3f-41d8-8410-9618846b23fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040920 May 12 06:52:34.444713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 68/133] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:52:34.452679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-10ff29ee-c821-46a7-897d-ba80ad1335da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:34.461552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-10ff29ee-c821-46a7-897d-ba80ad1335da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1362 microversion: 2.1 time: 0.259167 May 12 06:52:34.462533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 66/134] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:34 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:35.260978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f482ef2e-ef07-4b94-ad31-f49b1112e19d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:35.261682 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f482ef2e-ef07-4b94-ad31-f49b1112e19d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:35.273299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f482ef2e-ef07-4b94-ad31-f49b1112e19d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:35.273802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f482ef2e-ef07-4b94-ad31-f49b1112e19d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:35.274576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f482ef2e-ef07-4b94-ad31-f49b1112e19d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:35.279331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f482ef2e-ef07-4b94-ad31-f49b1112e19d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:35.467379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f482ef2e-ef07-4b94-ad31-f49b1112e19d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:35.474486 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f482ef2e-ef07-4b94-ad31-f49b1112e19d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.217989 May 12 06:52:35.475001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 69/135] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:35 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:35.481135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-24601126-f575-4c31-a5c5-23fa51890381 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:35.482554 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-24601126-f575-4c31-a5c5-23fa51890381 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:35.493564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-24601126-f575-4c31-a5c5-23fa51890381 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:35.506335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-24601126-f575-4c31-a5c5-23fa51890381 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:35.516400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-24601126-f575-4c31-a5c5-23fa51890381 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:35.518471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-24601126-f575-4c31-a5c5-23fa51890381 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:35.694349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-24601126-f575-4c31-a5c5-23fa51890381 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:35.702125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-24601126-f575-4c31-a5c5-23fa51890381 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1548 microversion: 2.1 time: 0.227485 May 12 06:52:35.703880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 67/136] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:35 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1548 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:35.722147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fa347781-b5c4-4021-86e8-6ed7956022a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:35.722147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fa347781-b5c4-4021-86e8-6ed7956022a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:35.728245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa347781-b5c4-4021-86e8-6ed7956022a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:35.730711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa347781-b5c4-4021-86e8-6ed7956022a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:35.733926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa347781-b5c4-4021-86e8-6ed7956022a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:35.734596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa347781-b5c4-4021-86e8-6ed7956022a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:35.893111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fa347781-b5c4-4021-86e8-6ed7956022a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177165 May 12 06:52:35.894146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 70/137] 10.222.0.25 () {58 vars in 1274 bytes} [Thu May 12 06:52:35 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:36.491284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-30fa0678-848b-4902-9d1f-aca29e9a764d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:36.491928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-30fa0678-848b-4902-9d1f-aca29e9a764d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:36.498414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30fa0678-848b-4902-9d1f-aca29e9a764d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:36.498868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30fa0678-848b-4902-9d1f-aca29e9a764d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:36.499645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30fa0678-848b-4902-9d1f-aca29e9a764d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:36.500113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30fa0678-848b-4902-9d1f-aca29e9a764d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:36.725391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-30fa0678-848b-4902-9d1f-aca29e9a764d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:36.733245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-30fa0678-848b-4902-9d1f-aca29e9a764d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.246006 May 12 06:52:36.733825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 68/138] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:36 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:37.175053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-54f8e76a-12c4-4148-8117-8752293dec98 req-84788ab0-80c2-4409-ae5e-13ef1c4822c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f4aebcd-2d12-4d12-941a-12261cb855af", "tag": "7fada614-d793-49ad-98bb-6d8332ab507a"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:37.184693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-54f8e76a-12c4-4148-8117-8752293dec98 req-84788ab0-80c2-4409-ae5e-13ef1c4822c2 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:37.185347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-54f8e76a-12c4-4148-8117-8752293dec98 req-84788ab0-80c2-4409-ae5e-13ef1c4822c2 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:37.197784 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-54f8e76a-12c4-4148-8117-8752293dec98 req-84788ab0-80c2-4409-ae5e-13ef1c4822c2 service nova] Creating event network-changed:7fada614-d793-49ad-98bb-6d8332ab507a for instance 7f4aebcd-2d12-4d12-941a-12261cb855af on hv-cinder-76606 May 12 06:52:37.203643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-54f8e76a-12c4-4148-8117-8752293dec98 req-84788ab0-80c2-4409-ae5e-13ef1c4822c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032268 May 12 06:52:37.204357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 71/139] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:37.750331 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2ca1a1f0-93bf-4e27-8afc-0b446c6895b1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:37.751302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2ca1a1f0-93bf-4e27-8afc-0b446c6895b1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:37.758111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ca1a1f0-93bf-4e27-8afc-0b446c6895b1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:37.758805 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ca1a1f0-93bf-4e27-8afc-0b446c6895b1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:37.759709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ca1a1f0-93bf-4e27-8afc-0b446c6895b1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:37.760257 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ca1a1f0-93bf-4e27-8afc-0b446c6895b1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:37.924046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2ca1a1f0-93bf-4e27-8afc-0b446c6895b1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:37.932437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2ca1a1f0-93bf-4e27-8afc-0b446c6895b1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.185887 May 12 06:52:37.933110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 69/140] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:37 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:38.950204 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2ee1581c-8a8c-41e1-b280-2b97504da3b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:38.950906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2ee1581c-8a8c-41e1-b280-2b97504da3b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:38.956928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ee1581c-8a8c-41e1-b280-2b97504da3b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:38.957446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ee1581c-8a8c-41e1-b280-2b97504da3b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:38.958150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ee1581c-8a8c-41e1-b280-2b97504da3b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:38.958588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ee1581c-8a8c-41e1-b280-2b97504da3b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:39.094301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2ee1581c-8a8c-41e1-b280-2b97504da3b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:39.103123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2ee1581c-8a8c-41e1-b280-2b97504da3b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.156795 May 12 06:52:39.103794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 72/141] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:38 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:40.120004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a8c811a5-b9c7-4971-8b15-2147c9fb456c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:40.120623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a8c811a5-b9c7-4971-8b15-2147c9fb456c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:40.126859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a8c811a5-b9c7-4971-8b15-2147c9fb456c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:40.127369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a8c811a5-b9c7-4971-8b15-2147c9fb456c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:40.128208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a8c811a5-b9c7-4971-8b15-2147c9fb456c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:40.128648 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a8c811a5-b9c7-4971-8b15-2147c9fb456c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:40.260618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a8c811a5-b9c7-4971-8b15-2147c9fb456c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:40.268100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a8c811a5-b9c7-4971-8b15-2147c9fb456c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.151918 May 12 06:52:40.268675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 70/142] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:40 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:41.288882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c8cb84dd-3548-4b81-925f-2735bceea804 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:41.288882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c8cb84dd-3548-4b81-925f-2735bceea804 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:41.291245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8cb84dd-3548-4b81-925f-2735bceea804 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:41.291708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8cb84dd-3548-4b81-925f-2735bceea804 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:41.292482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8cb84dd-3548-4b81-925f-2735bceea804 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:41.292913 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8cb84dd-3548-4b81-925f-2735bceea804 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:41.422787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c8cb84dd-3548-4b81-925f-2735bceea804 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:41.430760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c8cb84dd-3548-4b81-925f-2735bceea804 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.150183 May 12 06:52:41.431335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 73/143] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:41 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:42.447478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-753b88bb-bd0a-49e2-b8c7-cb821323a47f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:42.448115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-753b88bb-bd0a-49e2-b8c7-cb821323a47f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:42.454822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-753b88bb-bd0a-49e2-b8c7-cb821323a47f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:42.455275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-753b88bb-bd0a-49e2-b8c7-cb821323a47f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:42.456075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-753b88bb-bd0a-49e2-b8c7-cb821323a47f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:42.456513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-753b88bb-bd0a-49e2-b8c7-cb821323a47f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:42.623520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-753b88bb-bd0a-49e2-b8c7-cb821323a47f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:42.632429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-753b88bb-bd0a-49e2-b8c7-cb821323a47f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.188076 May 12 06:52:42.632429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 71/144] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:42 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:43.628559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-eec9eb28-d66e-4044-99fa-71aacc6a55c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:43.629583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-eec9eb28-d66e-4044-99fa-71aacc6a55c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:43.636814 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eec9eb28-d66e-4044-99fa-71aacc6a55c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:43.637269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eec9eb28-d66e-4044-99fa-71aacc6a55c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:43.638091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eec9eb28-d66e-4044-99fa-71aacc6a55c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:43.638526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eec9eb28-d66e-4044-99fa-71aacc6a55c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:43.653797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b5b566a4-b89e-4d2e-bb9a-9d70b87bc7b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:43.668176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b5b566a4-b89e-4d2e-bb9a-9d70b87bc7b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:43.668176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5b566a4-b89e-4d2e-bb9a-9d70b87bc7b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:43.668176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5b566a4-b89e-4d2e-bb9a-9d70b87bc7b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:43.668760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5b566a4-b89e-4d2e-bb9a-9d70b87bc7b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:43.669437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5b566a4-b89e-4d2e-bb9a-9d70b87bc7b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:43.707327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-eec9eb28-d66e-4044-99fa-71aacc6a55c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 06:52:43.933044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b5b566a4-b89e-4d2e-bb9a-9d70b87bc7b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:43.937561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b5b566a4-b89e-4d2e-bb9a-9d70b87bc7b7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.291078 May 12 06:52:43.938128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 72/145] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:43 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:44.142307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-eec9eb28-d66e-4044-99fa-71aacc6a55c4 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 204 len: 0 microversion: 2.1 time: 0.519015 May 12 06:52:44.143383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 74/146] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 06:52:43 2022] DELETE /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 06:52:44.152098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-479a17bb-5119-4d92-9216-0557f77ba2a2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:44.153260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-479a17bb-5119-4d92-9216-0557f77ba2a2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:44.159441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-479a17bb-5119-4d92-9216-0557f77ba2a2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:44.159923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-479a17bb-5119-4d92-9216-0557f77ba2a2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:44.160710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-479a17bb-5119-4d92-9216-0557f77ba2a2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:44.161146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-479a17bb-5119-4d92-9216-0557f77ba2a2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:44.471312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-479a17bb-5119-4d92-9216-0557f77ba2a2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:44.480171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-479a17bb-5119-4d92-9216-0557f77ba2a2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1553 microversion: 2.1 time: 0.332535 May 12 06:52:44.480752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 73/147] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:44 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1553 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:44.955187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-adeee6db-0036-4748-a04a-58ffb0b8fd26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:44.956342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-adeee6db-0036-4748-a04a-58ffb0b8fd26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:44.971488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-adeee6db-0036-4748-a04a-58ffb0b8fd26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:44.972160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-adeee6db-0036-4748-a04a-58ffb0b8fd26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:44.973026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-adeee6db-0036-4748-a04a-58ffb0b8fd26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:44.973565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-adeee6db-0036-4748-a04a-58ffb0b8fd26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:45.376984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-adeee6db-0036-4748-a04a-58ffb0b8fd26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:45.385487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-adeee6db-0036-4748-a04a-58ffb0b8fd26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.434747 May 12 06:52:45.386057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 75/148] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:44 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:45.497391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-947f8d53-7458-4a6e-9d47-e97073965495 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:45.498007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-947f8d53-7458-4a6e-9d47-e97073965495 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:45.504638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-947f8d53-7458-4a6e-9d47-e97073965495 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:45.505205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-947f8d53-7458-4a6e-9d47-e97073965495 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:45.508035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-947f8d53-7458-4a6e-9d47-e97073965495 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:45.508491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-947f8d53-7458-4a6e-9d47-e97073965495 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:45.712473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-947f8d53-7458-4a6e-9d47-e97073965495 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:45.720279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-947f8d53-7458-4a6e-9d47-e97073965495 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1553 microversion: 2.1 time: 0.226743 May 12 06:52:45.720843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 74/149] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:45 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1553 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:46.402298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3de0b197-0c22-4efb-ba6c-9675069e5d82 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:46.403108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3de0b197-0c22-4efb-ba6c-9675069e5d82 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:46.409666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3de0b197-0c22-4efb-ba6c-9675069e5d82 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:46.410526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3de0b197-0c22-4efb-ba6c-9675069e5d82 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:46.411546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3de0b197-0c22-4efb-ba6c-9675069e5d82 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:46.412197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3de0b197-0c22-4efb-ba6c-9675069e5d82 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:46.648140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3de0b197-0c22-4efb-ba6c-9675069e5d82 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:46.663153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3de0b197-0c22-4efb-ba6c-9675069e5d82 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.264317 May 12 06:52:46.664950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 76/150] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:46 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:46.738293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-70b32500-8136-4ad2-8aff-ea6a72646ccd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:46.739486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-70b32500-8136-4ad2-8aff-ea6a72646ccd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:46.745744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70b32500-8136-4ad2-8aff-ea6a72646ccd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:46.746390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70b32500-8136-4ad2-8aff-ea6a72646ccd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:46.747313 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70b32500-8136-4ad2-8aff-ea6a72646ccd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:46.747917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70b32500-8136-4ad2-8aff-ea6a72646ccd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:46.890706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-70b32500-8136-4ad2-8aff-ea6a72646ccd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:46.899079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-70b32500-8136-4ad2-8aff-ea6a72646ccd tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1553 microversion: 2.1 time: 0.164509 May 12 06:52:46.899898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 75/151] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:46 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:47.417974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-2d480e97-5527-435c-94ab-8df6732c9c04 req-8d9532f2-09c2-4387-9d86-762f14758f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff2372e-1d0c-451a-9133-670b69144366", "name": "network-vif-deleted", "tag": "fc53d3cb-2af6-4766-84ac-ed178ee084d1"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:52:47.446078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-2d480e97-5527-435c-94ab-8df6732c9c04 req-8d9532f2-09c2-4387-9d86-762f14758f34 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:47.447240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-2d480e97-5527-435c-94ab-8df6732c9c04 req-8d9532f2-09c2-4387-9d86-762f14758f34 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:47.462006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-2d480e97-5527-435c-94ab-8df6732c9c04 req-8d9532f2-09c2-4387-9d86-762f14758f34 service nova] Creating event network-vif-deleted:fc53d3cb-2af6-4766-84ac-ed178ee084d1 for instance 1ff2372e-1d0c-451a-9133-670b69144366 on hv-cinder-76606 May 12 06:52:47.468835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-2d480e97-5527-435c-94ab-8df6732c9c04 req-8d9532f2-09c2-4387-9d86-762f14758f34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054960 May 12 06:52:47.469327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 77/152] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:52:47.683642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7792740c-48fe-48e1-87b1-f19d394998cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:47.684341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7792740c-48fe-48e1-87b1-f19d394998cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:47.690381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7792740c-48fe-48e1-87b1-f19d394998cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:47.690832 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7792740c-48fe-48e1-87b1-f19d394998cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:47.691640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7792740c-48fe-48e1-87b1-f19d394998cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:47.692126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7792740c-48fe-48e1-87b1-f19d394998cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:47.820702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7792740c-48fe-48e1-87b1-f19d394998cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:47.828166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7792740c-48fe-48e1-87b1-f19d394998cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.148873 May 12 06:52:47.828748 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 76/153] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:47 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:52:47.916883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-83f6b1aa-7c02-4b12-b716-d63f1178854e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:47.917587 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-83f6b1aa-7c02-4b12-b716-d63f1178854e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:47.923516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83f6b1aa-7c02-4b12-b716-d63f1178854e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:47.923997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83f6b1aa-7c02-4b12-b716-d63f1178854e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:47.924765 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83f6b1aa-7c02-4b12-b716-d63f1178854e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:47.925202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83f6b1aa-7c02-4b12-b716-d63f1178854e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:48.020447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-83f6b1aa-7c02-4b12-b716-d63f1178854e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:48.029267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-83f6b1aa-7c02-4b12-b716-d63f1178854e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1346 microversion: 2.1 time: 0.117413 May 12 06:52:48.039927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 78/154] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:47 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1346 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:48.846952 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e78bd1cc-007f-46e4-b469-1253f44c4f81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:48.847736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e78bd1cc-007f-46e4-b469-1253f44c4f81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:48.860798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e78bd1cc-007f-46e4-b469-1253f44c4f81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:48.862287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e78bd1cc-007f-46e4-b469-1253f44c4f81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:48.864781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e78bd1cc-007f-46e4-b469-1253f44c4f81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:48.865234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e78bd1cc-007f-46e4-b469-1253f44c4f81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:49.018460 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e78bd1cc-007f-46e4-b469-1253f44c4f81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:49.027324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e78bd1cc-007f-46e4-b469-1253f44c4f81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.185961 May 12 06:52:49.038136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 77/155] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:48 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:49.046221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-eb7dc7cc-926d-46d9-87fd-657350e36ff2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:49.046842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-eb7dc7cc-926d-46d9-87fd-657350e36ff2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:49.058581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eb7dc7cc-926d-46d9-87fd-657350e36ff2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:49.059036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eb7dc7cc-926d-46d9-87fd-657350e36ff2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:49.059873 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eb7dc7cc-926d-46d9-87fd-657350e36ff2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:49.060295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eb7dc7cc-926d-46d9-87fd-657350e36ff2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:49.090942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eb7dc7cc-926d-46d9-87fd-657350e36ff2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:49.091322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eb7dc7cc-926d-46d9-87fd-657350e36ff2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:49.091876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-eb7dc7cc-926d-46d9-87fd-657350e36ff2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lazy-loading 'fault' on Instance uuid 1ff2372e-1d0c-451a-9133-670b69144366 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:52:49.136954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-eb7dc7cc-926d-46d9-87fd-657350e36ff2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a93626f8db64b7193772320bfb3ed5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3fff43ea54c74bb52d76d2264d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:49.163280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-eb7dc7cc-926d-46d9-87fd-657350e36ff2 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 200 len: 1305 microversion: 2.1 time: 0.120226 May 12 06:52:49.174207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 79/156] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:49 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 1305 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:50.045222 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1f32edd9-4b40-4636-b1b0-43ee30dac27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:50.045870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1f32edd9-4b40-4636-b1b0-43ee30dac27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:50.052176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f32edd9-4b40-4636-b1b0-43ee30dac27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:50.052643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f32edd9-4b40-4636-b1b0-43ee30dac27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:50.053383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f32edd9-4b40-4636-b1b0-43ee30dac27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:50.053826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f32edd9-4b40-4636-b1b0-43ee30dac27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:50.182144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1f32edd9-4b40-4636-b1b0-43ee30dac27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:50.186527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d3aba529-40ce-44dd-916a-2fd33289aaac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:50.187283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d3aba529-40ce-44dd-916a-2fd33289aaac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:50.189798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1f32edd9-4b40-4636-b1b0-43ee30dac27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.148419 May 12 06:52:50.190594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 78/157] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:50 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:50.196254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3aba529-40ce-44dd-916a-2fd33289aaac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:50.196615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3aba529-40ce-44dd-916a-2fd33289aaac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:50.197978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3aba529-40ce-44dd-916a-2fd33289aaac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:50.198909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3aba529-40ce-44dd-916a-2fd33289aaac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:50.214065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-d3aba529-40ce-44dd-916a-2fd33289aaac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] HTTP exception thrown: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d3aba529-40ce-44dd-916a-2fd33289aaac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Request method failure captured: May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 HTTP/1.1 May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK55zU4-0WGBBq4HXWxsZ1T4ApD-eb63yg6JrzBdBFT-1fyCVyO6pUzp_bIO_5zlo1QuHfidS5VxmsdubS4PLAqXhjG-d2SVkcs3as4J18wWMDsYKSmqzf2Dn6YnCvG0bDfDCyMDDm57H8rTbhiBlUv4mwdnHb81Blk8z0FuGHvCXb4 May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: a3b3fff43ea54c74bb52d76d2264d008 May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 06:52:50.218669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3b3fff43ea54c74bb52d76d2264d008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3b3fff43ea54c74bb52d76d2264d008", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3b3fff43ea54c74bb52d76d2264d008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3b3fff43ea54c74bb52d76d2264d008"}]}] May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: a3b3fff43ea54c74bb52d76d2264d008 May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-DeleteServersTestJSON-1756216634-project May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 0a93626f8db64b7193772320bfb3ed5a May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-DeleteServersTestJSON-1756216634-project May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:50.220405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': '1ff2372e-1d0c-451a-9133-670b69144366'} May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:52:50.221113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:50.222229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:52:50.223203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d3aba529-40ce-44dd-916a-2fd33289aaac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Returning 404 to user: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:52:50.223203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d3aba529-40ce-44dd-916a-2fd33289aaac tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 404 len: 111 microversion: 2.1 time: 0.037971 May 12 06:52:50.223203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 80/158] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:50 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 06:52:50.325072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e492840e-b57b-4392-895b-15289e98b29e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:50.326056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e492840e-b57b-4392-895b-15289e98b29e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:50.332014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e492840e-b57b-4392-895b-15289e98b29e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:50.332459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e492840e-b57b-4392-895b-15289e98b29e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:50.333313 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e492840e-b57b-4392-895b-15289e98b29e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:50.333770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e492840e-b57b-4392-895b-15289e98b29e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:50.352651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-e492840e-b57b-4392-895b-15289e98b29e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] HTTP exception thrown: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e492840e-b57b-4392-895b-15289e98b29e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Request method failure captured: May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366/os-volume_attachments HTTP/1.1 May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK55zU4-0WGBBq4HXWxsZ1T4ApD-eb63yg6JrzBdBFT-1fyCVyO6pUzp_bIO_5zlo1QuHfidS5VxmsdubS4PLAqXhjG-d2SVkcs3as4J18wWMDsYKSmqzf2Dn6YnCvG0bDfDCyMDDm57H8rTbhiBlUv4mwdnHb81Blk8z0FuGHvCXb4 May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: a3b3fff43ea54c74bb52d76d2264d008 May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 06:52:50.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3b3fff43ea54c74bb52d76d2264d008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3b3fff43ea54c74bb52d76d2264d008", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3b3fff43ea54c74bb52d76d2264d008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3b3fff43ea54c74bb52d76d2264d008"}]}] May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: a3b3fff43ea54c74bb52d76d2264d008 May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-DeleteServersTestJSON-1756216634-project May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 0a93626f8db64b7193772320bfb3ed5a May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-DeleteServersTestJSON-1756216634-project May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:50.358175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'server_id': '1ff2372e-1d0c-451a-9133-670b69144366'} May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:52:50.358918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:50.360013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:52:50.361060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e492840e-b57b-4392-895b-15289e98b29e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Returning 404 to user: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:52:50.361060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e492840e-b57b-4392-895b-15289e98b29e tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037682 May 12 06:52:50.361060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 79/159] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:52:50 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 06:52:51.216639 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d01a548d-4ea4-4f37-bd16-38121c21d0c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:51.218383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d01a548d-4ea4-4f37-bd16-38121c21d0c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:51.228287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d01a548d-4ea4-4f37-bd16-38121c21d0c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:51.228853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d01a548d-4ea4-4f37-bd16-38121c21d0c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:51.229717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d01a548d-4ea4-4f37-bd16-38121c21d0c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:51.230228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d01a548d-4ea4-4f37-bd16-38121c21d0c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:51.386045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d01a548d-4ea4-4f37-bd16-38121c21d0c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:51.393243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d01a548d-4ea4-4f37-bd16-38121c21d0c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.189950 May 12 06:52:51.394046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 81/160] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:51 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:51.702445 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f8d1149f-6fe6-4465-a337-5e286347ad17 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:51.702989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f8d1149f-6fe6-4465-a337-5e286347ad17 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:51.709532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8d1149f-6fe6-4465-a337-5e286347ad17 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:51.709943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8d1149f-6fe6-4465-a337-5e286347ad17 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:51.710818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8d1149f-6fe6-4465-a337-5e286347ad17 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:51.711796 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8d1149f-6fe6-4465-a337-5e286347ad17 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:51.725304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-f8d1149f-6fe6-4465-a337-5e286347ad17 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] HTTP exception thrown: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f8d1149f-6fe6-4465-a337-5e286347ad17 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Request method failure captured: May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 HTTP/1.1 May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK55zU4-0WGBBq4HXWxsZ1T4ApD-eb63yg6JrzBdBFT-1fyCVyO6pUzp_bIO_5zlo1QuHfidS5VxmsdubS4PLAqXhjG-d2SVkcs3as4J18wWMDsYKSmqzf2Dn6YnCvG0bDfDCyMDDm57H8rTbhiBlUv4mwdnHb81Blk8z0FuGHvCXb4 May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: a3b3fff43ea54c74bb52d76d2264d008 May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 06:52:51.727492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3b3fff43ea54c74bb52d76d2264d008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3b3fff43ea54c74bb52d76d2264d008", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3b3fff43ea54c74bb52d76d2264d008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3b3fff43ea54c74bb52d76d2264d008"}]}] May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: a3b3fff43ea54c74bb52d76d2264d008 May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-DeleteServersTestJSON-1756216634-project May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 0a93626f8db64b7193772320bfb3ed5a May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-DeleteServersTestJSON-1756216634-project May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:51.728890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '1ff2372e-1d0c-451a-9133-670b69144366'} May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:52:51.729698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:51.731018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:52:51.732338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f8d1149f-6fe6-4465-a337-5e286347ad17 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Returning 404 to user: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:52:51.732338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f8d1149f-6fe6-4465-a337-5e286347ad17 tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 404 len: 111 microversion: 2.1 time: 0.030740 May 12 06:52:51.732338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 80/161] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 06:52:51 2022] DELETE /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 06:52:51.737462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3ddc17a1-4715-4099-a593-0cb679c3243c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:51.738069 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3ddc17a1-4715-4099-a593-0cb679c3243c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] [instance: 1ff2372e-1d0c-451a-9133-670b69144366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:51.743911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ddc17a1-4715-4099-a593-0cb679c3243c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:51.744356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ddc17a1-4715-4099-a593-0cb679c3243c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:51.745109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ddc17a1-4715-4099-a593-0cb679c3243c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:51.745537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ddc17a1-4715-4099-a593-0cb679c3243c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:51.758760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-3ddc17a1-4715-4099-a593-0cb679c3243c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] HTTP exception thrown: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3ddc17a1-4715-4099-a593-0cb679c3243c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Request method failure captured: May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 HTTP/1.1 May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK55zU4-0WGBBq4HXWxsZ1T4ApD-eb63yg6JrzBdBFT-1fyCVyO6pUzp_bIO_5zlo1QuHfidS5VxmsdubS4PLAqXhjG-d2SVkcs3as4J18wWMDsYKSmqzf2Dn6YnCvG0bDfDCyMDDm57H8rTbhiBlUv4mwdnHb81Blk8z0FuGHvCXb4 May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: a3b3fff43ea54c74bb52d76d2264d008 May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 06:52:51.760266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3b3fff43ea54c74bb52d76d2264d008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3b3fff43ea54c74bb52d76d2264d008", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3b3fff43ea54c74bb52d76d2264d008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3b3fff43ea54c74bb52d76d2264d008"}]}] May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: a3b3fff43ea54c74bb52d76d2264d008 May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756216634 May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-DeleteServersTestJSON-1756216634-project May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 0a93626f8db64b7193772320bfb3ed5a May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-DeleteServersTestJSON-1756216634-project May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:51.761683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': '1ff2372e-1d0c-451a-9133-670b69144366'} May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:52:51.762461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. May 12 06:52:51.763746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:52:51.764944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3ddc17a1-4715-4099-a593-0cb679c3243c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] Returning 404 to user: Instance 1ff2372e-1d0c-451a-9133-670b69144366 could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:52:51.764944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3ddc17a1-4715-4099-a593-0cb679c3243c tempest-DeleteServersTestJSON-1756216634 tempest-DeleteServersTestJSON-1756216634-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366" status: 404 len: 111 microversion: 2.1 time: 0.027956 May 12 06:52:51.764944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 82/162] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:51 2022] GET /compute/v2.1/servers/1ff2372e-1d0c-451a-9133-670b69144366 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 06:52:52.415227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2b5ebbf0-867a-4bca-b592-77fb0335fcb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:52.416493 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2b5ebbf0-867a-4bca-b592-77fb0335fcb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:52.425983 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b5ebbf0-867a-4bca-b592-77fb0335fcb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:52.427390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b5ebbf0-867a-4bca-b592-77fb0335fcb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:52.429518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b5ebbf0-867a-4bca-b592-77fb0335fcb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:52.431048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b5ebbf0-867a-4bca-b592-77fb0335fcb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:52.656013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2b5ebbf0-867a-4bca-b592-77fb0335fcb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:52.664923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2b5ebbf0-867a-4bca-b592-77fb0335fcb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.258208 May 12 06:52:52.665499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 81/163] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:52 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:53.681943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0de38bdd-9efc-4c9f-91a2-f274908414eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:53.683063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0de38bdd-9efc-4c9f-91a2-f274908414eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:53.689030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0de38bdd-9efc-4c9f-91a2-f274908414eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:53.691869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0de38bdd-9efc-4c9f-91a2-f274908414eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:53.696822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0de38bdd-9efc-4c9f-91a2-f274908414eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:53.697505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0de38bdd-9efc-4c9f-91a2-f274908414eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:53.833970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0de38bdd-9efc-4c9f-91a2-f274908414eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:53.841211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0de38bdd-9efc-4c9f-91a2-f274908414eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.163420 May 12 06:52:53.841769 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 83/164] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:53 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:54.857477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-355be630-138c-41e9-b9b6-bdec289c5ddd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:54.858040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-355be630-138c-41e9-b9b6-bdec289c5ddd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:54.864440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-355be630-138c-41e9-b9b6-bdec289c5ddd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:54.864885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-355be630-138c-41e9-b9b6-bdec289c5ddd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:54.865654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-355be630-138c-41e9-b9b6-bdec289c5ddd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:54.866117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-355be630-138c-41e9-b9b6-bdec289c5ddd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:54.996377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-355be630-138c-41e9-b9b6-bdec289c5ddd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:55.003793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-355be630-138c-41e9-b9b6-bdec289c5ddd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.150138 May 12 06:52:55.004348 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 82/165] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:54 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:56.025605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ebb77644-266c-4a96-b759-4e2e0d03cfcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:56.025605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ebb77644-266c-4a96-b759-4e2e0d03cfcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:56.029864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebb77644-266c-4a96-b759-4e2e0d03cfcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:56.030603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebb77644-266c-4a96-b759-4e2e0d03cfcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:56.031589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebb77644-266c-4a96-b759-4e2e0d03cfcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:56.032137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebb77644-266c-4a96-b759-4e2e0d03cfcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:56.250947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ebb77644-266c-4a96-b759-4e2e0d03cfcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:56.258511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ebb77644-266c-4a96-b759-4e2e0d03cfcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.241330 May 12 06:52:56.259369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 84/166] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:56 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:57.275998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cfa4f884-5825-4495-9b7b-23f91623127b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:57.277541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cfa4f884-5825-4495-9b7b-23f91623127b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:57.284659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfa4f884-5825-4495-9b7b-23f91623127b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:57.285220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfa4f884-5825-4495-9b7b-23f91623127b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:57.286143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfa4f884-5825-4495-9b7b-23f91623127b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:57.286653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfa4f884-5825-4495-9b7b-23f91623127b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:57.463012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cfa4f884-5825-4495-9b7b-23f91623127b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:57.472124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cfa4f884-5825-4495-9b7b-23f91623127b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.201313 May 12 06:52:57.484700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 83/167] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:57 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:58.492924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a3fdef37-e541-4dfb-8c85-36b9052aa9c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:58.493562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a3fdef37-e541-4dfb-8c85-36b9052aa9c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:58.516469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3fdef37-e541-4dfb-8c85-36b9052aa9c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:58.517875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3fdef37-e541-4dfb-8c85-36b9052aa9c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:58.518893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3fdef37-e541-4dfb-8c85-36b9052aa9c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:58.519590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3fdef37-e541-4dfb-8c85-36b9052aa9c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:58.724552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a3fdef37-e541-4dfb-8c85-36b9052aa9c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:58.736159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a3fdef37-e541-4dfb-8c85-36b9052aa9c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.249014 May 12 06:52:58.737417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 85/168] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:58 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:52:59.754732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6d9f92ee-27a7-4af0-8f93-2135acef9ff8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:52:59.755656 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6d9f92ee-27a7-4af0-8f93-2135acef9ff8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:52:59.772763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6d9f92ee-27a7-4af0-8f93-2135acef9ff8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:59.773619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6d9f92ee-27a7-4af0-8f93-2135acef9ff8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:59.774682 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6d9f92ee-27a7-4af0-8f93-2135acef9ff8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:52:59.775283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6d9f92ee-27a7-4af0-8f93-2135acef9ff8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:52:59.963165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6d9f92ee-27a7-4af0-8f93-2135acef9ff8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:52:59.974106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6d9f92ee-27a7-4af0-8f93-2135acef9ff8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.224656 May 12 06:52:59.974714 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 84/169] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:52:59 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:01.007295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ec710b7a-dde4-4fa4-9926-212eafa0b09f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:01.009129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ec710b7a-dde4-4fa4-9926-212eafa0b09f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:01.020098 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec710b7a-dde4-4fa4-9926-212eafa0b09f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:01.020602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec710b7a-dde4-4fa4-9926-212eafa0b09f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:01.021722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec710b7a-dde4-4fa4-9926-212eafa0b09f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:01.022412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec710b7a-dde4-4fa4-9926-212eafa0b09f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:01.177427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ec710b7a-dde4-4fa4-9926-212eafa0b09f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:01.187357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ec710b7a-dde4-4fa4-9926-212eafa0b09f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.198723 May 12 06:53:01.188842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 86/170] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:00 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:02.209337 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f85ff383-1a5e-408d-ac9f-814a7de1ef7e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:02.212118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f85ff383-1a5e-408d-ac9f-814a7de1ef7e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:02.220794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f85ff383-1a5e-408d-ac9f-814a7de1ef7e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:02.221341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f85ff383-1a5e-408d-ac9f-814a7de1ef7e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:02.222354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f85ff383-1a5e-408d-ac9f-814a7de1ef7e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:02.222790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f85ff383-1a5e-408d-ac9f-814a7de1ef7e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:02.412119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f85ff383-1a5e-408d-ac9f-814a7de1ef7e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:02.420748 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f85ff383-1a5e-408d-ac9f-814a7de1ef7e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.219637 May 12 06:53:02.421926 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 85/171] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:02 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:03.224528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5dcccfe5-9ed0-458f-8fc0-8830546c5ac2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Action: 'create', calling method: .version_select at 0x7f89da5fe9d0>, body: {"keypair": {"name": "tempest-keypair-791570375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAwxrp11251+OC62erhrSE7N9FXVOja9wqp7DF9dMDSTFzRYEHplL58PspPd1Mt1GixHXX9cYNeX4VayKUsYfGUNWIWCfXSEujkRxTC5AnNnxxml8I3WidSw7eLR/RckQ=="}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:03.240595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-5dcccfe5-9ed0-458f-8fc0-8830546c5ac2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Getting quotas for project d3c6164700aa4d2a87819ad713a5fa37. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:53:03.245312 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-5dcccfe5-9ed0-458f-8fc0-8830546c5ac2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Getting quotas for user 4097ea09148b4093914d1c4796e05df8 and project d3c6164700aa4d2a87819ad713a5fa37. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:53:03.366157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5dcccfe5-9ed0-458f-8fc0-8830546c5ac2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.280314 May 12 06:53:03.367563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 87/172] 10.222.0.25 () {62 vars in 1199 bytes} [Thu May 12 06:53:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 282 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 06:53:03.438395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c8846aaf-a39d-4a53-af89-8275d39a7cf3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:03.438914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c8846aaf-a39d-4a53-af89-8275d39a7cf3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:03.445886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8846aaf-a39d-4a53-af89-8275d39a7cf3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:03.446332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8846aaf-a39d-4a53-af89-8275d39a7cf3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:03.447093 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8846aaf-a39d-4a53-af89-8275d39a7cf3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:03.447525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8846aaf-a39d-4a53-af89-8275d39a7cf3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:03.581611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c8846aaf-a39d-4a53-af89-8275d39a7cf3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:03.589389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c8846aaf-a39d-4a53-af89-8275d39a7cf3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.154981 May 12 06:53:03.589975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 86/173] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:03 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:04.607286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e5471ed5-3c58-43f0-95a4-326e171c5570 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:04.608060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e5471ed5-3c58-43f0-95a4-326e171c5570 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:04.614896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5471ed5-3c58-43f0-95a4-326e171c5570 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:04.615745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5471ed5-3c58-43f0-95a4-326e171c5570 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:04.616687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5471ed5-3c58-43f0-95a4-326e171c5570 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:04.617663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5471ed5-3c58-43f0-95a4-326e171c5570 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:04.768382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e5471ed5-3c58-43f0-95a4-326e171c5570 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:04.781570 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e5471ed5-3c58-43f0-95a4-326e171c5570 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.178488 May 12 06:53:04.782470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 88/174] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:04 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:05.742933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-685010984", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2cb2b6a-a9dd-4877-bda4-e495f18ff2a3"}], "security_groups": [{"name": "tempest-securitygroup--2093945440"}], "key_name": "tempest-keypair-791570375", "user_data": "}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:05.800643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-228cae10-c8a7-4eb8-b9eb-6b4d68e1c88c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:05.802197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-228cae10-c8a7-4eb8-b9eb-6b4d68e1c88c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:05.810185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-228cae10-c8a7-4eb8-b9eb-6b4d68e1c88c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:05.810637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-228cae10-c8a7-4eb8-b9eb-6b4d68e1c88c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:05.811421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-228cae10-c8a7-4eb8-b9eb-6b4d68e1c88c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:05.812173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-228cae10-c8a7-4eb8-b9eb-6b4d68e1c88c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:05.918595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.network.neutron [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] validate_networks() for [('d2cb2b6a-a9dd-4877-bda4-e495f18ff2a3', None, None, None, None, None)] {{(pid=124024) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:53:06.048804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-228cae10-c8a7-4eb8-b9eb-6b4d68e1c88c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:06.057586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-228cae10-c8a7-4eb8-b9eb-6b4d68e1c88c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.261415 May 12 06:53:06.058726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 89/175] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:05 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:06.365190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Flavor limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:53:06.365809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Image limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:53:06.366549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Flavor pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:53:06.366992 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Image pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:53:06.367401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:53:06.376463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:06.376911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:06.377705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:06.378136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:06.394707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Getting quotas for project d3c6164700aa4d2a87819ad713a5fa37. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:53:06.399219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Getting quotas for user 4097ea09148b4093914d1c4796e05df8 and project d3c6164700aa4d2a87819ad713a5fa37. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:53:06.410378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Going to run 1 instances... {{(pid=124024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:53:06.412679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:53:06.592375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-10c36ec8-8fe1-4b02-96a2-d8a70f9cdd30 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.854829 May 12 06:53:06.593028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 87/176] 10.222.0.25 () {62 vars in 1187 bytes} [Thu May 12 06:53:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 06:53:06.604517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1202da5d-a34e-40d3-a152-ab644f7dc258 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:06.606549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1202da5d-a34e-40d3-a152-ab644f7dc258 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:06.685467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1202da5d-a34e-40d3-a152-ab644f7dc258 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:06.695509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1202da5d-a34e-40d3-a152-ab644f7dc258 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:06.696100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1202da5d-a34e-40d3-a152-ab644f7dc258 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:06.697215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1202da5d-a34e-40d3-a152-ab644f7dc258 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1280 microversion: 2.20 time: 0.098074 May 12 06:53:06.698111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 90/177] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:06 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1280 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:53:07.077693 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f08e09f4-a21c-439f-b301-4107342be74f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:07.079569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f08e09f4-a21c-439f-b301-4107342be74f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:07.087955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f08e09f4-a21c-439f-b301-4107342be74f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:07.088651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f08e09f4-a21c-439f-b301-4107342be74f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:07.089534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f08e09f4-a21c-439f-b301-4107342be74f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:07.089979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f08e09f4-a21c-439f-b301-4107342be74f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:07.225395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f08e09f4-a21c-439f-b301-4107342be74f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:07.233751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f08e09f4-a21c-439f-b301-4107342be74f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.163299 May 12 06:53:07.234315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 88/178] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:07 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:07.715765 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-97c54dbe-8ad6-4d51-a398-3bb619672d7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:07.717151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-97c54dbe-8ad6-4d51-a398-3bb619672d7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:07.787444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97c54dbe-8ad6-4d51-a398-3bb619672d7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:07.799060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97c54dbe-8ad6-4d51-a398-3bb619672d7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:07.800951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97c54dbe-8ad6-4d51-a398-3bb619672d7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:07.802169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-97c54dbe-8ad6-4d51-a398-3bb619672d7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1280 microversion: 2.20 time: 0.090430 May 12 06:53:07.802716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 91/179] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:07 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:53:08.250542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-609832c8-9be9-45ae-b7f4-b53a819aebec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:08.251160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-609832c8-9be9-45ae-b7f4-b53a819aebec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:08.260075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-609832c8-9be9-45ae-b7f4-b53a819aebec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:08.260529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-609832c8-9be9-45ae-b7f4-b53a819aebec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:08.261297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-609832c8-9be9-45ae-b7f4-b53a819aebec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:08.264829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-609832c8-9be9-45ae-b7f4-b53a819aebec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:08.410173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-609832c8-9be9-45ae-b7f4-b53a819aebec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:08.418018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-609832c8-9be9-45ae-b7f4-b53a819aebec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.171197 May 12 06:53:08.419039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 89/180] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:08 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:08.823960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-896025ab-243f-4bd6-88b5-bbb2ef9dea77 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:08.824915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-896025ab-243f-4bd6-88b5-bbb2ef9dea77 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:08.833973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-896025ab-243f-4bd6-88b5-bbb2ef9dea77 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:08.834435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-896025ab-243f-4bd6-88b5-bbb2ef9dea77 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:08.835999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-896025ab-243f-4bd6-88b5-bbb2ef9dea77 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:08.836444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-896025ab-243f-4bd6-88b5-bbb2ef9dea77 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:08.932796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-896025ab-243f-4bd6-88b5-bbb2ef9dea77 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:08.941357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-896025ab-243f-4bd6-88b5-bbb2ef9dea77 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:08.942868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-896025ab-243f-4bd6-88b5-bbb2ef9dea77 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:08.943994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-896025ab-243f-4bd6-88b5-bbb2ef9dea77 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1276 microversion: 2.20 time: 0.126808 May 12 06:53:08.944631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 92/181] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:53:09.437238 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-40b94cf4-fd99-427d-a191-3615593bf1ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:09.437853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-40b94cf4-fd99-427d-a191-3615593bf1ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:09.448078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40b94cf4-fd99-427d-a191-3615593bf1ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:09.448665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40b94cf4-fd99-427d-a191-3615593bf1ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:09.449694 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40b94cf4-fd99-427d-a191-3615593bf1ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:09.450226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40b94cf4-fd99-427d-a191-3615593bf1ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:09.586431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-40b94cf4-fd99-427d-a191-3615593bf1ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:09.596506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-40b94cf4-fd99-427d-a191-3615593bf1ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1521 microversion: 2.1 time: 0.163861 May 12 06:53:09.597155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 90/182] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:09 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:09.962819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3dbc61d5-290f-4f19-8127-7d22cc6fc8e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:09.964188 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3dbc61d5-290f-4f19-8127-7d22cc6fc8e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:09.972187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dbc61d5-290f-4f19-8127-7d22cc6fc8e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:09.972698 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dbc61d5-290f-4f19-8127-7d22cc6fc8e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:09.973668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dbc61d5-290f-4f19-8127-7d22cc6fc8e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:09.974123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dbc61d5-290f-4f19-8127-7d22cc6fc8e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:10.043235 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3dbc61d5-290f-4f19-8127-7d22cc6fc8e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:10.052125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3dbc61d5-290f-4f19-8127-7d22cc6fc8e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:10.053627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3dbc61d5-290f-4f19-8127-7d22cc6fc8e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:10.055728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3dbc61d5-290f-4f19-8127-7d22cc6fc8e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1332 microversion: 2.20 time: 0.097301 May 12 06:53:10.056292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 93/183] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:53:10.615547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-558d5ce0-2408-4bb0-abb0-f1d1c6e2d8bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:10.616212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-558d5ce0-2408-4bb0-abb0-f1d1c6e2d8bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:10.622649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-558d5ce0-2408-4bb0-abb0-f1d1c6e2d8bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:10.623089 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-558d5ce0-2408-4bb0-abb0-f1d1c6e2d8bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:10.624742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-558d5ce0-2408-4bb0-abb0-f1d1c6e2d8bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:10.625217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-558d5ce0-2408-4bb0-abb0-f1d1c6e2d8bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:10.855147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-558d5ce0-2408-4bb0-abb0-f1d1c6e2d8bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:10.863191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-558d5ce0-2408-4bb0-abb0-f1d1c6e2d8bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1501 microversion: 2.1 time: 0.251832 May 12 06:53:10.863782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 91/184] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:10 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1501 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:10.878976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cb6183d4-f3e1-46c9-8bac-2ef02c7e1521 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:10.879593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cb6183d4-f3e1-46c9-8bac-2ef02c7e1521 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:10.885571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb6183d4-f3e1-46c9-8bac-2ef02c7e1521 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:10.886026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb6183d4-f3e1-46c9-8bac-2ef02c7e1521 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:10.889939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb6183d4-f3e1-46c9-8bac-2ef02c7e1521 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:10.889939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb6183d4-f3e1-46c9-8bac-2ef02c7e1521 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:11.073536 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c7914efc-1bb2-4a3e-8b7e-0576d6d12b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:11.076586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c7914efc-1bb2-4a3e-8b7e-0576d6d12b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:11.092427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7914efc-1bb2-4a3e-8b7e-0576d6d12b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:11.092880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7914efc-1bb2-4a3e-8b7e-0576d6d12b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:11.093846 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7914efc-1bb2-4a3e-8b7e-0576d6d12b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:11.094285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7914efc-1bb2-4a3e-8b7e-0576d6d12b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:11.103432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cb6183d4-f3e1-46c9-8bac-2ef02c7e1521 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:11.110691 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cb6183d4-f3e1-46c9-8bac-2ef02c7e1521 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1516 microversion: 2.1 time: 0.235614 May 12 06:53:11.116224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 94/185] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:10 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:11.156632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c7914efc-1bb2-4a3e-8b7e-0576d6d12b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:11.165657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c7914efc-1bb2-4a3e-8b7e-0576d6d12b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:11.167162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c7914efc-1bb2-4a3e-8b7e-0576d6d12b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:11.168292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c7914efc-1bb2-4a3e-8b7e-0576d6d12b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1338 microversion: 2.20 time: 0.098668 May 12 06:53:11.168866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 92/186] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1338 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:53:12.187196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b01ce0b2-3cec-4b07-b3a7-b955e0d02826 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:12.188641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b01ce0b2-3cec-4b07-b3a7-b955e0d02826 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:12.199188 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b01ce0b2-3cec-4b07-b3a7-b955e0d02826 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:12.199965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b01ce0b2-3cec-4b07-b3a7-b955e0d02826 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:12.200825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b01ce0b2-3cec-4b07-b3a7-b955e0d02826 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:12.201296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b01ce0b2-3cec-4b07-b3a7-b955e0d02826 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:12.429361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b01ce0b2-3cec-4b07-b3a7-b955e0d02826 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:12.429361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b01ce0b2-3cec-4b07-b3a7-b955e0d02826 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:12.430563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b01ce0b2-3cec-4b07-b3a7-b955e0d02826 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:12.430563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b01ce0b2-3cec-4b07-b3a7-b955e0d02826 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1406 microversion: 2.20 time: 0.208414 May 12 06:53:12.430563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 95/187] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:12 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:53:12.923289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b5e6f010-e9e8-4137-acf1-84fb35ea3341 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:12.924302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b5e6f010-e9e8-4137-acf1-84fb35ea3341 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:12.931521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5e6f010-e9e8-4137-acf1-84fb35ea3341 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:12.934044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5e6f010-e9e8-4137-acf1-84fb35ea3341 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:12.934044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5e6f010-e9e8-4137-acf1-84fb35ea3341 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:12.934488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5e6f010-e9e8-4137-acf1-84fb35ea3341 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:12.957712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-b5e6f010-e9e8-4137-acf1-84fb35ea3341 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'flavor' on Instance uuid a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:53:13.038199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-d7bb360e-d952-4c2f-b651-840af26cc670 req-2a426afe-49ac-45cb-8c45-18e1a94fcaaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30aa8f3-ada1-42f3-bb93-081f2552b4a3", "tag": "d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:13.052652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-d7bb360e-d952-4c2f-b651-840af26cc670 req-2a426afe-49ac-45cb-8c45-18e1a94fcaaf service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:13.055319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-d7bb360e-d952-4c2f-b651-840af26cc670 req-2a426afe-49ac-45cb-8c45-18e1a94fcaaf service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:13.072506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-d7bb360e-d952-4c2f-b651-840af26cc670 req-2a426afe-49ac-45cb-8c45-18e1a94fcaaf service nova] Creating event network-changed:d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36 for instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 on hv-cinder-76606 May 12 06:53:13.077884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-d7bb360e-d952-4c2f-b651-840af26cc670 req-2a426afe-49ac-45cb-8c45-18e1a94fcaaf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044811 May 12 06:53:13.080094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 96/188] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:13.336293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b5e6f010-e9e8-4137-acf1-84fb35ea3341 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15/action" status: 200 len: 32 microversion: 2.1 time: 0.416329 May 12 06:53:13.337617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 93/189] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 06:53:12 2022] POST /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15/action => generated 32 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 06:53:13.348323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-253f4d6f-9d4f-40ac-bebb-2f4e7673b6ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:13.349868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-253f4d6f-9d4f-40ac-bebb-2f4e7673b6ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:13.365995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-253f4d6f-9d4f-40ac-bebb-2f4e7673b6ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:13.367252 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-253f4d6f-9d4f-40ac-bebb-2f4e7673b6ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:13.368311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-253f4d6f-9d4f-40ac-bebb-2f4e7673b6ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:13.372551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-253f4d6f-9d4f-40ac-bebb-2f4e7673b6ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:13.440248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-98d8d999-270e-4b13-a1df-55042c030b64 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:13.441157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-98d8d999-270e-4b13-a1df-55042c030b64 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:13.455958 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98d8d999-270e-4b13-a1df-55042c030b64 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:13.456694 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98d8d999-270e-4b13-a1df-55042c030b64 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:13.457965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98d8d999-270e-4b13-a1df-55042c030b64 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:13.458640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98d8d999-270e-4b13-a1df-55042c030b64 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:13.629935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-253f4d6f-9d4f-40ac-bebb-2f4e7673b6ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:13.640604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-253f4d6f-9d4f-40ac-bebb-2f4e7673b6ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.297585 May 12 06:53:13.641852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 97/190] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:13 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:13.671051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-98d8d999-270e-4b13-a1df-55042c030b64 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:13.679321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-98d8d999-270e-4b13-a1df-55042c030b64 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:13.681453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-98d8d999-270e-4b13-a1df-55042c030b64 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:13.682790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-98d8d999-270e-4b13-a1df-55042c030b64 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1406 microversion: 2.20 time: 0.247135 May 12 06:53:13.683350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 94/191] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:53:14.661546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-91e519bd-b796-4b45-8f53-7753448ad7ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:14.662150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-91e519bd-b796-4b45-8f53-7753448ad7ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:14.668904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91e519bd-b796-4b45-8f53-7753448ad7ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:14.669352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91e519bd-b796-4b45-8f53-7753448ad7ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:14.670119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91e519bd-b796-4b45-8f53-7753448ad7ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:14.670562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91e519bd-b796-4b45-8f53-7753448ad7ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:14.701068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-842da0a1-013e-4a06-b1c2-5c8763c7e74f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:14.701678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-842da0a1-013e-4a06-b1c2-5c8763c7e74f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:14.713976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-842da0a1-013e-4a06-b1c2-5c8763c7e74f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:14.714640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-842da0a1-013e-4a06-b1c2-5c8763c7e74f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:14.715607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-842da0a1-013e-4a06-b1c2-5c8763c7e74f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:14.716318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-842da0a1-013e-4a06-b1c2-5c8763c7e74f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:14.882382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-91e519bd-b796-4b45-8f53-7753448ad7ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:14.890058 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-91e519bd-b796-4b45-8f53-7753448ad7ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.232603 May 12 06:53:14.895816 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 98/192] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:14 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:14.925283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-842da0a1-013e-4a06-b1c2-5c8763c7e74f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:14.933490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-842da0a1-013e-4a06-b1c2-5c8763c7e74f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:14.935470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-842da0a1-013e-4a06-b1c2-5c8763c7e74f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:14.936854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-842da0a1-013e-4a06-b1c2-5c8763c7e74f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1406 microversion: 2.20 time: 0.239620 May 12 06:53:14.937927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 95/193] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:14 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:53:15.907091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d8511cd9-ebf1-4cfe-a49e-cfb55d253b83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:15.907727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d8511cd9-ebf1-4cfe-a49e-cfb55d253b83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:15.919200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d8511cd9-ebf1-4cfe-a49e-cfb55d253b83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:15.924927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d8511cd9-ebf1-4cfe-a49e-cfb55d253b83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:15.924927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d8511cd9-ebf1-4cfe-a49e-cfb55d253b83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:15.924927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d8511cd9-ebf1-4cfe-a49e-cfb55d253b83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:15.955557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4705dd42-1e18-453d-8b4a-ecfefd9e15c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:15.956510 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4705dd42-1e18-453d-8b4a-ecfefd9e15c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:15.965458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4705dd42-1e18-453d-8b4a-ecfefd9e15c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:15.966235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4705dd42-1e18-453d-8b4a-ecfefd9e15c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:15.967304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4705dd42-1e18-453d-8b4a-ecfefd9e15c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:15.967834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4705dd42-1e18-453d-8b4a-ecfefd9e15c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:16.499019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4705dd42-1e18-453d-8b4a-ecfefd9e15c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:16.507076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4705dd42-1e18-453d-8b4a-ecfefd9e15c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:16.509271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4705dd42-1e18-453d-8b4a-ecfefd9e15c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:16.511050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4705dd42-1e18-453d-8b4a-ecfefd9e15c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1406 microversion: 2.20 time: 0.559613 May 12 06:53:16.521174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 96/194] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1406 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:53:16.521473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d8511cd9-ebf1-4cfe-a49e-cfb55d253b83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:16.524319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d8511cd9-ebf1-4cfe-a49e-cfb55d253b83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.621041 May 12 06:53:16.525263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 99/195] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:15 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:17.530575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-001332c3-86df-43dd-98a3-77ab014c6313 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:17.531189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-001332c3-86df-43dd-98a3-77ab014c6313 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:17.542790 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-25bfea31-2445-4e76-9b2b-3193d7858c8c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:17.543406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-25bfea31-2445-4e76-9b2b-3193d7858c8c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:17.549622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25bfea31-2445-4e76-9b2b-3193d7858c8c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:17.550086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25bfea31-2445-4e76-9b2b-3193d7858c8c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:17.552887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-001332c3-86df-43dd-98a3-77ab014c6313 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:17.553336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-001332c3-86df-43dd-98a3-77ab014c6313 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:17.554177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-001332c3-86df-43dd-98a3-77ab014c6313 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:17.554606 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-001332c3-86df-43dd-98a3-77ab014c6313 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:17.557261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25bfea31-2445-4e76-9b2b-3193d7858c8c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:17.557801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25bfea31-2445-4e76-9b2b-3193d7858c8c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:17.827778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-001332c3-86df-43dd-98a3-77ab014c6313 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:17.829629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-25bfea31-2445-4e76-9b2b-3193d7858c8c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:17.840830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-25bfea31-2445-4e76-9b2b-3193d7858c8c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.302846 May 12 06:53:17.842363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 100/196] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:17 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:17.845284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-001332c3-86df-43dd-98a3-77ab014c6313 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:17.847289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-001332c3-86df-43dd-98a3-77ab014c6313 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:17.848447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-001332c3-86df-43dd-98a3-77ab014c6313 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1406 microversion: 2.20 time: 0.322001 May 12 06:53:17.849006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 97/197] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:17 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:53:18.088465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-22312647-b723-4439-a15a-2bd117765ec2 req-8b2c1764-606a-45fc-bb0d-dc084b41bb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30aa8f3-ada1-42f3-bb93-081f2552b4a3", "name": "network-vif-plugged", "status": "completed", "tag": "d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:18.100245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-22312647-b723-4439-a15a-2bd117765ec2 req-8b2c1764-606a-45fc-bb0d-dc084b41bb53 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:18.105995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-22312647-b723-4439-a15a-2bd117765ec2 req-8b2c1764-606a-45fc-bb0d-dc084b41bb53 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:18.113290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-22312647-b723-4439-a15a-2bd117765ec2 req-8b2c1764-606a-45fc-bb0d-dc084b41bb53 service nova] Creating event network-vif-plugged:d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36 for instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 on hv-cinder-76606 May 12 06:53:18.119932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-22312647-b723-4439-a15a-2bd117765ec2 req-8b2c1764-606a-45fc-bb0d-dc084b41bb53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035926 May 12 06:53:18.121326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 101/198] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:18.858108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-664efce7-1e30-4f77-b827-cb83665ab0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:18.858746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-664efce7-1e30-4f77-b827-cb83665ab0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:18.866518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-664efce7-1e30-4f77-b827-cb83665ab0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:18.867439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-817a172f-0495-4c4b-9a99-70f2d68da61c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:18.867963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-664efce7-1e30-4f77-b827-cb83665ab0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:18.868227 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-817a172f-0495-4c4b-9a99-70f2d68da61c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:18.868327 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-664efce7-1e30-4f77-b827-cb83665ab0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:18.868765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-664efce7-1e30-4f77-b827-cb83665ab0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:18.874625 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-817a172f-0495-4c4b-9a99-70f2d68da61c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:18.875304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-817a172f-0495-4c4b-9a99-70f2d68da61c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:18.876281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-817a172f-0495-4c4b-9a99-70f2d68da61c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:18.876716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-817a172f-0495-4c4b-9a99-70f2d68da61c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:19.183919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-664efce7-1e30-4f77-b827-cb83665ab0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:19.188000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-817a172f-0495-4c4b-9a99-70f2d68da61c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:19.193377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-664efce7-1e30-4f77-b827-cb83665ab0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.339180 May 12 06:53:19.194283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 98/199] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:18 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:19.197221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-817a172f-0495-4c4b-9a99-70f2d68da61c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:19.199153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-817a172f-0495-4c4b-9a99-70f2d68da61c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:19.199822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-23b791f0-6664-4513-bf74-272f71f319b8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:19.200339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-817a172f-0495-4c4b-9a99-70f2d68da61c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1406 microversion: 2.20 time: 0.337852 May 12 06:53:19.200671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-23b791f0-6664-4513-bf74-272f71f319b8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:19.207839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 102/200] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:53:19.207839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1469130762", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "networks": [{"uuid": "640a8875-a025-45be-8fa1-4e38d2dc64f6"}]}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:19.216194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23b791f0-6664-4513-bf74-272f71f319b8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:19.220663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23b791f0-6664-4513-bf74-272f71f319b8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:19.220663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23b791f0-6664-4513-bf74-272f71f319b8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:19.220663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23b791f0-6664-4513-bf74-272f71f319b8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:19.251320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-23b791f0-6664-4513-bf74-272f71f319b8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/ips" status: 200 len: 149 microversion: 2.1 time: 0.055101 May 12 06:53:19.260059 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 99/201] 10.222.0.25 () {58 vars in 1247 bytes} [Thu May 12 06:53:19 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/ips => generated 149 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:19.272620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.network.neutron [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] validate_networks() for [('640a8875-a025-45be-8fa1-4e38d2dc64f6', None, None, None, None, None)] {{(pid=124025) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:53:20.080033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Flavor limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:53:20.080545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Image limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:53:20.082828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Flavor pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:53:20.082828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Image pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:53:20.082828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:53:20.092004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:20.092449 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:20.093247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:20.093807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:20.117831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Getting quotas for project e59759391f6e4650b3bbd3059dd3f9f7. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:53:20.127024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Getting quotas for user d16de05b788c42b5979a20ff3b26340c and project e59759391f6e4650b3bbd3059dd3f9f7. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:53:20.139311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Going to run 1 instances... {{(pid=124025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:53:20.141973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:53:20.210126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-890472c8-168d-47e4-a922-8d83a4d7529a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:20.210760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-890472c8-168d-47e4-a922-8d83a4d7529a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:20.230097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-890472c8-168d-47e4-a922-8d83a4d7529a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:20.230614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-890472c8-168d-47e4-a922-8d83a4d7529a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:20.231436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-890472c8-168d-47e4-a922-8d83a4d7529a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:20.231898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-890472c8-168d-47e4-a922-8d83a4d7529a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:20.362813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ab68d9d5-3179-4d65-8dec-99197b1480a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160515 May 12 06:53:20.364494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 103/202] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:53:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 06:53:20.369863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e2b5d9a3-b3a7-45f0-bb83-2cc09f5d9fc6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:20.370893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e2b5d9a3-b3a7-45f0-bb83-2cc09f5d9fc6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:20.378016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2b5d9a3-b3a7-45f0-bb83-2cc09f5d9fc6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:20.378777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2b5d9a3-b3a7-45f0-bb83-2cc09f5d9fc6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:20.379881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2b5d9a3-b3a7-45f0-bb83-2cc09f5d9fc6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:20.381297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2b5d9a3-b3a7-45f0-bb83-2cc09f5d9fc6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:20.396069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-890472c8-168d-47e4-a922-8d83a4d7529a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:20.405531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-890472c8-168d-47e4-a922-8d83a4d7529a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.199179 May 12 06:53:20.406635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 100/203] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:20 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:20.412448 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bd8ac0c5-0795-47e5-a2a8-1ab9570b10bf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:20.413117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bd8ac0c5-0795-47e5-a2a8-1ab9570b10bf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:20.532871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bd8ac0c5-0795-47e5-a2a8-1ab9570b10bf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:20.540382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bd8ac0c5-0795-47e5-a2a8-1ab9570b10bf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1214 microversion: 2.1 time: 0.132371 May 12 06:53:20.540962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 101/204] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:20 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:20.677724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e2b5d9a3-b3a7-45f0-bb83-2cc09f5d9fc6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:20.706394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e2b5d9a3-b3a7-45f0-bb83-2cc09f5d9fc6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:20.715819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e2b5d9a3-b3a7-45f0-bb83-2cc09f5d9fc6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:20.720047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e2b5d9a3-b3a7-45f0-bb83-2cc09f5d9fc6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1598 microversion: 2.20 time: 0.354331 May 12 06:53:20.722370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 104/205] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:53:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1598 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:53:20.745489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-361027d3-b092-436a-8bfc-5ba462fa7c11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:20.748936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-361027d3-b092-436a-8bfc-5ba462fa7c11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:20.755898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-361027d3-b092-436a-8bfc-5ba462fa7c11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:20.759156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-361027d3-b092-436a-8bfc-5ba462fa7c11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:20.760205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-361027d3-b092-436a-8bfc-5ba462fa7c11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:20.762450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-361027d3-b092-436a-8bfc-5ba462fa7c11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:20.864624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-361027d3-b092-436a-8bfc-5ba462fa7c11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.123574 May 12 06:53:20.866349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 102/206] 10.222.0.25 () {60 vars in 1315 bytes} [Thu May 12 06:53:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:53:21.089503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c2b8d0d4-ffc1-4b6e-a0e0-70077300292c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfc3da97-0d0b-4645-a5af-d6ac93d70b08"}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:21.094736 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c2b8d0d4-ffc1-4b6e-a0e0-70077300292c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:21.104432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2b8d0d4-ffc1-4b6e-a0e0-70077300292c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:21.105094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2b8d0d4-ffc1-4b6e-a0e0-70077300292c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:21.106270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2b8d0d4-ffc1-4b6e-a0e0-70077300292c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:21.106932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2b8d0d4-ffc1-4b6e-a0e0-70077300292c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:21.426619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-882f672c-0e88-472a-a05e-b8e9469a29b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:21.427387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-882f672c-0e88-472a-a05e-b8e9469a29b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:21.437495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-882f672c-0e88-472a-a05e-b8e9469a29b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:21.437495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-882f672c-0e88-472a-a05e-b8e9469a29b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:21.437495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-882f672c-0e88-472a-a05e-b8e9469a29b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:21.437935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-882f672c-0e88-472a-a05e-b8e9469a29b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:21.660214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-882f672c-0e88-472a-a05e-b8e9469a29b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:21.669324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-882f672c-0e88-472a-a05e-b8e9469a29b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.247823 May 12 06:53:21.672003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 103/207] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:21 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:21.677938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-71957176-a4ab-4ef4-bb79-cc9f11463c14 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:21.678955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-71957176-a4ab-4ef4-bb79-cc9f11463c14 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:21.738373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-71957176-a4ab-4ef4-bb79-cc9f11463c14 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:21.751258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-71957176-a4ab-4ef4-bb79-cc9f11463c14 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1214 microversion: 2.1 time: 0.077792 May 12 06:53:21.752290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 104/208] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:21 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:22.303357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-00e11153-dbff-49bd-abb3-94cd55c84031 req-cead358b-7c08-4cd2-8646-9296e975dd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30aa8f3-ada1-42f3-bb93-081f2552b4a3", "tag": "d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:22.310025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c2b8d0d4-ffc1-4b6e-a0e0-70077300292c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "POST /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.224338 May 12 06:53:22.311782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 105/209] 10.222.0.25 () {60 vars in 1322 bytes} [Thu May 12 06:53:21 2022] POST /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 194 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:22.327132 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-00e11153-dbff-49bd-abb3-94cd55c84031 req-cead358b-7c08-4cd2-8646-9296e975dd14 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:22.327595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-00e11153-dbff-49bd-abb3-94cd55c84031 req-cead358b-7c08-4cd2-8646-9296e975dd14 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:22.347296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-00e11153-dbff-49bd-abb3-94cd55c84031 req-cead358b-7c08-4cd2-8646-9296e975dd14 service nova] Creating event network-changed:d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36 for instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 on hv-cinder-76606 May 12 06:53:22.353887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-00e11153-dbff-49bd-abb3-94cd55c84031 req-cead358b-7c08-4cd2-8646-9296e975dd14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057390 May 12 06:53:22.355191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 105/210] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:53:22.697758 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-23eec27d-cfae-4182-bba8-7cd02ab03e56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:22.700742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-23eec27d-cfae-4182-bba8-7cd02ab03e56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:22.729206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23eec27d-cfae-4182-bba8-7cd02ab03e56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:22.729206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23eec27d-cfae-4182-bba8-7cd02ab03e56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:22.729206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23eec27d-cfae-4182-bba8-7cd02ab03e56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:22.729206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23eec27d-cfae-4182-bba8-7cd02ab03e56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:22.769757 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d7f0697b-eed0-4723-b6a8-3ab7884fbb62 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:22.770456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d7f0697b-eed0-4723-b6a8-3ab7884fbb62 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:22.782139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7f0697b-eed0-4723-b6a8-3ab7884fbb62 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:22.786131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7f0697b-eed0-4723-b6a8-3ab7884fbb62 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:22.787379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7f0697b-eed0-4723-b6a8-3ab7884fbb62 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:22.790120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7f0697b-eed0-4723-b6a8-3ab7884fbb62 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:22.972633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d7f0697b-eed0-4723-b6a8-3ab7884fbb62 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:22.985083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d7f0697b-eed0-4723-b6a8-3ab7884fbb62 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1210 microversion: 2.1 time: 0.220243 May 12 06:53:22.990086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 106/211] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:22 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1210 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:23.016305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-23eec27d-cfae-4182-bba8-7cd02ab03e56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:23.026621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-23eec27d-cfae-4182-bba8-7cd02ab03e56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.337680 May 12 06:53:23.027188 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 106/212] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:22 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:23.965394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7964207e-7a28-481f-b39d-da51543abfda tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:23.965966 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7964207e-7a28-481f-b39d-da51543abfda tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:23.979160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7964207e-7a28-481f-b39d-da51543abfda tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:23.979618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7964207e-7a28-481f-b39d-da51543abfda tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:23.980474 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7964207e-7a28-481f-b39d-da51543abfda tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:23.980918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7964207e-7a28-481f-b39d-da51543abfda tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:24.006338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6ddfb11a-1249-4d0c-b4e0-f074ab6cf22b tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:24.006955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6ddfb11a-1249-4d0c-b4e0-f074ab6cf22b tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:24.019482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ddfb11a-1249-4d0c-b4e0-f074ab6cf22b tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:24.024358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ddfb11a-1249-4d0c-b4e0-f074ab6cf22b tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:24.026351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ddfb11a-1249-4d0c-b4e0-f074ab6cf22b tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:24.026805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ddfb11a-1249-4d0c-b4e0-f074ab6cf22b tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:24.032681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7964207e-7a28-481f-b39d-da51543abfda tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/ips" status: 200 len: 146 microversion: 2.1 time: 0.076612 May 12 06:53:24.033825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 107/213] 10.222.0.25 () {58 vars in 1247 bytes} [Thu May 12 06:53:23 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/ips => generated 146 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:24.045866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0f8a3e0f-f72a-4c10-b834-817cc00f0e69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:24.047585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0f8a3e0f-f72a-4c10-b834-817cc00f0e69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:24.055013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0f8a3e0f-f72a-4c10-b834-817cc00f0e69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:24.055717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0f8a3e0f-f72a-4c10-b834-817cc00f0e69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:24.064955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0f8a3e0f-f72a-4c10-b834-817cc00f0e69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:24.064955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0f8a3e0f-f72a-4c10-b834-817cc00f0e69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:24.104142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6ddfb11a-1249-4d0c-b4e0-f074ab6cf22b tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:24.112367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6ddfb11a-1249-4d0c-b4e0-f074ab6cf22b tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1274 microversion: 2.1 time: 0.109720 May 12 06:53:24.113547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 107/214] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:24 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1274 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:24.334967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0f8a3e0f-f72a-4c10-b834-817cc00f0e69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:24.353769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0f8a3e0f-f72a-4c10-b834-817cc00f0e69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.313949 May 12 06:53:24.354357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 108/215] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:24 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:25.132639 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4a9fc319-a356-4852-8b9c-faef98ea8cf1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:25.138525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4a9fc319-a356-4852-8b9c-faef98ea8cf1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:25.147475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a9fc319-a356-4852-8b9c-faef98ea8cf1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:25.148887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a9fc319-a356-4852-8b9c-faef98ea8cf1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:25.150006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a9fc319-a356-4852-8b9c-faef98ea8cf1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:25.150488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a9fc319-a356-4852-8b9c-faef98ea8cf1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:25.339305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4a9fc319-a356-4852-8b9c-faef98ea8cf1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:25.347077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4a9fc319-a356-4852-8b9c-faef98ea8cf1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1314 microversion: 2.1 time: 0.220780 May 12 06:53:25.347639 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 108/216] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:25 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:25.371315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e1c95cec-5fe7-4138-b4eb-ddf7e0a312ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:25.371947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e1c95cec-5fe7-4138-b4eb-ddf7e0a312ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:25.379591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1c95cec-5fe7-4138-b4eb-ddf7e0a312ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:25.380087 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1c95cec-5fe7-4138-b4eb-ddf7e0a312ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:25.381248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1c95cec-5fe7-4138-b4eb-ddf7e0a312ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:25.381694 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1c95cec-5fe7-4138-b4eb-ddf7e0a312ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:25.566893 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e1c95cec-5fe7-4138-b4eb-ddf7e0a312ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:25.577965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e1c95cec-5fe7-4138-b4eb-ddf7e0a312ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.210604 May 12 06:53:25.578548 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 109/217] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:25 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:26.191934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-8133010e-fe0a-4454-93a9-7f5809464c49 req-f8411578-cf1d-4915-a0e2-3613c6f137be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21eb6c1-9437-4dc6-b794-839171935fc2", "tag": "e7c7162b-ad50-4803-ad01-a664c850a52d"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:26.200906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-8133010e-fe0a-4454-93a9-7f5809464c49 req-f8411578-cf1d-4915-a0e2-3613c6f137be service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:26.201603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-8133010e-fe0a-4454-93a9-7f5809464c49 req-f8411578-cf1d-4915-a0e2-3613c6f137be service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:26.215573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-8133010e-fe0a-4454-93a9-7f5809464c49 req-f8411578-cf1d-4915-a0e2-3613c6f137be service nova] Creating event network-changed:e7c7162b-ad50-4803-ad01-a664c850a52d for instance a21eb6c1-9437-4dc6-b794-839171935fc2 on hv-cinder-76606 May 12 06:53:26.221499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-8133010e-fe0a-4454-93a9-7f5809464c49 req-f8411578-cf1d-4915-a0e2-3613c6f137be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033041 May 12 06:53:26.230647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 109/218] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:26.363963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-799dd50d-08c1-4014-bdf7-9d293cbbc480 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:26.364692 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-799dd50d-08c1-4014-bdf7-9d293cbbc480 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:26.371207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-799dd50d-08c1-4014-bdf7-9d293cbbc480 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:26.371771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-799dd50d-08c1-4014-bdf7-9d293cbbc480 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:26.372646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-799dd50d-08c1-4014-bdf7-9d293cbbc480 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:26.373157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-799dd50d-08c1-4014-bdf7-9d293cbbc480 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:26.510790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-799dd50d-08c1-4014-bdf7-9d293cbbc480 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:26.519294 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-799dd50d-08c1-4014-bdf7-9d293cbbc480 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1314 microversion: 2.1 time: 0.159207 May 12 06:53:26.519904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 110/219] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:26 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:26.597003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8fd17e01-272d-4744-9536-c65da6da4951 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:26.597714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8fd17e01-272d-4744-9536-c65da6da4951 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:26.606942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fd17e01-272d-4744-9536-c65da6da4951 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:26.607314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fd17e01-272d-4744-9536-c65da6da4951 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:26.608147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fd17e01-272d-4744-9536-c65da6da4951 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:26.608588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fd17e01-272d-4744-9536-c65da6da4951 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:26.852168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8fd17e01-272d-4744-9536-c65da6da4951 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:26.860904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8fd17e01-272d-4744-9536-c65da6da4951 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.268625 May 12 06:53:26.861861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 110/220] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:26 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:27.536868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-81b4660f-455d-4a2b-89ce-6b858c031927 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:27.538288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-81b4660f-455d-4a2b-89ce-6b858c031927 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:27.546695 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81b4660f-455d-4a2b-89ce-6b858c031927 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:27.547401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81b4660f-455d-4a2b-89ce-6b858c031927 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:27.548582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81b4660f-455d-4a2b-89ce-6b858c031927 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:27.549604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81b4660f-455d-4a2b-89ce-6b858c031927 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:27.879098 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-27df3b61-1a9a-4891-b1c6-05c6a63bab6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:27.880768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-27df3b61-1a9a-4891-b1c6-05c6a63bab6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:27.898571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27df3b61-1a9a-4891-b1c6-05c6a63bab6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:27.909637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27df3b61-1a9a-4891-b1c6-05c6a63bab6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:27.911282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27df3b61-1a9a-4891-b1c6-05c6a63bab6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:27.911963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27df3b61-1a9a-4891-b1c6-05c6a63bab6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:28.107921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-81b4660f-455d-4a2b-89ce-6b858c031927 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:28.118465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-81b4660f-455d-4a2b-89ce-6b858c031927 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1314 microversion: 2.1 time: 0.582800 May 12 06:53:28.121363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 111/221] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:27 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:28.321025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-27df3b61-1a9a-4891-b1c6-05c6a63bab6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:28.331017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-27df3b61-1a9a-4891-b1c6-05c6a63bab6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.456239 May 12 06:53:28.341464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 111/222] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:27 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:29.137415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a5cbda2a-737a-4b69-94de-6655f4e995f3 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:29.138044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a5cbda2a-737a-4b69-94de-6655f4e995f3 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:29.149205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5cbda2a-737a-4b69-94de-6655f4e995f3 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:29.149664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5cbda2a-737a-4b69-94de-6655f4e995f3 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:29.150480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5cbda2a-737a-4b69-94de-6655f4e995f3 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:29.150996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5cbda2a-737a-4b69-94de-6655f4e995f3 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:29.350522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1fb193c0-b9e3-4198-953b-e5778aff49c8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:29.351273 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1fb193c0-b9e3-4198-953b-e5778aff49c8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:29.357404 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fb193c0-b9e3-4198-953b-e5778aff49c8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:29.358032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fb193c0-b9e3-4198-953b-e5778aff49c8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:29.358813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fb193c0-b9e3-4198-953b-e5778aff49c8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:29.359254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fb193c0-b9e3-4198-953b-e5778aff49c8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:29.399162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a5cbda2a-737a-4b69-94de-6655f4e995f3 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:29.406921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a5cbda2a-737a-4b69-94de-6655f4e995f3 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1314 microversion: 2.1 time: 0.273618 May 12 06:53:29.417145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 112/223] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:29 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:29.593509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1fb193c0-b9e3-4198-953b-e5778aff49c8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:29.604809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1fb193c0-b9e3-4198-953b-e5778aff49c8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.258599 May 12 06:53:29.606145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 112/224] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:29 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:30.425383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2f131d4d-fc08-4f34-807d-a96b1eacf8c4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:30.426139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2f131d4d-fc08-4f34-807d-a96b1eacf8c4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:30.441672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f131d4d-fc08-4f34-807d-a96b1eacf8c4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:30.443593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f131d4d-fc08-4f34-807d-a96b1eacf8c4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:30.444504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f131d4d-fc08-4f34-807d-a96b1eacf8c4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:30.444969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f131d4d-fc08-4f34-807d-a96b1eacf8c4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:30.623459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ed0649c4-2d25-44de-92e2-0eb37cb461ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:30.624106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ed0649c4-2d25-44de-92e2-0eb37cb461ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:30.630704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed0649c4-2d25-44de-92e2-0eb37cb461ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:30.631367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed0649c4-2d25-44de-92e2-0eb37cb461ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:30.632372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed0649c4-2d25-44de-92e2-0eb37cb461ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:30.632967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed0649c4-2d25-44de-92e2-0eb37cb461ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:30.745120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2f131d4d-fc08-4f34-807d-a96b1eacf8c4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:30.780316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2f131d4d-fc08-4f34-807d-a96b1eacf8c4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1314 microversion: 2.1 time: 0.359492 May 12 06:53:30.783723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 113/225] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:30 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:30.904205 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ed0649c4-2d25-44de-92e2-0eb37cb461ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:30.916038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ed0649c4-2d25-44de-92e2-0eb37cb461ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.297212 May 12 06:53:30.917179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 113/226] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:30 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:31.338502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e448e3a5-d491-4fc8-93e4-0e98402cdd56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "823a4f88-bcf6-4890-8292-6b03da40f027"}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:31.341277 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e448e3a5-d491-4fc8-93e4-0e98402cdd56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:31.350132 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e448e3a5-d491-4fc8-93e4-0e98402cdd56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:31.351356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e448e3a5-d491-4fc8-93e4-0e98402cdd56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:31.352445 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e448e3a5-d491-4fc8-93e4-0e98402cdd56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:31.354207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e448e3a5-d491-4fc8-93e4-0e98402cdd56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:31.800079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cfe7860a-2b57-42a1-8472-e91775491ba4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:31.800692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cfe7860a-2b57-42a1-8472-e91775491ba4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:31.807581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfe7860a-2b57-42a1-8472-e91775491ba4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:31.808068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfe7860a-2b57-42a1-8472-e91775491ba4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:31.808842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfe7860a-2b57-42a1-8472-e91775491ba4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:31.809285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfe7860a-2b57-42a1-8472-e91775491ba4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:32.061012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cfe7860a-2b57-42a1-8472-e91775491ba4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:32.075795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cfe7860a-2b57-42a1-8472-e91775491ba4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1314 microversion: 2.1 time: 0.279613 May 12 06:53:32.076535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 114/227] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:31 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:32.081292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ecb67e2f-1d24-4248-b931-a7a7e7424e6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:32.082036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ecb67e2f-1d24-4248-b931-a7a7e7424e6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:32.088284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ecb67e2f-1d24-4248-b931-a7a7e7424e6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:32.088731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ecb67e2f-1d24-4248-b931-a7a7e7424e6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:32.089705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ecb67e2f-1d24-4248-b931-a7a7e7424e6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:32.090150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ecb67e2f-1d24-4248-b931-a7a7e7424e6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:32.570533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ecb67e2f-1d24-4248-b931-a7a7e7424e6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:32.597973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ecb67e2f-1d24-4248-b931-a7a7e7424e6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.519853 May 12 06:53:32.609507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 115/228] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:32 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:33.083170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-da3ae55e-fc2a-44e6-b05c-7e8506759e3b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Action: 'create', calling method: .version_select at 0x7f89da50b0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1222361415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlF2+ouWH75vgA6ATLJVF6VhDSX3BtAwlL2Oc8jVcd2eTTfZCORtTHfTghdY+LQWggkFODUVZD8aVlDcvls5+c98KT2CAHYvkfgp/xX9eDhQa8AH0wbJAGdqTBsT10hLg=="}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:33.101638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-da3ae55e-fc2a-44e6-b05c-7e8506759e3b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Getting quotas for project 9623ac5b3c664e44bf4e0bacb398a8a3. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:53:33.111473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-da3ae55e-fc2a-44e6-b05c-7e8506759e3b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Getting quotas for user 4edf41df1d4940028966ad901d3f5847 and project 9623ac5b3c664e44bf4e0bacb398a8a3. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:53:33.310832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-da3ae55e-fc2a-44e6-b05c-7e8506759e3b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.440143 May 12 06:53:33.310832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 116/229] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 12 06:53:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:53:33.311300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a50ea591-8ad2-4ad2-830b-8cd4b815fd1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:33.312140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a50ea591-8ad2-4ad2-830b-8cd4b815fd1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:33.326856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a50ea591-8ad2-4ad2-830b-8cd4b815fd1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:33.327334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a50ea591-8ad2-4ad2-830b-8cd4b815fd1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:33.328157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a50ea591-8ad2-4ad2-830b-8cd4b815fd1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:33.328596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a50ea591-8ad2-4ad2-830b-8cd4b815fd1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:33.374744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e448e3a5-d491-4fc8-93e4-0e98402cdd56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "POST /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.049292 May 12 06:53:33.388433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 114/230] 10.222.0.25 () {60 vars in 1322 bytes} [Thu May 12 06:53:31 2022] POST /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 194 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:33.488820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a50ea591-8ad2-4ad2-830b-8cd4b815fd1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:33.500212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a50ea591-8ad2-4ad2-830b-8cd4b815fd1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1314 microversion: 2.1 time: 0.192701 May 12 06:53:33.501137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 117/231] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:33 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:33.615462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fbc51bb1-329a-4dee-baf5-12d2ab9243b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:33.616772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fbc51bb1-329a-4dee-baf5-12d2ab9243b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:33.622937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fbc51bb1-329a-4dee-baf5-12d2ab9243b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:33.623384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fbc51bb1-329a-4dee-baf5-12d2ab9243b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:33.624203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fbc51bb1-329a-4dee-baf5-12d2ab9243b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:33.624641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fbc51bb1-329a-4dee-baf5-12d2ab9243b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:33.805156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fbc51bb1-329a-4dee-baf5-12d2ab9243b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:33.812655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fbc51bb1-329a-4dee-baf5-12d2ab9243b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.201994 May 12 06:53:33.813236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 115/232] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:33 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:34.370845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aa3717d7-13e0-4b92-9c3a-c422a34c17ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Action: 'create', calling method: .version_select at 0x7f89da5219d0>, body: {"keypair": {"name": "tempest-keypair-1039778787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAgPtWC9CWnnNRx8ELPNXn0BEdskNfYufoQvpvspVqUYkYX8RWGpa7v+EuisCBQSuu2VA+KAW0BoZHl9VNOU1Mw+plfuITm+lnTTRqis1ynzhcaDZFuS8CSSXigDdMFpQ=="}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:34.387860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-aa3717d7-13e0-4b92-9c3a-c422a34c17ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:53:34.392640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-aa3717d7-13e0-4b92-9c3a-c422a34c17ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for user d77bf80654c24c8c8336ce395f789ccb and project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:53:34.518038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-16518931-d243-4fdf-8c0f-d98f9e3608f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:34.519206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-16518931-d243-4fdf-8c0f-d98f9e3608f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:34.525167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16518931-d243-4fdf-8c0f-d98f9e3608f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:34.525615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16518931-d243-4fdf-8c0f-d98f9e3608f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:34.526383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16518931-d243-4fdf-8c0f-d98f9e3608f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:34.526840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16518931-d243-4fdf-8c0f-d98f9e3608f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:34.648541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aa3717d7-13e0-4b92-9c3a-c422a34c17ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.281136 May 12 06:53:34.651251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 118/233] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 12 06:53:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:34.694573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-16518931-d243-4fdf-8c0f-d98f9e3608f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:34.706524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-16518931-d243-4fdf-8c0f-d98f9e3608f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1314 microversion: 2.1 time: 0.192619 May 12 06:53:34.717960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 116/234] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:34 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:34.830518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-10de9b45-1dc0-4045-bc99-7b0934af6c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:34.831226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-10de9b45-1dc0-4045-bc99-7b0934af6c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:34.838151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10de9b45-1dc0-4045-bc99-7b0934af6c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:34.838636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10de9b45-1dc0-4045-bc99-7b0934af6c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:34.839766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10de9b45-1dc0-4045-bc99-7b0934af6c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:34.853024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10de9b45-1dc0-4045-bc99-7b0934af6c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:35.004207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-10de9b45-1dc0-4045-bc99-7b0934af6c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:35.013662 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-10de9b45-1dc0-4045-bc99-7b0934af6c59 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.187111 May 12 06:53:35.014685 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 119/235] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:34 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:35.349798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-b1067da5-3a2e-4c31-8815-bd375206e2d5 req-e5d5af36-f662-41e5-8479-d67c440edd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21eb6c1-9437-4dc6-b794-839171935fc2", "name": "network-vif-plugged", "status": "completed", "tag": "e7c7162b-ad50-4803-ad01-a664c850a52d"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:35.361747 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-b1067da5-3a2e-4c31-8815-bd375206e2d5 req-e5d5af36-f662-41e5-8479-d67c440edd55 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:35.362485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-b1067da5-3a2e-4c31-8815-bd375206e2d5 req-e5d5af36-f662-41e5-8479-d67c440edd55 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:35.376150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-b1067da5-3a2e-4c31-8815-bd375206e2d5 req-e5d5af36-f662-41e5-8479-d67c440edd55 service nova] Creating event network-vif-plugged:e7c7162b-ad50-4803-ad01-a664c850a52d for instance a21eb6c1-9437-4dc6-b794-839171935fc2 on hv-cinder-76606 May 12 06:53:35.382946 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-b1067da5-3a2e-4c31-8815-bd375206e2d5 req-e5d5af36-f662-41e5-8479-d67c440edd55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036701 May 12 06:53:35.384398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 117/236] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:35.737672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d7f2260d-8e86-433e-8107-c7fbfeccbb35 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:35.738302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d7f2260d-8e86-433e-8107-c7fbfeccbb35 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:35.750770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7f2260d-8e86-433e-8107-c7fbfeccbb35 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:35.751319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7f2260d-8e86-433e-8107-c7fbfeccbb35 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:35.752300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7f2260d-8e86-433e-8107-c7fbfeccbb35 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:35.752882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7f2260d-8e86-433e-8107-c7fbfeccbb35 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:35.937803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d7f2260d-8e86-433e-8107-c7fbfeccbb35 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:35.945620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d7f2260d-8e86-433e-8107-c7fbfeccbb35 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1314 microversion: 2.1 time: 0.215305 May 12 06:53:35.946186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 120/237] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:35 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:36.031821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d216e4d8-62de-4e10-804a-b81c0a813775 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:36.032481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d216e4d8-62de-4e10-804a-b81c0a813775 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:36.041876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d216e4d8-62de-4e10-804a-b81c0a813775 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:36.042484 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d216e4d8-62de-4e10-804a-b81c0a813775 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:36.043652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d216e4d8-62de-4e10-804a-b81c0a813775 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:36.044241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d216e4d8-62de-4e10-804a-b81c0a813775 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:36.291966 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d216e4d8-62de-4e10-804a-b81c0a813775 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:36.299389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d216e4d8-62de-4e10-804a-b81c0a813775 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1502 microversion: 2.1 time: 0.272564 May 12 06:53:36.300009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 118/238] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:36 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1502 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:36.317397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-10c2c2f8-6e81-4e41-816b-df9d2c21e008 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "232a9232-d191-46b4-b091-48709a56721c"}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:36.318466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-10c2c2f8-6e81-4e41-816b-df9d2c21e008 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:36.325094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10c2c2f8-6e81-4e41-816b-df9d2c21e008 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:36.325479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10c2c2f8-6e81-4e41-816b-df9d2c21e008 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:36.326248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10c2c2f8-6e81-4e41-816b-df9d2c21e008 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:36.326689 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10c2c2f8-6e81-4e41-816b-df9d2c21e008 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:36.349219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-10c2c2f8-6e81-4e41-816b-df9d2c21e008 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Cannot 'attach_volume' instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 while it is in vm_state rescued May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-10c2c2f8-6e81-4e41-816b-df9d2c21e008 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: POST /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15/os-volume_attachments HTTP/1.1 May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 74 May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 06:53:36.351265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {"volumeAttachment": {"volumeId": "232a9232-d191-46b4-b091-48709a56721c"}} May 12 06:53:36.356289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Cannot 'attach_volume' instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 while it is in vm_state rescued May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'server_id': 'a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15', 'body': {'volumeAttachment': {'volumeId': '232a9232-d191-46b4-b091-48709a56721c'}}} May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:53:36.356990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 while it is in vm_state rescued May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:53:36.358187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:53:36.359964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:53:36.359964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:53:36.359964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 while it is in vm_state rescued May 12 06:53:36.359964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:53:36.359964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-10c2c2f8-6e81-4e41-816b-df9d2c21e008 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 409 to user: Cannot 'attach_volume' instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 while it is in vm_state rescued {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:53:36.359964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-10c2c2f8-6e81-4e41-816b-df9d2c21e008 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039583 May 12 06:53:36.359964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 121/239] 10.222.0.25 () {60 vars in 1322 bytes} [Thu May 12 06:53:36 2022] POST /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 06:53:36.366101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0e7169c6-e0fc-4699-bd51-46c1d12e60f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:36.367314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0e7169c6-e0fc-4699-bd51-46c1d12e60f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:36.373767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e7169c6-e0fc-4699-bd51-46c1d12e60f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:36.374681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e7169c6-e0fc-4699-bd51-46c1d12e60f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:36.375468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e7169c6-e0fc-4699-bd51-46c1d12e60f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:36.375950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e7169c6-e0fc-4699-bd51-46c1d12e60f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:36.771857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0e7169c6-e0fc-4699-bd51-46c1d12e60f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15/action" status: 202 len: 0 microversion: 2.1 time: 0.408858 May 12 06:53:36.776130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 119/240] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 06:53:36 2022] POST /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 06:53:36.782490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e1ade0f4-19cb-461d-91da-79545b422961 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:36.783387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e1ade0f4-19cb-461d-91da-79545b422961 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:36.795448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1ade0f4-19cb-461d-91da-79545b422961 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:36.800345 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1ade0f4-19cb-461d-91da-79545b422961 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:36.801389 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1ade0f4-19cb-461d-91da-79545b422961 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:36.801847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1ade0f4-19cb-461d-91da-79545b422961 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:36.965818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-025e44d3-857b-46be-92f8-e096a9b167fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:36.966682 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-025e44d3-857b-46be-92f8-e096a9b167fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:36.990676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-025e44d3-857b-46be-92f8-e096a9b167fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:36.991369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-025e44d3-857b-46be-92f8-e096a9b167fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:36.992299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-025e44d3-857b-46be-92f8-e096a9b167fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:36.992835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-025e44d3-857b-46be-92f8-e096a9b167fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:37.109139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e1ade0f4-19cb-461d-91da-79545b422961 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:37.130664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e1ade0f4-19cb-461d-91da-79545b422961 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1510 microversion: 2.1 time: 0.352763 May 12 06:53:37.132902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 122/241] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:36 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:37.222084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-025e44d3-857b-46be-92f8-e096a9b167fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:37.235322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-025e44d3-857b-46be-92f8-e096a9b167fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1314 microversion: 2.1 time: 0.273037 May 12 06:53:37.235322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 120/242] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:36 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:38.149658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6e797288-373a-443f-a8f0-38365c4ee5ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:38.150478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6e797288-373a-443f-a8f0-38365c4ee5ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:38.157500 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e797288-373a-443f-a8f0-38365c4ee5ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:38.158304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e797288-373a-443f-a8f0-38365c4ee5ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:38.159239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e797288-373a-443f-a8f0-38365c4ee5ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:38.159931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e797288-373a-443f-a8f0-38365c4ee5ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:38.253367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dfd64dc5-a5ee-4301-a3ab-57cd2d202623 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:38.260149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dfd64dc5-a5ee-4301-a3ab-57cd2d202623 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:38.268042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dfd64dc5-a5ee-4301-a3ab-57cd2d202623 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:38.268769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dfd64dc5-a5ee-4301-a3ab-57cd2d202623 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:38.269696 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dfd64dc5-a5ee-4301-a3ab-57cd2d202623 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:38.270193 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dfd64dc5-a5ee-4301-a3ab-57cd2d202623 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:38.389237 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6e797288-373a-443f-a8f0-38365c4ee5ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:38.403417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6e797288-373a-443f-a8f0-38365c4ee5ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1510 microversion: 2.1 time: 0.257712 May 12 06:53:38.405316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 123/243] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:38 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:38.415628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1967989191", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "940de373-828a-40b3-8a07-fc0aff461153"}], "security_groups": [{"name": "tempest-securitygroup--21563164"}], "key_name": "tempest-keypair-1039778787", "user_data": "}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:38.479520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dfd64dc5-a5ee-4301-a3ab-57cd2d202623 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:38.487545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dfd64dc5-a5ee-4301-a3ab-57cd2d202623 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1498 microversion: 2.1 time: 0.238831 May 12 06:53:38.503142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 121/244] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:38 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1498 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:38.550518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.network.neutron [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] validate_networks() for [('940de373-828a-40b3-8a07-fc0aff461153', None, None, None, None, None)] {{(pid=124025) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:53:39.083127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Flavor limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:53:39.083631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Image limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:53:39.084143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Flavor pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:53:39.084549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Image pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:53:39.085555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:53:39.094056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:39.094653 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:39.095399 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:39.095862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:39.116214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:53:39.121205 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for user d77bf80654c24c8c8336ce395f789ccb and project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:53:39.134462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Going to run 1 instances... {{(pid=124025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:53:39.140032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:53:39.288616 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ff4b782a-57ca-4893-80d0-760b20541888 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.880872 May 12 06:53:39.289554 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 124/245] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:53:38 2022] POST /compute/v2.1/servers => generated 400 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 06:53:39.299613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1fe4b6d4-3306-45ad-b27f-352c80bef2dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:39.306831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1fe4b6d4-3306-45ad-b27f-352c80bef2dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:39.356382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1fe4b6d4-3306-45ad-b27f-352c80bef2dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:39.363006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1fe4b6d4-3306-45ad-b27f-352c80bef2dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1242 microversion: 2.1 time: 0.067278 May 12 06:53:39.363587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 122/246] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:39 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:39.422060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d34ff639-945e-4afb-a3f7-d31cd767af4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:39.422681 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d34ff639-945e-4afb-a3f7-d31cd767af4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:39.430008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d34ff639-945e-4afb-a3f7-d31cd767af4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:39.430543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d34ff639-945e-4afb-a3f7-d31cd767af4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:39.431254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d34ff639-945e-4afb-a3f7-d31cd767af4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:39.431728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d34ff639-945e-4afb-a3f7-d31cd767af4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:39.572374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d34ff639-945e-4afb-a3f7-d31cd767af4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:39.580124 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d34ff639-945e-4afb-a3f7-d31cd767af4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1510 microversion: 2.1 time: 0.161877 May 12 06:53:39.580927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 125/247] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:39 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:39.616747 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-070c5024-6a5e-4605-ac74-0f49ef0c71cf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:39.622641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-070c5024-6a5e-4605-ac74-0f49ef0c71cf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:39.622957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-070c5024-6a5e-4605-ac74-0f49ef0c71cf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:39.623409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-070c5024-6a5e-4605-ac74-0f49ef0c71cf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:39.624213 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-070c5024-6a5e-4605-ac74-0f49ef0c71cf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:39.624655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-070c5024-6a5e-4605-ac74-0f49ef0c71cf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:39.653997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-070c5024-6a5e-4605-ac74-0f49ef0c71cf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Going to try to terminate instance {{(pid=124024) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 06:53:40.045435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-070c5024-6a5e-4605-ac74-0f49ef0c71cf tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 204 len: 0 microversion: 2.1 time: 0.432647 May 12 06:53:40.045844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 123/248] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 06:53:39 2022] DELETE /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 06:53:40.054886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bbef182f-4486-419d-8d5b-6deee07848a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:40.055509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bbef182f-4486-419d-8d5b-6deee07848a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:40.061801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bbef182f-4486-419d-8d5b-6deee07848a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:40.062257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bbef182f-4486-419d-8d5b-6deee07848a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:40.063108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bbef182f-4486-419d-8d5b-6deee07848a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:40.063624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bbef182f-4486-419d-8d5b-6deee07848a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:40.208412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bbef182f-4486-419d-8d5b-6deee07848a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:40.216624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bbef182f-4486-419d-8d5b-6deee07848a2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1504 microversion: 2.1 time: 0.166562 May 12 06:53:40.217195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 126/249] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:40 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:40.381710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a8118355-ecf6-46bf-a6a5-8f82f8a44250 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:40.382422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a8118355-ecf6-46bf-a6a5-8f82f8a44250 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:40.389031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a8118355-ecf6-46bf-a6a5-8f82f8a44250 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:40.389480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a8118355-ecf6-46bf-a6a5-8f82f8a44250 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:40.390253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a8118355-ecf6-46bf-a6a5-8f82f8a44250 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:40.390689 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a8118355-ecf6-46bf-a6a5-8f82f8a44250 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:40.457777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a8118355-ecf6-46bf-a6a5-8f82f8a44250 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:40.465112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a8118355-ecf6-46bf-a6a5-8f82f8a44250 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1246 microversion: 2.1 time: 0.087868 May 12 06:53:40.465678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 124/250] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:40 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:40.598515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a2bf9f96-1b4d-4e07-bd8d-61128c3dfb51 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:40.599145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a2bf9f96-1b4d-4e07-bd8d-61128c3dfb51 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:40.605092 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2bf9f96-1b4d-4e07-bd8d-61128c3dfb51 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:40.605537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2bf9f96-1b4d-4e07-bd8d-61128c3dfb51 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:40.606309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2bf9f96-1b4d-4e07-bd8d-61128c3dfb51 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:40.606741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2bf9f96-1b4d-4e07-bd8d-61128c3dfb51 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:40.739671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a2bf9f96-1b4d-4e07-bd8d-61128c3dfb51 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:40.747051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a2bf9f96-1b4d-4e07-bd8d-61128c3dfb51 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1510 microversion: 2.1 time: 0.152568 May 12 06:53:40.747615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 127/251] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:40 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:41.234234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d7eaaf40-415a-4028-8962-0ea1f44723f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:41.234843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d7eaaf40-415a-4028-8962-0ea1f44723f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:41.240806 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7eaaf40-415a-4028-8962-0ea1f44723f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:41.241247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7eaaf40-415a-4028-8962-0ea1f44723f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:41.242008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7eaaf40-415a-4028-8962-0ea1f44723f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:41.242506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7eaaf40-415a-4028-8962-0ea1f44723f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:41.375491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d7eaaf40-415a-4028-8962-0ea1f44723f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:41.385495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d7eaaf40-415a-4028-8962-0ea1f44723f0 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1504 microversion: 2.1 time: 0.154933 May 12 06:53:41.390938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 125/252] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:41 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:41.481386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-76a6c3a6-1751-4ec5-bf4c-4db5ee2da237 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:41.482017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-76a6c3a6-1751-4ec5-bf4c-4db5ee2da237 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:41.488556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76a6c3a6-1751-4ec5-bf4c-4db5ee2da237 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:41.489013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76a6c3a6-1751-4ec5-bf4c-4db5ee2da237 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:41.489808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76a6c3a6-1751-4ec5-bf4c-4db5ee2da237 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:41.490232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76a6c3a6-1751-4ec5-bf4c-4db5ee2da237 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:41.558535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-76a6c3a6-1751-4ec5-bf4c-4db5ee2da237 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:41.566095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-76a6c3a6-1751-4ec5-bf4c-4db5ee2da237 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1246 microversion: 2.1 time: 0.088499 May 12 06:53:41.566676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 128/253] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:41 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:41.764188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a32c6f0d-6238-4bf6-a05e-b048c62187a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:41.764882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a32c6f0d-6238-4bf6-a05e-b048c62187a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:41.771490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a32c6f0d-6238-4bf6-a05e-b048c62187a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:41.772050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a32c6f0d-6238-4bf6-a05e-b048c62187a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:41.772934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a32c6f0d-6238-4bf6-a05e-b048c62187a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:41.773506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a32c6f0d-6238-4bf6-a05e-b048c62187a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:41.912947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a32c6f0d-6238-4bf6-a05e-b048c62187a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:41.921343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a32c6f0d-6238-4bf6-a05e-b048c62187a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1510 microversion: 2.1 time: 0.160931 May 12 06:53:41.922040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 126/254] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:41 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:42.403894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f6455ba1-ebc2-4fa8-95ad-23e831a12464 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:42.404501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f6455ba1-ebc2-4fa8-95ad-23e831a12464 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:42.410387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6455ba1-ebc2-4fa8-95ad-23e831a12464 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:42.410826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6455ba1-ebc2-4fa8-95ad-23e831a12464 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:42.411592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6455ba1-ebc2-4fa8-95ad-23e831a12464 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:42.412061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6455ba1-ebc2-4fa8-95ad-23e831a12464 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:42.550416 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f6455ba1-ebc2-4fa8-95ad-23e831a12464 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:42.558292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f6455ba1-ebc2-4fa8-95ad-23e831a12464 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1504 microversion: 2.1 time: 0.158830 May 12 06:53:42.558859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 129/255] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:42 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:42.583533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-00c5d0a7-39d4-4023-af72-a683b3e53a37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:42.584081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-00c5d0a7-39d4-4023-af72-a683b3e53a37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:42.590954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00c5d0a7-39d4-4023-af72-a683b3e53a37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:42.591403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00c5d0a7-39d4-4023-af72-a683b3e53a37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:42.592531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00c5d0a7-39d4-4023-af72-a683b3e53a37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:42.603401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00c5d0a7-39d4-4023-af72-a683b3e53a37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:42.658919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-00c5d0a7-39d4-4023-af72-a683b3e53a37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:42.664466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-00c5d0a7-39d4-4023-af72-a683b3e53a37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1246 microversion: 2.1 time: 0.084850 May 12 06:53:42.665034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 127/256] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:42 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:42.938513 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-49aca2fe-3154-4a6a-a413-10e5c3b382de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:42.939150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-49aca2fe-3154-4a6a-a413-10e5c3b382de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:42.945792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49aca2fe-3154-4a6a-a413-10e5c3b382de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:42.946243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49aca2fe-3154-4a6a-a413-10e5c3b382de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:42.947031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49aca2fe-3154-4a6a-a413-10e5c3b382de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:42.947465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49aca2fe-3154-4a6a-a413-10e5c3b382de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:43.085442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-49aca2fe-3154-4a6a-a413-10e5c3b382de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:43.093245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-49aca2fe-3154-4a6a-a413-10e5c3b382de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1510 microversion: 2.1 time: 0.158582 May 12 06:53:43.093878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 130/257] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:42 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:43.575712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-54cdb1d6-60a2-448f-a9f4-1b9d45b6bae7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:43.576321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-54cdb1d6-60a2-448f-a9f4-1b9d45b6bae7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:43.582596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54cdb1d6-60a2-448f-a9f4-1b9d45b6bae7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:43.583042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54cdb1d6-60a2-448f-a9f4-1b9d45b6bae7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:43.583846 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54cdb1d6-60a2-448f-a9f4-1b9d45b6bae7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:43.584379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54cdb1d6-60a2-448f-a9f4-1b9d45b6bae7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:43.681937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fb7a48c2-1d8b-4390-9357-6bbf9d71f428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:43.683234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fb7a48c2-1d8b-4390-9357-6bbf9d71f428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:43.690068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb7a48c2-1d8b-4390-9357-6bbf9d71f428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:43.690523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb7a48c2-1d8b-4390-9357-6bbf9d71f428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:43.691308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb7a48c2-1d8b-4390-9357-6bbf9d71f428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:43.691778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb7a48c2-1d8b-4390-9357-6bbf9d71f428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:43.714526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-54cdb1d6-60a2-448f-a9f4-1b9d45b6bae7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:43.723414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-54cdb1d6-60a2-448f-a9f4-1b9d45b6bae7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1504 microversion: 2.1 time: 0.151545 May 12 06:53:43.724232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 128/258] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:43 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:43.755400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fb7a48c2-1d8b-4390-9357-6bbf9d71f428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:43.763791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fb7a48c2-1d8b-4390-9357-6bbf9d71f428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1246 microversion: 2.1 time: 0.086235 May 12 06:53:43.764437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 131/259] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:43 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:44.110206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d4104623-70bb-41cc-881c-46624be73731 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:44.110818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d4104623-70bb-41cc-881c-46624be73731 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:44.116713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4104623-70bb-41cc-881c-46624be73731 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:44.117151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4104623-70bb-41cc-881c-46624be73731 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:44.117928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4104623-70bb-41cc-881c-46624be73731 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:44.118342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4104623-70bb-41cc-881c-46624be73731 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:44.248828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d4104623-70bb-41cc-881c-46624be73731 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:44.258466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d4104623-70bb-41cc-881c-46624be73731 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1510 microversion: 2.1 time: 0.149812 May 12 06:53:44.258466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 129/260] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:44 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:44.741643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-39417a61-d5f6-48bd-af7c-8d1d841e0621 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:44.742256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-39417a61-d5f6-48bd-af7c-8d1d841e0621 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:44.748499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-39417a61-d5f6-48bd-af7c-8d1d841e0621 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:44.748955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-39417a61-d5f6-48bd-af7c-8d1d841e0621 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:44.749731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-39417a61-d5f6-48bd-af7c-8d1d841e0621 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:44.750172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-39417a61-d5f6-48bd-af7c-8d1d841e0621 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:44.780447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-47b66601-1871-4959-9f6b-feaf913d7060 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:44.781712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-47b66601-1871-4959-9f6b-feaf913d7060 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:44.788611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47b66601-1871-4959-9f6b-feaf913d7060 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:44.789116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47b66601-1871-4959-9f6b-feaf913d7060 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:44.789923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47b66601-1871-4959-9f6b-feaf913d7060 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:44.790955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47b66601-1871-4959-9f6b-feaf913d7060 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:44.865236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-47b66601-1871-4959-9f6b-feaf913d7060 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:44.874137 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-47b66601-1871-4959-9f6b-feaf913d7060 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1246 microversion: 2.1 time: 0.097535 May 12 06:53:44.874735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 130/261] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:44 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:44.904791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-39417a61-d5f6-48bd-af7c-8d1d841e0621 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:44.912248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-39417a61-d5f6-48bd-af7c-8d1d841e0621 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1504 microversion: 2.1 time: 0.175064 May 12 06:53:44.913375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 132/262] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:44 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:45.274001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2b39ee66-5917-4b1d-bf1a-903e51632483 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:45.274606 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2b39ee66-5917-4b1d-bf1a-903e51632483 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:45.280399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b39ee66-5917-4b1d-bf1a-903e51632483 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:45.280834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b39ee66-5917-4b1d-bf1a-903e51632483 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:45.281589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b39ee66-5917-4b1d-bf1a-903e51632483 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:45.282018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b39ee66-5917-4b1d-bf1a-903e51632483 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:45.414338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2b39ee66-5917-4b1d-bf1a-903e51632483 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:45.421955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2b39ee66-5917-4b1d-bf1a-903e51632483 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1510 microversion: 2.1 time: 0.151827 May 12 06:53:45.422529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 131/263] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:45 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:45.892929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2fe71b3d-05c1-4378-94ec-15aeacc7328a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:45.893573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2fe71b3d-05c1-4378-94ec-15aeacc7328a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:45.899884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fe71b3d-05c1-4378-94ec-15aeacc7328a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:45.901959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fe71b3d-05c1-4378-94ec-15aeacc7328a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:45.901959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fe71b3d-05c1-4378-94ec-15aeacc7328a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:45.901959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fe71b3d-05c1-4378-94ec-15aeacc7328a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:45.930763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-83236411-e8d6-4df0-b57d-7ba52076e1c7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:45.931375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-83236411-e8d6-4df0-b57d-7ba52076e1c7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:45.938117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83236411-e8d6-4df0-b57d-7ba52076e1c7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:45.938568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83236411-e8d6-4df0-b57d-7ba52076e1c7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:45.939340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83236411-e8d6-4df0-b57d-7ba52076e1c7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:45.939820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83236411-e8d6-4df0-b57d-7ba52076e1c7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:45.966492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2fe71b3d-05c1-4378-94ec-15aeacc7328a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:45.974156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2fe71b3d-05c1-4378-94ec-15aeacc7328a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1246 microversion: 2.1 time: 0.085084 May 12 06:53:45.975144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 133/264] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:45 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:46.078360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-83236411-e8d6-4df0-b57d-7ba52076e1c7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:46.086257 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-83236411-e8d6-4df0-b57d-7ba52076e1c7 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1504 microversion: 2.1 time: 0.159972 May 12 06:53:46.086821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 132/265] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:45 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:46.438759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fa2fee2c-dd14-43c8-a3e3-33db88d039e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:46.439378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fa2fee2c-dd14-43c8-a3e3-33db88d039e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:46.445959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa2fee2c-dd14-43c8-a3e3-33db88d039e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:46.446405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa2fee2c-dd14-43c8-a3e3-33db88d039e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:46.447177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa2fee2c-dd14-43c8-a3e3-33db88d039e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:46.447645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa2fee2c-dd14-43c8-a3e3-33db88d039e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:46.580086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fa2fee2c-dd14-43c8-a3e3-33db88d039e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:46.587945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fa2fee2c-dd14-43c8-a3e3-33db88d039e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1516 microversion: 2.1 time: 0.153233 May 12 06:53:46.588512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 134/266] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:46 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:46.993334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9e0387fc-a5a8-46ea-adef-1962e4e40c4f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:46.993995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9e0387fc-a5a8-46ea-adef-1962e4e40c4f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:47.000736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e0387fc-a5a8-46ea-adef-1962e4e40c4f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:47.001183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e0387fc-a5a8-46ea-adef-1962e4e40c4f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:47.002137 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e0387fc-a5a8-46ea-adef-1962e4e40c4f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:47.002547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e0387fc-a5a8-46ea-adef-1962e4e40c4f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:47.069049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9e0387fc-a5a8-46ea-adef-1962e4e40c4f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:47.076964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9e0387fc-a5a8-46ea-adef-1962e4e40c4f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1246 microversion: 2.1 time: 0.088176 May 12 06:53:47.077531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 133/267] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:46 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:47.102849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6be222c6-9087-4ace-991c-6a3a12cec3c1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:47.103459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6be222c6-9087-4ace-991c-6a3a12cec3c1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:47.110128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6be222c6-9087-4ace-991c-6a3a12cec3c1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:47.110568 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6be222c6-9087-4ace-991c-6a3a12cec3c1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:47.111334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6be222c6-9087-4ace-991c-6a3a12cec3c1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:47.112432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6be222c6-9087-4ace-991c-6a3a12cec3c1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:47.250402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6be222c6-9087-4ace-991c-6a3a12cec3c1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:47.258724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6be222c6-9087-4ace-991c-6a3a12cec3c1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1504 microversion: 2.1 time: 0.159794 May 12 06:53:47.259772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 135/268] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:47 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:48.094347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-730ed261-6ea0-428d-8ec9-188a0323411b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:48.094897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-730ed261-6ea0-428d-8ec9-188a0323411b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:48.103520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-730ed261-6ea0-428d-8ec9-188a0323411b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:48.103995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-730ed261-6ea0-428d-8ec9-188a0323411b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:48.104773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-730ed261-6ea0-428d-8ec9-188a0323411b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:48.105214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-730ed261-6ea0-428d-8ec9-188a0323411b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:48.166478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-730ed261-6ea0-428d-8ec9-188a0323411b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:48.173759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-730ed261-6ea0-428d-8ec9-188a0323411b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1238 microversion: 2.1 time: 0.083939 May 12 06:53:48.174320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 134/269] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:48 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:48.245615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-90572b70-6580-4b8d-b740-b6d63de4c566 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'create', calling method: .version_select at 0x7f89db01ea60>, body: {"keypair": {"name": "tempest-keypair-2071890825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYWKS/BSqX8pI1ncBuDi95aLzM6ljzkpGmsSpITl15i8o7jYcnEpdj7sMbHQETYkgAxtX5hf4G9A90yHB4fq2A8SeQ4XAt1Lo34TsPbAoCFKUWRU6JJtLrKqzRGWpdV9Q=="}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:48.260522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-90572b70-6580-4b8d-b740-b6d63de4c566 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Getting quotas for project b772df3ea0d9417188aab057dce4d320. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:53:48.264351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-90572b70-6580-4b8d-b740-b6d63de4c566 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Getting quotas for user 13ef78da38e941b3a09f1de838581d54 and project b772df3ea0d9417188aab057dce4d320. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:53:48.275002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-691b8e80-b3a3-4393-9853-9c4a5c19fb6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:48.275626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-691b8e80-b3a3-4393-9853-9c4a5c19fb6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:48.281663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-691b8e80-b3a3-4393-9853-9c4a5c19fb6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:48.286555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-691b8e80-b3a3-4393-9853-9c4a5c19fb6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:48.286555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-691b8e80-b3a3-4393-9853-9c4a5c19fb6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:48.286555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-691b8e80-b3a3-4393-9853-9c4a5c19fb6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:48.414451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-691b8e80-b3a3-4393-9853-9c4a5c19fb6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:48.424228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-90572b70-6580-4b8d-b740-b6d63de4c566 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171034 May 12 06:53:48.424228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 136/270] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 12 06:53:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:48.426838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-691b8e80-b3a3-4393-9853-9c4a5c19fb6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1504 microversion: 2.1 time: 0.155559 May 12 06:53:48.427429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 135/271] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:48 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:49.191621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d7eb2984-2974-40af-a8a5-6c743e0c00b6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:49.192746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d7eb2984-2974-40af-a8a5-6c743e0c00b6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:49.199667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7eb2984-2974-40af-a8a5-6c743e0c00b6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:49.202375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7eb2984-2974-40af-a8a5-6c743e0c00b6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:49.202375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7eb2984-2974-40af-a8a5-6c743e0c00b6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:49.202375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7eb2984-2974-40af-a8a5-6c743e0c00b6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:49.249611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-7205df35-9e1c-4a8f-8ff6-c9f657ecfd30 req-f7b4a99d-045b-4d8a-b081-9b59f8e5c9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21eb6c1-9437-4dc6-b794-839171935fc2", "name": "network-vif-deleted", "tag": "e7c7162b-ad50-4803-ad01-a664c850a52d"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:49.258260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-7205df35-9e1c-4a8f-8ff6-c9f657ecfd30 req-f7b4a99d-045b-4d8a-b081-9b59f8e5c9ea service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:49.259582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-7205df35-9e1c-4a8f-8ff6-c9f657ecfd30 req-f7b4a99d-045b-4d8a-b081-9b59f8e5c9ea service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:49.270591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-7205df35-9e1c-4a8f-8ff6-c9f657ecfd30 req-f7b4a99d-045b-4d8a-b081-9b59f8e5c9ea service nova] Creating event network-vif-deleted:e7c7162b-ad50-4803-ad01-a664c850a52d for instance a21eb6c1-9437-4dc6-b794-839171935fc2 on hv-cinder-76606 May 12 06:53:49.276426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-7205df35-9e1c-4a8f-8ff6-c9f657ecfd30 req-f7b4a99d-045b-4d8a-b081-9b59f8e5c9ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030839 May 12 06:53:49.277065 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 136/272] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:49.293654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d7eb2984-2974-40af-a8a5-6c743e0c00b6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:49.301300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d7eb2984-2974-40af-a8a5-6c743e0c00b6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1294 microversion: 2.1 time: 0.114052 May 12 06:53:49.301864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 137/273] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:49 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1294 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:49.445520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8ec63cd3-08e4-494f-a49c-5f8ced065d26 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:49.446226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8ec63cd3-08e4-494f-a49c-5f8ced065d26 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:49.462989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ec63cd3-08e4-494f-a49c-5f8ced065d26 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:49.462989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ec63cd3-08e4-494f-a49c-5f8ced065d26 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:49.462989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ec63cd3-08e4-494f-a49c-5f8ced065d26 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:49.462989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ec63cd3-08e4-494f-a49c-5f8ced065d26 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:49.556089 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8ec63cd3-08e4-494f-a49c-5f8ced065d26 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:49.564301 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8ec63cd3-08e4-494f-a49c-5f8ced065d26 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1462 microversion: 2.1 time: 0.124077 May 12 06:53:49.574800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 137/274] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:49 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1462 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:50.318137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-82555711-5283-4e0a-810c-647b4ed22be2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:50.318757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-82555711-5283-4e0a-810c-647b4ed22be2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:50.326073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-82555711-5283-4e0a-810c-647b4ed22be2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:50.326532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-82555711-5283-4e0a-810c-647b4ed22be2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:50.327328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-82555711-5283-4e0a-810c-647b4ed22be2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:50.327810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-82555711-5283-4e0a-810c-647b4ed22be2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:50.405898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-82555711-5283-4e0a-810c-647b4ed22be2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:50.414126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-82555711-5283-4e0a-810c-647b4ed22be2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1302 microversion: 2.1 time: 0.099956 May 12 06:53:50.415036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 138/275] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:50 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1302 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:50.480576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7bd09f8d-56e9-4f6b-b26a-9d6a17899015 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:50.486980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bd09f8d-56e9-4f6b-b26a-9d6a17899015 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:50.487433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bd09f8d-56e9-4f6b-b26a-9d6a17899015 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:50.547716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7bd09f8d-56e9-4f6b-b26a-9d6a17899015 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Going to try to stop instance {{(pid=124024) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 06:53:50.581445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-61905857-6d14-4e7a-a79e-29c9ad2ca43c tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:50.592054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-61905857-6d14-4e7a-a79e-29c9ad2ca43c tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:50.592054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61905857-6d14-4e7a-a79e-29c9ad2ca43c tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:50.592054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61905857-6d14-4e7a-a79e-29c9ad2ca43c tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:50.592054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61905857-6d14-4e7a-a79e-29c9ad2ca43c tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:50.592726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61905857-6d14-4e7a-a79e-29c9ad2ca43c tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:50.623526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61905857-6d14-4e7a-a79e-29c9ad2ca43c tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:50.624009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61905857-6d14-4e7a-a79e-29c9ad2ca43c tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:50.624455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-61905857-6d14-4e7a-a79e-29c9ad2ca43c tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lazy-loading 'fault' on Instance uuid a21eb6c1-9437-4dc6-b794-839171935fc2 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:53:50.686748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-61905857-6d14-4e7a-a79e-29c9ad2ca43c tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:50.694001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-61905857-6d14-4e7a-a79e-29c9ad2ca43c tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1304 microversion: 2.1 time: 0.116302 May 12 06:53:50.701032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 139/276] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:50 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:50.792947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7bd09f8d-56e9-4f6b-b26a-9d6a17899015 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "POST /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/action" status: 202 len: 0 microversion: 2.1 time: 0.308428 May 12 06:53:50.792947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 138/277] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 06:53:50 2022] POST /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 06:53:50.799648 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-03e3d1ce-6812-44cf-8168-aabdff8ea57a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:50.800246 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-03e3d1ce-6812-44cf-8168-aabdff8ea57a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:50.806746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-03e3d1ce-6812-44cf-8168-aabdff8ea57a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:50.807198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-03e3d1ce-6812-44cf-8168-aabdff8ea57a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:50.807993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-03e3d1ce-6812-44cf-8168-aabdff8ea57a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:50.808438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-03e3d1ce-6812-44cf-8168-aabdff8ea57a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:51.234455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-03e3d1ce-6812-44cf-8168-aabdff8ea57a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:51.242957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-03e3d1ce-6812-44cf-8168-aabdff8ea57a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.447221 May 12 06:53:51.243562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 140/278] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:50 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:51.432434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4f6fa251-8f6c-4abe-8a7c-ded770c1111e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:51.433153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4f6fa251-8f6c-4abe-8a7c-ded770c1111e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:51.439406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f6fa251-8f6c-4abe-8a7c-ded770c1111e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:51.448650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f6fa251-8f6c-4abe-8a7c-ded770c1111e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:51.448650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f6fa251-8f6c-4abe-8a7c-ded770c1111e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:51.448650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f6fa251-8f6c-4abe-8a7c-ded770c1111e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:51.449097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1611075788", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4489a095-1a64-45d5-bdcd-998cb94b654c"}], "security_groups": [{"name": "tempest-securitygroup--623828523"}], "key_name": "tempest-keypair-2071890825", "user_data": "}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:51.506029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4f6fa251-8f6c-4abe-8a7c-ded770c1111e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:51.513653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4f6fa251-8f6c-4abe-8a7c-ded770c1111e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1302 microversion: 2.1 time: 0.085402 May 12 06:53:51.514321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 139/279] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:51 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:51.545362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.network.neutron [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] validate_networks() for [('4489a095-1a64-45d5-bdcd-998cb94b654c', None, None, None, None, None)] {{(pid=124025) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:53:51.712804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cbae3a85-1931-4864-92bf-c6ecb8a904e4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:51.713526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cbae3a85-1931-4864-92bf-c6ecb8a904e4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:51.719415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cbae3a85-1931-4864-92bf-c6ecb8a904e4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:51.719903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cbae3a85-1931-4864-92bf-c6ecb8a904e4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:51.720685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cbae3a85-1931-4864-92bf-c6ecb8a904e4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:51.721257 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cbae3a85-1931-4864-92bf-c6ecb8a904e4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:51.752495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cbae3a85-1931-4864-92bf-c6ecb8a904e4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:51.752760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cbae3a85-1931-4864-92bf-c6ecb8a904e4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:51.753181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-cbae3a85-1931-4864-92bf-c6ecb8a904e4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lazy-loading 'fault' on Instance uuid a21eb6c1-9437-4dc6-b794-839171935fc2 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:53:51.822832 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cbae3a85-1931-4864-92bf-c6ecb8a904e4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:51.830310 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cbae3a85-1931-4864-92bf-c6ecb8a904e4 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1304 microversion: 2.1 time: 0.122169 May 12 06:53:51.831116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 140/280] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:51 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:51.933567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Flavor limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:53:51.933995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Image limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:53:51.934598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Flavor pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:53:51.935016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Image pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:53:51.935462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:53:51.944486 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:51.944973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:51.945793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:51.946236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:51.962838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Getting quotas for project b772df3ea0d9417188aab057dce4d320. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:53:51.966606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Getting quotas for user 13ef78da38e941b3a09f1de838581d54 and project b772df3ea0d9417188aab057dce4d320. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:53:51.977394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Going to run 1 instances... {{(pid=124025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:53:51.979505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:53:52.120848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c0bc7df1-0106-482a-b864-9cc8c4a75257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.682113 May 12 06:53:52.121413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 141/281] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:53:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 06:53:52.131302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-21d1e8ff-d8cf-4360-82c3-e229fc80aa21 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:52.132589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-21d1e8ff-d8cf-4360-82c3-e229fc80aa21 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:52.185900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-21d1e8ff-d8cf-4360-82c3-e229fc80aa21 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:52.193557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-21d1e8ff-d8cf-4360-82c3-e229fc80aa21 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1246 microversion: 2.1 time: 0.066036 May 12 06:53:52.203575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 141/282] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:52.260234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2ec731d8-8239-495c-8dc3-c71a63c419ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:52.260877 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2ec731d8-8239-495c-8dc3-c71a63c419ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:52.267249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ec731d8-8239-495c-8dc3-c71a63c419ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:52.267719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ec731d8-8239-495c-8dc3-c71a63c419ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:52.268519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ec731d8-8239-495c-8dc3-c71a63c419ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:52.268958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ec731d8-8239-495c-8dc3-c71a63c419ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:52.395091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2ec731d8-8239-495c-8dc3-c71a63c419ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:52.403294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2ec731d8-8239-495c-8dc3-c71a63c419ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.147636 May 12 06:53:52.403911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 142/283] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:52 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:52.533398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d27bd0f4-7e29-41b9-92e2-015b8fbd0bf7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:52.535202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d27bd0f4-7e29-41b9-92e2-015b8fbd0bf7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:52.551214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d27bd0f4-7e29-41b9-92e2-015b8fbd0bf7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:52.551824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d27bd0f4-7e29-41b9-92e2-015b8fbd0bf7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:52.552719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d27bd0f4-7e29-41b9-92e2-015b8fbd0bf7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:52.553234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d27bd0f4-7e29-41b9-92e2-015b8fbd0bf7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:52.619478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d27bd0f4-7e29-41b9-92e2-015b8fbd0bf7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:52.628066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d27bd0f4-7e29-41b9-92e2-015b8fbd0bf7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1302 microversion: 2.1 time: 0.100569 May 12 06:53:52.633760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 142/284] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:52 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:52.848636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7e9d5d73-0c0a-4061-b48d-d75b609c2de2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:52.849330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7e9d5d73-0c0a-4061-b48d-d75b609c2de2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:52.859813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7e9d5d73-0c0a-4061-b48d-d75b609c2de2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:52.859813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7e9d5d73-0c0a-4061-b48d-d75b609c2de2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:52.859813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7e9d5d73-0c0a-4061-b48d-d75b609c2de2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:52.859813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7e9d5d73-0c0a-4061-b48d-d75b609c2de2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:52.908458 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7e9d5d73-0c0a-4061-b48d-d75b609c2de2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:52.908837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7e9d5d73-0c0a-4061-b48d-d75b609c2de2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:52.909324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-7e9d5d73-0c0a-4061-b48d-d75b609c2de2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lazy-loading 'fault' on Instance uuid a21eb6c1-9437-4dc6-b794-839171935fc2 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:53:52.961212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7e9d5d73-0c0a-4061-b48d-d75b609c2de2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:52.971028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7e9d5d73-0c0a-4061-b48d-d75b609c2de2 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 200 len: 1304 microversion: 2.1 time: 0.124703 May 12 06:53:52.971028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 143/285] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:52 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:53.211887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a36c406b-c5c5-4c93-81dc-250b4878e0fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:53.213190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a36c406b-c5c5-4c93-81dc-250b4878e0fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:53.218723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a36c406b-c5c5-4c93-81dc-250b4878e0fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:53.219169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a36c406b-c5c5-4c93-81dc-250b4878e0fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:53.220103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a36c406b-c5c5-4c93-81dc-250b4878e0fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:53.220602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a36c406b-c5c5-4c93-81dc-250b4878e0fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:53.285326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a36c406b-c5c5-4c93-81dc-250b4878e0fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:53.294355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a36c406b-c5c5-4c93-81dc-250b4878e0fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1250 microversion: 2.1 time: 0.087301 May 12 06:53:53.294931 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 143/286] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:53.421857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7c8034ec-60ca-441a-b9d3-fa1dd2f73d92 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:53.422452 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7c8034ec-60ca-441a-b9d3-fa1dd2f73d92 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:53.431231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7c8034ec-60ca-441a-b9d3-fa1dd2f73d92 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:53.431675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7c8034ec-60ca-441a-b9d3-fa1dd2f73d92 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:53.432488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7c8034ec-60ca-441a-b9d3-fa1dd2f73d92 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:53.432925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7c8034ec-60ca-441a-b9d3-fa1dd2f73d92 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:53.595867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7c8034ec-60ca-441a-b9d3-fa1dd2f73d92 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:53.611258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7c8034ec-60ca-441a-b9d3-fa1dd2f73d92 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.188905 May 12 06:53:53.612423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 144/287] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:53 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:53.648205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7dd20750-a317-4882-b5c3-acd9242a71a1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:53.657920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7dd20750-a317-4882-b5c3-acd9242a71a1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:53.669208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dd20750-a317-4882-b5c3-acd9242a71a1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:53.669726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dd20750-a317-4882-b5c3-acd9242a71a1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:53.673580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dd20750-a317-4882-b5c3-acd9242a71a1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:53.674933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dd20750-a317-4882-b5c3-acd9242a71a1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:53.867402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7dd20750-a317-4882-b5c3-acd9242a71a1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:53.875150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7dd20750-a317-4882-b5c3-acd9242a71a1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1366 microversion: 2.1 time: 0.233313 May 12 06:53:53.880374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 144/288] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:53 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:53.986396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-14bc5737-4dd6-4eda-b486-35c304514444 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:53.987747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-14bc5737-4dd6-4eda-b486-35c304514444 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: a21eb6c1-9437-4dc6-b794-839171935fc2] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:53.995216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14bc5737-4dd6-4eda-b486-35c304514444 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:53.995338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14bc5737-4dd6-4eda-b486-35c304514444 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:53.996044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14bc5737-4dd6-4eda-b486-35c304514444 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:53.996478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14bc5737-4dd6-4eda-b486-35c304514444 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:54.012174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-14bc5737-4dd6-4eda-b486-35c304514444 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] HTTP exception thrown: Instance a21eb6c1-9437-4dc6-b794-839171935fc2 could not be found. May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-14bc5737-4dd6-4eda-b486-35c304514444 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Request method failure captured: May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 HTTP/1.1 May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK7dTafjPQGyJKeSwOPeOW2Ze_EUwPcB1kkiWsQygeAMeyMpYKOe9h7W7tuVm5PiJ02_AMH6xlEZo82OrE5o_cmYj41_Wi57Jb_YmtajwFry9Iv1eCcrixsMfP5F8hgYdxRKmQNcLk1tt3sTOcwXM3zPN_D5uMkwUytgzfBmImlgQBM May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: e59759391f6e4650b3bbd3059dd3f9f7 May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-VolumesActionsTest-872849924 May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 06:53:54.013939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e59759391f6e4650b3bbd3059dd3f9f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e59759391f6e4650b3bbd3059dd3f9f7", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e59759391f6e4650b3bbd3059dd3f9f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e59759391f6e4650b3bbd3059dd3f9f7"}]}] May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-VolumesActionsTest-872849924 May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: e59759391f6e4650b3bbd3059dd3f9f7 May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-VolumesActionsTest-872849924 May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-VolumesActionsTest-872849924-project May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: d16de05b788c42b5979a20ff3b26340c May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-VolumesActionsTest-872849924-project May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance a21eb6c1-9437-4dc6-b794-839171935fc2 could not be found. May 12 06:53:54.015171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': 'a21eb6c1-9437-4dc6-b794-839171935fc2'} May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21eb6c1-9437-4dc6-b794-839171935fc2 could not be found. May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:53:54.015957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21eb6c1-9437-4dc6-b794-839171935fc2 could not be found. May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21eb6c1-9437-4dc6-b794-839171935fc2 could not be found. May 12 06:53:54.033455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:53:54.035029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-14bc5737-4dd6-4eda-b486-35c304514444 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Returning 404 to user: Instance a21eb6c1-9437-4dc6-b794-839171935fc2 could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:53:54.035029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-14bc5737-4dd6-4eda-b486-35c304514444 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2" status: 404 len: 111 microversion: 2.1 time: 0.032758 May 12 06:53:54.035029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 145/289] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:53 2022] GET /compute/v2.1/servers/a21eb6c1-9437-4dc6-b794-839171935fc2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 06:53:54.143717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1777856945", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "networks": [{"uuid": "640a8875-a025-45be-8fa1-4e38d2dc64f6"}]}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:54.199101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.network.neutron [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] validate_networks() for [('640a8875-a025-45be-8fa1-4e38d2dc64f6', None, None, None, None, None)] {{(pid=124024) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:53:54.315666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4b4ee8e0-cd77-480e-b714-1ae6bf0ba8be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:54.317134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4b4ee8e0-cd77-480e-b714-1ae6bf0ba8be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:54.323982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b4ee8e0-cd77-480e-b714-1ae6bf0ba8be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:54.324902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b4ee8e0-cd77-480e-b714-1ae6bf0ba8be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:54.325870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b4ee8e0-cd77-480e-b714-1ae6bf0ba8be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:54.326546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b4ee8e0-cd77-480e-b714-1ae6bf0ba8be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:54.425831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4b4ee8e0-cd77-480e-b714-1ae6bf0ba8be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:54.435356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4b4ee8e0-cd77-480e-b714-1ae6bf0ba8be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1242 microversion: 2.1 time: 0.127342 May 12 06:53:54.436384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 146/290] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1242 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:54.630197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b141048a-4a6a-4e3b-bb39-4386ead1fee8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:54.631011 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b141048a-4a6a-4e3b-bb39-4386ead1fee8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:54.637808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b141048a-4a6a-4e3b-bb39-4386ead1fee8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:54.638475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b141048a-4a6a-4e3b-bb39-4386ead1fee8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:54.639441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b141048a-4a6a-4e3b-bb39-4386ead1fee8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:54.640221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b141048a-4a6a-4e3b-bb39-4386ead1fee8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:54.791224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Flavor limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:53:54.791852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Image limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:53:54.792710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Flavor pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:53:54.793234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Image pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:53:54.793725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:53:54.807232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:54.808383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:54.809537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:54.810314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:54.850256 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Getting quotas for project e59759391f6e4650b3bbd3059dd3f9f7. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:53:54.856025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Getting quotas for user d16de05b788c42b5979a20ff3b26340c and project e59759391f6e4650b3bbd3059dd3f9f7. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:53:54.875461 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Going to run 1 instances... {{(pid=124024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:53:54.878971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:53:54.895311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b141048a-4a6a-4e3b-bb39-4386ead1fee8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:54.906970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b141048a-4a6a-4e3b-bb39-4386ead1fee8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.280468 May 12 06:53:54.910757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 147/291] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:54 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:54.924658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-83d7f26c-8aaf-4983-a09a-2b5c31e64938 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:54.925459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-83d7f26c-8aaf-4983-a09a-2b5c31e64938 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:54.933631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83d7f26c-8aaf-4983-a09a-2b5c31e64938 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:54.934357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83d7f26c-8aaf-4983-a09a-2b5c31e64938 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:54.935377 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83d7f26c-8aaf-4983-a09a-2b5c31e64938 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:54.936129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83d7f26c-8aaf-4983-a09a-2b5c31e64938 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:55.080239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-83d7f26c-8aaf-4983-a09a-2b5c31e64938 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:55.087975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-83d7f26c-8aaf-4983-a09a-2b5c31e64938 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1366 microversion: 2.1 time: 0.175637 May 12 06:53:55.088556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 148/292] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:54 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:55.112066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-cc6a9658-5d44-48c5-8d7f-e1a83d48ce86 req-8977c418-adbf-4969-b5cc-675d34c5363d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a57c872-cacc-4345-b372-154b251e3661", "tag": "e115eee1-342f-406a-a608-d498c1303d80"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:55.121467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-cc6a9658-5d44-48c5-8d7f-e1a83d48ce86 req-8977c418-adbf-4969-b5cc-675d34c5363d service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:55.122000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-cc6a9658-5d44-48c5-8d7f-e1a83d48ce86 req-8977c418-adbf-4969-b5cc-675d34c5363d service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:55.139236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-cc6a9658-5d44-48c5-8d7f-e1a83d48ce86 req-8977c418-adbf-4969-b5cc-675d34c5363d service nova] Creating event network-changed:e115eee1-342f-406a-a608-d498c1303d80 for instance 4a57c872-cacc-4345-b372-154b251e3661 on hv-cinder-76606 May 12 06:53:55.142615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-cc6a9658-5d44-48c5-8d7f-e1a83d48ce86 req-8977c418-adbf-4969-b5cc-675d34c5363d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034523 May 12 06:53:55.143811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 149/293] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:55.189189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c58f12a1-d715-4f87-bf50-c9366acd33cd tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049883 May 12 06:53:55.190178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 145/294] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:53:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 06:53:55.201854 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7941a60c-91df-47e4-872e-3db407eebd6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:55.202860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7941a60c-91df-47e4-872e-3db407eebd6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:55.339994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7941a60c-91df-47e4-872e-3db407eebd6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:55.347887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7941a60c-91df-47e4-872e-3db407eebd6d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1214 microversion: 2.1 time: 0.150545 May 12 06:53:55.349645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 150/295] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:55 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:55.454494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-99219bc2-5b0a-46ba-9f30-0688bbc66528 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:55.455920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-99219bc2-5b0a-46ba-9f30-0688bbc66528 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:55.464600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99219bc2-5b0a-46ba-9f30-0688bbc66528 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:55.465330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99219bc2-5b0a-46ba-9f30-0688bbc66528 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:55.466442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99219bc2-5b0a-46ba-9f30-0688bbc66528 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:55.466744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99219bc2-5b0a-46ba-9f30-0688bbc66528 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:55.559192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-99219bc2-5b0a-46ba-9f30-0688bbc66528 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:55.571809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-99219bc2-5b0a-46ba-9f30-0688bbc66528 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1306 microversion: 2.1 time: 0.121520 May 12 06:53:55.572650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 146/296] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:55 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1306 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:55.929441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-812a13d5-56cd-494b-8431-b5628da67824 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:55.930503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-812a13d5-56cd-494b-8431-b5628da67824 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:55.941140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-812a13d5-56cd-494b-8431-b5628da67824 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:55.941813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-812a13d5-56cd-494b-8431-b5628da67824 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:55.942825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-812a13d5-56cd-494b-8431-b5628da67824 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:55.943475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-812a13d5-56cd-494b-8431-b5628da67824 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:56.090668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-812a13d5-56cd-494b-8431-b5628da67824 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:56.099641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-812a13d5-56cd-494b-8431-b5628da67824 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.174623 May 12 06:53:56.104975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-77952385-ae4a-4ed5-a4d1-9e681d2a5746 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:56.106629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-77952385-ae4a-4ed5-a4d1-9e681d2a5746 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:56.110022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 151/297] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:55 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:56.113785 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77952385-ae4a-4ed5-a4d1-9e681d2a5746 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:56.114235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77952385-ae4a-4ed5-a4d1-9e681d2a5746 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:56.115012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77952385-ae4a-4ed5-a4d1-9e681d2a5746 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:56.115669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77952385-ae4a-4ed5-a4d1-9e681d2a5746 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:56.276903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-77952385-ae4a-4ed5-a4d1-9e681d2a5746 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:56.285073 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-77952385-ae4a-4ed5-a4d1-9e681d2a5746 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1366 microversion: 2.1 time: 0.184738 May 12 06:53:56.285717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 147/298] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:56 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:56.365809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6cb213bf-ba99-40e0-91b8-a46ea9f52561 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:56.367025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6cb213bf-ba99-40e0-91b8-a46ea9f52561 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:56.373044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cb213bf-ba99-40e0-91b8-a46ea9f52561 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:56.373486 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cb213bf-ba99-40e0-91b8-a46ea9f52561 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:56.374610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cb213bf-ba99-40e0-91b8-a46ea9f52561 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:56.375051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cb213bf-ba99-40e0-91b8-a46ea9f52561 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:56.449224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6cb213bf-ba99-40e0-91b8-a46ea9f52561 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:56.453709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6cb213bf-ba99-40e0-91b8-a46ea9f52561 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1218 microversion: 2.1 time: 0.092122 May 12 06:53:56.454269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 152/299] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:56 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:56.589223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a9c6d722-a86d-44bb-82f2-bbdb1b0ef37f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:56.589864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a9c6d722-a86d-44bb-82f2-bbdb1b0ef37f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:56.596004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9c6d722-a86d-44bb-82f2-bbdb1b0ef37f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:56.596458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9c6d722-a86d-44bb-82f2-bbdb1b0ef37f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:56.597285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9c6d722-a86d-44bb-82f2-bbdb1b0ef37f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:56.597725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9c6d722-a86d-44bb-82f2-bbdb1b0ef37f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:56.661176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a9c6d722-a86d-44bb-82f2-bbdb1b0ef37f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:56.669409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a9c6d722-a86d-44bb-82f2-bbdb1b0ef37f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1304 microversion: 2.1 time: 0.084457 May 12 06:53:56.669991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 148/300] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:57.117523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f31dcd37-b7a2-486c-9dbe-0bbf3b9c6488 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:57.119174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f31dcd37-b7a2-486c-9dbe-0bbf3b9c6488 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:57.126256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f31dcd37-b7a2-486c-9dbe-0bbf3b9c6488 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:57.126951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f31dcd37-b7a2-486c-9dbe-0bbf3b9c6488 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:57.128161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f31dcd37-b7a2-486c-9dbe-0bbf3b9c6488 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:57.128675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f31dcd37-b7a2-486c-9dbe-0bbf3b9c6488 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:57.258475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f31dcd37-b7a2-486c-9dbe-0bbf3b9c6488 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:57.266384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f31dcd37-b7a2-486c-9dbe-0bbf3b9c6488 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.153317 May 12 06:53:57.266950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 153/301] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:57 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:57.302705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-30e8a2e1-6029-43e9-9a85-7a948f243a3a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:57.303905 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-30e8a2e1-6029-43e9-9a85-7a948f243a3a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:57.310454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30e8a2e1-6029-43e9-9a85-7a948f243a3a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:57.311028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30e8a2e1-6029-43e9-9a85-7a948f243a3a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:57.311963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30e8a2e1-6029-43e9-9a85-7a948f243a3a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:57.312407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30e8a2e1-6029-43e9-9a85-7a948f243a3a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:57.444920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-30e8a2e1-6029-43e9-9a85-7a948f243a3a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:57.452222 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-30e8a2e1-6029-43e9-9a85-7a948f243a3a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1366 microversion: 2.1 time: 0.153675 May 12 06:53:57.452785 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 149/302] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:57 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:57.470191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c121519e-35e4-401d-ab7c-a639f6708311 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:57.470749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c121519e-35e4-401d-ab7c-a639f6708311 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:57.476614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c121519e-35e4-401d-ab7c-a639f6708311 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:57.477065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c121519e-35e4-401d-ab7c-a639f6708311 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:57.477840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c121519e-35e4-401d-ab7c-a639f6708311 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:57.478283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c121519e-35e4-401d-ab7c-a639f6708311 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:57.540363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c121519e-35e4-401d-ab7c-a639f6708311 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:57.547958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c121519e-35e4-401d-ab7c-a639f6708311 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1210 microversion: 2.1 time: 0.081648 May 12 06:53:57.548531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 154/303] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:57 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:57.686317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-986f64bf-251b-431e-bd46-6bc11d1b993a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:57.686952 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-986f64bf-251b-431e-bd46-6bc11d1b993a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:57.692891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-986f64bf-251b-431e-bd46-6bc11d1b993a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:57.693321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-986f64bf-251b-431e-bd46-6bc11d1b993a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:57.694219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-986f64bf-251b-431e-bd46-6bc11d1b993a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:57.694516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-986f64bf-251b-431e-bd46-6bc11d1b993a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:57.836721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-986f64bf-251b-431e-bd46-6bc11d1b993a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:57.845260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-986f64bf-251b-431e-bd46-6bc11d1b993a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1371 microversion: 2.1 time: 0.162770 May 12 06:53:57.845949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 150/304] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:58.284456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8a2ad985-e55b-468c-a15f-27d7b779c3ed tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:58.285666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8a2ad985-e55b-468c-a15f-27d7b779c3ed tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:58.293297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a2ad985-e55b-468c-a15f-27d7b779c3ed tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:58.293988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a2ad985-e55b-468c-a15f-27d7b779c3ed tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:58.295131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a2ad985-e55b-468c-a15f-27d7b779c3ed tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:58.295774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a2ad985-e55b-468c-a15f-27d7b779c3ed tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:58.426242 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8a2ad985-e55b-468c-a15f-27d7b779c3ed tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:58.434659 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8a2ad985-e55b-468c-a15f-27d7b779c3ed tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.154370 May 12 06:53:58.435219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 155/305] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:58 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:58.473640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d4be26d7-3da5-44bc-bf51-ae7ad763ca98 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:58.477907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d4be26d7-3da5-44bc-bf51-ae7ad763ca98 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:58.488852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4be26d7-3da5-44bc-bf51-ae7ad763ca98 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:58.489595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4be26d7-3da5-44bc-bf51-ae7ad763ca98 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:58.490551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4be26d7-3da5-44bc-bf51-ae7ad763ca98 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:58.492116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4be26d7-3da5-44bc-bf51-ae7ad763ca98 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:58.565731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d057e817-e35b-4109-b25f-e2778f346783 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:58.566656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d057e817-e35b-4109-b25f-e2778f346783 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:58.576888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d057e817-e35b-4109-b25f-e2778f346783 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:58.580697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d057e817-e35b-4109-b25f-e2778f346783 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:58.581714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d057e817-e35b-4109-b25f-e2778f346783 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:58.582660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d057e817-e35b-4109-b25f-e2778f346783 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:58.676068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d057e817-e35b-4109-b25f-e2778f346783 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:58.688363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d057e817-e35b-4109-b25f-e2778f346783 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1266 microversion: 2.1 time: 0.126698 May 12 06:53:58.688918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 156/306] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:58 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:53:58.689712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d4be26d7-3da5-44bc-bf51-ae7ad763ca98 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:58.699382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d4be26d7-3da5-44bc-bf51-ae7ad763ca98 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1366 microversion: 2.1 time: 0.234645 May 12 06:53:58.704980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 151/307] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:58 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:58.862295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-80bc4594-45a6-48bb-80f0-dbb0672768b4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:58.862905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-80bc4594-45a6-48bb-80f0-dbb0672768b4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:58.869391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80bc4594-45a6-48bb-80f0-dbb0672768b4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:58.869846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80bc4594-45a6-48bb-80f0-dbb0672768b4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:58.870646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80bc4594-45a6-48bb-80f0-dbb0672768b4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:58.871086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80bc4594-45a6-48bb-80f0-dbb0672768b4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:58.952736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-23cfb047-005d-450c-b646-b5ef39a1f6b9 req-4b644f9c-981d-4080-89b1-1fb456b45bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106", "tag": "bb3b7568-76ad-422a-b728-00d4b4baa39a"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:53:58.971497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-23cfb047-005d-450c-b646-b5ef39a1f6b9 req-4b644f9c-981d-4080-89b1-1fb456b45bc6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:58.979114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-23cfb047-005d-450c-b646-b5ef39a1f6b9 req-4b644f9c-981d-4080-89b1-1fb456b45bc6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:59.000706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-23cfb047-005d-450c-b646-b5ef39a1f6b9 req-4b644f9c-981d-4080-89b1-1fb456b45bc6 service nova] Creating event network-changed:bb3b7568-76ad-422a-b728-00d4b4baa39a for instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 on hv-cinder-76606 May 12 06:53:59.010432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-23cfb047-005d-450c-b646-b5ef39a1f6b9 req-4b644f9c-981d-4080-89b1-1fb456b45bc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060978 May 12 06:53:59.011843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 152/308] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:53:59.058676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-80bc4594-45a6-48bb-80f0-dbb0672768b4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:59.066144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-80bc4594-45a6-48bb-80f0-dbb0672768b4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1371 microversion: 2.1 time: 0.207621 May 12 06:53:59.066740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 157/309] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:59.455276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c3a47ccb-fd76-48c9-af4a-ffc059188550 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:59.456622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c3a47ccb-fd76-48c9-af4a-ffc059188550 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:59.467534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3a47ccb-fd76-48c9-af4a-ffc059188550 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:59.468586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3a47ccb-fd76-48c9-af4a-ffc059188550 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:59.482197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3a47ccb-fd76-48c9-af4a-ffc059188550 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:59.484186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3a47ccb-fd76-48c9-af4a-ffc059188550 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:59.656513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c3a47ccb-fd76-48c9-af4a-ffc059188550 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:59.665789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c3a47ccb-fd76-48c9-af4a-ffc059188550 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.215318 May 12 06:53:59.675870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 153/310] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:59 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:59.704890 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a70ea001-47ee-49d1-beb2-86d4ded449b9 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:59.705507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a70ea001-47ee-49d1-beb2-86d4ded449b9 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:59.712006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70ea001-47ee-49d1-beb2-86d4ded449b9 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:59.712465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70ea001-47ee-49d1-beb2-86d4ded449b9 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:59.713253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70ea001-47ee-49d1-beb2-86d4ded449b9 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:59.713719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70ea001-47ee-49d1-beb2-86d4ded449b9 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:59.720164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d4b4477b-53c0-4a7d-a349-8afbda9dbd2c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:53:59.720779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d4b4477b-53c0-4a7d-a349-8afbda9dbd2c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:53:59.726993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4b4477b-53c0-4a7d-a349-8afbda9dbd2c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:59.727441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4b4477b-53c0-4a7d-a349-8afbda9dbd2c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:59.728255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4b4477b-53c0-4a7d-a349-8afbda9dbd2c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:53:59.728749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4b4477b-53c0-4a7d-a349-8afbda9dbd2c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:53:59.813538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a70ea001-47ee-49d1-beb2-86d4ded449b9 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:59.822141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a70ea001-47ee-49d1-beb2-86d4ded449b9 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1272 microversion: 2.1 time: 0.121084 May 12 06:53:59.823338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 158/311] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:59 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:53:59.916804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d4b4477b-53c0-4a7d-a349-8afbda9dbd2c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:53:59.925439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d4b4477b-53c0-4a7d-a349-8afbda9dbd2c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1366 microversion: 2.1 time: 0.209105 May 12 06:53:59.926420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 154/312] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:53:59 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:00.085159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-834bb4b4-864a-4a1b-80a7-75882343355f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:00.085853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-834bb4b4-864a-4a1b-80a7-75882343355f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:00.101672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-834bb4b4-864a-4a1b-80a7-75882343355f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:00.102120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-834bb4b4-864a-4a1b-80a7-75882343355f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:00.102907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-834bb4b4-864a-4a1b-80a7-75882343355f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:00.103350 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-834bb4b4-864a-4a1b-80a7-75882343355f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:00.245695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-834bb4b4-864a-4a1b-80a7-75882343355f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:00.253698 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-834bb4b4-864a-4a1b-80a7-75882343355f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1371 microversion: 2.1 time: 0.174255 May 12 06:54:00.254651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 159/313] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:00.683532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4a9a1f15-b870-410b-aa58-a5f15d03e5ff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:00.684396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4a9a1f15-b870-410b-aa58-a5f15d03e5ff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:00.697817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a9a1f15-b870-410b-aa58-a5f15d03e5ff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:00.698276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a9a1f15-b870-410b-aa58-a5f15d03e5ff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:00.699057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a9a1f15-b870-410b-aa58-a5f15d03e5ff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:00.699544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a9a1f15-b870-410b-aa58-a5f15d03e5ff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:00.839303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ed70fe42-031a-4661-8b94-0f5d444b6829 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:00.840069 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ed70fe42-031a-4661-8b94-0f5d444b6829 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:00.845934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4a9a1f15-b870-410b-aa58-a5f15d03e5ff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:00.846763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed70fe42-031a-4661-8b94-0f5d444b6829 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:00.847218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed70fe42-031a-4661-8b94-0f5d444b6829 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:00.848060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed70fe42-031a-4661-8b94-0f5d444b6829 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:00.848699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed70fe42-031a-4661-8b94-0f5d444b6829 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:00.856124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4a9a1f15-b870-410b-aa58-a5f15d03e5ff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.176378 May 12 06:54:00.856709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 155/314] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:00 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:00.942461 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-19c09381-bcac-44b1-b161-a82cd4309d37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:00.943110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-19c09381-bcac-44b1-b161-a82cd4309d37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:00.949606 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19c09381-bcac-44b1-b161-a82cd4309d37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:00.950077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19c09381-bcac-44b1-b161-a82cd4309d37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:00.950927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19c09381-bcac-44b1-b161-a82cd4309d37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:00.951627 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19c09381-bcac-44b1-b161-a82cd4309d37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:01.007372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ed70fe42-031a-4661-8b94-0f5d444b6829 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:01.015858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ed70fe42-031a-4661-8b94-0f5d444b6829 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1314 microversion: 2.1 time: 0.181233 May 12 06:54:01.016518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 160/315] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:00 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:01.094843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-19c09381-bcac-44b1-b161-a82cd4309d37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:01.101773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-e9b96ffa-6379-4258-a3fd-9f7551571b36 req-cc714115-edaa-4f2e-9db7-261afde2b98c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fbc5457-605d-4013-88c1-18f936b8d0ac", "tag": "48da0c84-0c6b-4010-924b-e4f8552570e3"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:01.103428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-19c09381-bcac-44b1-b161-a82cd4309d37 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1366 microversion: 2.1 time: 0.164964 May 12 06:54:01.104222 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 156/316] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:00 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:01.109800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-e9b96ffa-6379-4258-a3fd-9f7551571b36 req-cc714115-edaa-4f2e-9db7-261afde2b98c service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:01.110243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-e9b96ffa-6379-4258-a3fd-9f7551571b36 req-cc714115-edaa-4f2e-9db7-261afde2b98c service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:01.121066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-e9b96ffa-6379-4258-a3fd-9f7551571b36 req-cc714115-edaa-4f2e-9db7-261afde2b98c service nova] Creating event network-changed:48da0c84-0c6b-4010-924b-e4f8552570e3 for instance 0fbc5457-605d-4013-88c1-18f936b8d0ac on hv-cinder-76606 May 12 06:54:01.125707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-e9b96ffa-6379-4258-a3fd-9f7551571b36 req-cc714115-edaa-4f2e-9db7-261afde2b98c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028436 May 12 06:54:01.126288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 161/317] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:54:01.270654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9f92b30e-1e2f-416d-8d14-f68e361b3a26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:01.271407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9f92b30e-1e2f-416d-8d14-f68e361b3a26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:01.277959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f92b30e-1e2f-416d-8d14-f68e361b3a26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:01.278405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f92b30e-1e2f-416d-8d14-f68e361b3a26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:01.279173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f92b30e-1e2f-416d-8d14-f68e361b3a26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:01.279607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f92b30e-1e2f-416d-8d14-f68e361b3a26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:01.346605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-ab4b7edd-2ffd-4cc8-a1a3-efd7b4f1e625 req-e1901331-2332-436e-b798-91baa1f23e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a57c872-cacc-4345-b372-154b251e3661", "name": "network-vif-plugged", "status": "completed", "tag": "e115eee1-342f-406a-a608-d498c1303d80"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:01.360308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-ab4b7edd-2ffd-4cc8-a1a3-efd7b4f1e625 req-e1901331-2332-436e-b798-91baa1f23e06 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:01.360980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-ab4b7edd-2ffd-4cc8-a1a3-efd7b4f1e625 req-e1901331-2332-436e-b798-91baa1f23e06 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:01.372380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-ab4b7edd-2ffd-4cc8-a1a3-efd7b4f1e625 req-e1901331-2332-436e-b798-91baa1f23e06 service nova] Creating event network-vif-plugged:e115eee1-342f-406a-a608-d498c1303d80 for instance 4a57c872-cacc-4345-b372-154b251e3661 on hv-cinder-76606 May 12 06:54:01.380135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-ab4b7edd-2ffd-4cc8-a1a3-efd7b4f1e625 req-e1901331-2332-436e-b798-91baa1f23e06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035611 May 12 06:54:01.380937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 162/318] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:01.431923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9f92b30e-1e2f-416d-8d14-f68e361b3a26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:01.439566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9f92b30e-1e2f-416d-8d14-f68e361b3a26 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1371 microversion: 2.1 time: 0.172752 May 12 06:54:01.440164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 157/319] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:01.874154 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-95cce435-c1e0-4320-98a0-92d0a81d8f57 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:01.874891 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-95cce435-c1e0-4320-98a0-92d0a81d8f57 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:01.881837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95cce435-c1e0-4320-98a0-92d0a81d8f57 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:01.882375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95cce435-c1e0-4320-98a0-92d0a81d8f57 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:01.883232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95cce435-c1e0-4320-98a0-92d0a81d8f57 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:01.884014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95cce435-c1e0-4320-98a0-92d0a81d8f57 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:02.028221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-95cce435-c1e0-4320-98a0-92d0a81d8f57 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:02.032078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0f68443c-8b50-409e-93b9-fe993955495e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:02.032787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0f68443c-8b50-409e-93b9-fe993955495e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:02.036615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-95cce435-c1e0-4320-98a0-92d0a81d8f57 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.167237 May 12 06:54:02.037259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 163/320] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:01 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:02.041962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0f68443c-8b50-409e-93b9-fe993955495e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:02.042409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0f68443c-8b50-409e-93b9-fe993955495e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:02.043184 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0f68443c-8b50-409e-93b9-fe993955495e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:02.043820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0f68443c-8b50-409e-93b9-fe993955495e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:02.120665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8c496386-a5dc-4a36-a675-6f711d14ebc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:02.121288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8c496386-a5dc-4a36-a675-6f711d14ebc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:02.131324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c496386-a5dc-4a36-a675-6f711d14ebc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:02.131324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c496386-a5dc-4a36-a675-6f711d14ebc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:02.131324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c496386-a5dc-4a36-a675-6f711d14ebc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:02.131324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c496386-a5dc-4a36-a675-6f711d14ebc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:02.218547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0f68443c-8b50-409e-93b9-fe993955495e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:02.228849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0f68443c-8b50-409e-93b9-fe993955495e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1314 microversion: 2.1 time: 0.200638 May 12 06:54:02.233819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 158/321] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:02 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:02.294743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8c496386-a5dc-4a36-a675-6f711d14ebc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:02.302830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8c496386-a5dc-4a36-a675-6f711d14ebc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1366 microversion: 2.1 time: 0.185966 May 12 06:54:02.304081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 164/322] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:02 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:02.456439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-708dded2-4057-4ea5-8e3b-b5df3d2abbd2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:02.457090 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-708dded2-4057-4ea5-8e3b-b5df3d2abbd2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:02.463179 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-708dded2-4057-4ea5-8e3b-b5df3d2abbd2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:02.463672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-708dded2-4057-4ea5-8e3b-b5df3d2abbd2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:02.464468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-708dded2-4057-4ea5-8e3b-b5df3d2abbd2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:02.465047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-708dded2-4057-4ea5-8e3b-b5df3d2abbd2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:02.593872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-708dded2-4057-4ea5-8e3b-b5df3d2abbd2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:02.601922 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-708dded2-4057-4ea5-8e3b-b5df3d2abbd2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1371 microversion: 2.1 time: 0.149634 May 12 06:54:02.602654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 159/323] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:03.054071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d7b1fa34-58ca-47b2-afe4-9e8e122b5dee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:03.054950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d7b1fa34-58ca-47b2-afe4-9e8e122b5dee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:03.061200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7b1fa34-58ca-47b2-afe4-9e8e122b5dee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:03.061715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7b1fa34-58ca-47b2-afe4-9e8e122b5dee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:03.062557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7b1fa34-58ca-47b2-afe4-9e8e122b5dee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:03.063066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7b1fa34-58ca-47b2-afe4-9e8e122b5dee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:03.250187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b3b42f92-ce48-4772-b23f-ecdec56c6833 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:03.250807 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b3b42f92-ce48-4772-b23f-ecdec56c6833 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:03.260322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3b42f92-ce48-4772-b23f-ecdec56c6833 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:03.260818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3b42f92-ce48-4772-b23f-ecdec56c6833 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:03.261816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3b42f92-ce48-4772-b23f-ecdec56c6833 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:03.262054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3b42f92-ce48-4772-b23f-ecdec56c6833 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:03.309736 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d7b1fa34-58ca-47b2-afe4-9e8e122b5dee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:03.322645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d7b1fa34-58ca-47b2-afe4-9e8e122b5dee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.272343 May 12 06:54:03.323320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 165/324] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:03 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:03.328093 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-45b6a80a-bed9-4d47-b4d9-da4eaf048f86 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:03.329008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-45b6a80a-bed9-4d47-b4d9-da4eaf048f86 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:03.336556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45b6a80a-bed9-4d47-b4d9-da4eaf048f86 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:03.337254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45b6a80a-bed9-4d47-b4d9-da4eaf048f86 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:03.338231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45b6a80a-bed9-4d47-b4d9-da4eaf048f86 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:03.338664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45b6a80a-bed9-4d47-b4d9-da4eaf048f86 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:03.460719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b3b42f92-ce48-4772-b23f-ecdec56c6833 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:03.468736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b3b42f92-ce48-4772-b23f-ecdec56c6833 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1314 microversion: 2.1 time: 0.222275 May 12 06:54:03.469309 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 160/325] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:03 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:03.504656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-45b6a80a-bed9-4d47-b4d9-da4eaf048f86 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:03.512808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-45b6a80a-bed9-4d47-b4d9-da4eaf048f86 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1366 microversion: 2.1 time: 0.188266 May 12 06:54:03.513359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 166/326] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:03 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:03.520049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1709882332", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1222361415", "security_groups": [{"name": "tempest-secgroup-smoke-863588972"}], "networks": [{"uuid": "93167cb8-049c-4789-8553-c7e22b19ab5b"}], "block_device_mapping_v2": [{"uuid": "6ace090d-0882-41ea-9e78-f70a6c179718", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:03.619788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6e051d4e-677d-420b-aa94-1f7f8b2592dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:03.620455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6e051d4e-677d-420b-aa94-1f7f8b2592dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:03.627027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e051d4e-677d-420b-aa94-1f7f8b2592dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:03.633275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e051d4e-677d-420b-aa94-1f7f8b2592dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:03.634247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.network.neutron [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] validate_networks() for [('93167cb8-049c-4789-8553-c7e22b19ab5b', None, None, None, None, None)] {{(pid=124024) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:54:03.635062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e051d4e-677d-420b-aa94-1f7f8b2592dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:03.635591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e051d4e-677d-420b-aa94-1f7f8b2592dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:03.849915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6e051d4e-677d-420b-aa94-1f7f8b2592dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:03.858426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6e051d4e-677d-420b-aa94-1f7f8b2592dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1371 microversion: 2.1 time: 0.243762 May 12 06:54:03.859021 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 167/327] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:04.094409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Flavor limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:54:04.094834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Image limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:54:04.095306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Flavor pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:54:04.095741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Image pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:54:04.096159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:54:04.105789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:04.106234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:04.107032 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:04.107468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:04.123636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Getting quotas for project 9623ac5b3c664e44bf4e0bacb398a8a3. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:54:04.127582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Getting quotas for user 4edf41df1d4940028966ad901d3f5847 and project 9623ac5b3c664e44bf4e0bacb398a8a3. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:54:04.185176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Going to run 1 instances... {{(pid=124024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:54:04.187425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ace090d-0882-41ea-9e78-f70a6c179718',volume_size=None,volume_type=None)] {{(pid=124024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:54:04.340524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9a379356-e422-442c-bc97-a778d80fbeaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:04.345777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9a379356-e422-442c-bc97-a778d80fbeaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:04.348197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a379356-e422-442c-bc97-a778d80fbeaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:04.348878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a379356-e422-442c-bc97-a778d80fbeaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:04.349865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a379356-e422-442c-bc97-a778d80fbeaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:04.364451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a379356-e422-442c-bc97-a778d80fbeaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:04.504560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9a379356-e422-442c-bc97-a778d80fbeaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:04.512851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9a379356-e422-442c-bc97-a778d80fbeaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.176134 May 12 06:54:04.513410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 168/328] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:04 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:04.517670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-43937803-6a5e-4860-8664-cbfca8ffefdb tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:04.518264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-43937803-6a5e-4860-8664-cbfca8ffefdb tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:04.524304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43937803-6a5e-4860-8664-cbfca8ffefdb tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:04.524775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43937803-6a5e-4860-8664-cbfca8ffefdb tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:04.525538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43937803-6a5e-4860-8664-cbfca8ffefdb tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:04.525967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43937803-6a5e-4860-8664-cbfca8ffefdb tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:04.657028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-43937803-6a5e-4860-8664-cbfca8ffefdb tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:04.664360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-43937803-6a5e-4860-8664-cbfca8ffefdb tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1314 microversion: 2.1 time: 0.149954 May 12 06:54:04.664922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 169/329] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:04 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:04.674297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a599b1ba-de0f-473e-bee9-9176a59d1c1f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:04.675288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a599b1ba-de0f-473e-bee9-9176a59d1c1f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:04.686799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a599b1ba-de0f-473e-bee9-9176a59d1c1f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:04.687635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a599b1ba-de0f-473e-bee9-9176a59d1c1f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:04.689072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a599b1ba-de0f-473e-bee9-9176a59d1c1f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:04.689520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a599b1ba-de0f-473e-bee9-9176a59d1c1f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:04.723984 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8899c651-2594-4817-a814-3e7eafd15fe5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.207103 May 12 06:54:04.728613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 161/330] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:54:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 06:54:04.734940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-67e2478f-a929-47a1-a693-80d853270815 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:04.735561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-67e2478f-a929-47a1-a693-80d853270815 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:04.837423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-67e2478f-a929-47a1-a693-80d853270815 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:04.844194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-67e2478f-a929-47a1-a693-80d853270815 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1089 microversion: 2.1 time: 0.112996 May 12 06:54:04.847737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 162/331] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1089 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:04.865564 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a599b1ba-de0f-473e-bee9-9176a59d1c1f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:04.873422 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a599b1ba-de0f-473e-bee9-9176a59d1c1f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1366 microversion: 2.1 time: 0.207525 May 12 06:54:04.885390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 170/332] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:04 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:04.885722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e1461a5b-bcf0-461f-9ca4-643a9c6972b6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:04.885722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e1461a5b-bcf0-461f-9ca4-643a9c6972b6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:04.885722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1461a5b-bcf0-461f-9ca4-643a9c6972b6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:04.885722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1461a5b-bcf0-461f-9ca4-643a9c6972b6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:04.886112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1461a5b-bcf0-461f-9ca4-643a9c6972b6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:04.886112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1461a5b-bcf0-461f-9ca4-643a9c6972b6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:05.028283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e1461a5b-bcf0-461f-9ca4-643a9c6972b6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:05.035583 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e1461a5b-bcf0-461f-9ca4-643a9c6972b6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1371 microversion: 2.1 time: 0.163804 May 12 06:54:05.036174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 163/333] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:05.298063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-b99fe2b9-c07b-4967-baec-414b50d940dd req-c2ec1f87-bfce-4eb7-ae95-30b6f3988647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106", "name": "network-vif-plugged", "status": "completed", "tag": "bb3b7568-76ad-422a-b728-00d4b4baa39a"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:05.316004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-b99fe2b9-c07b-4967-baec-414b50d940dd req-c2ec1f87-bfce-4eb7-ae95-30b6f3988647 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:05.316004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-b99fe2b9-c07b-4967-baec-414b50d940dd req-c2ec1f87-bfce-4eb7-ae95-30b6f3988647 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:05.318475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-b99fe2b9-c07b-4967-baec-414b50d940dd req-c2ec1f87-bfce-4eb7-ae95-30b6f3988647 service nova] Creating event network-vif-plugged:bb3b7568-76ad-422a-b728-00d4b4baa39a for instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 on hv-cinder-76606 May 12 06:54:05.323381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-b99fe2b9-c07b-4967-baec-414b50d940dd req-c2ec1f87-bfce-4eb7-ae95-30b6f3988647 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029738 May 12 06:54:05.324006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 171/334] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:05.530527 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7ce50c65-9858-4721-88ba-e6e511c3a1fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:05.531439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7ce50c65-9858-4721-88ba-e6e511c3a1fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:05.538709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ce50c65-9858-4721-88ba-e6e511c3a1fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:05.539074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ce50c65-9858-4721-88ba-e6e511c3a1fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:05.540094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ce50c65-9858-4721-88ba-e6e511c3a1fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:05.540541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ce50c65-9858-4721-88ba-e6e511c3a1fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:05.682996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-925cbf3c-5219-464e-8fff-71b561686b5e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:05.683860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-925cbf3c-5219-464e-8fff-71b561686b5e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:05.690428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-925cbf3c-5219-464e-8fff-71b561686b5e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:05.690880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-925cbf3c-5219-464e-8fff-71b561686b5e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:05.691818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-925cbf3c-5219-464e-8fff-71b561686b5e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:05.692263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-925cbf3c-5219-464e-8fff-71b561686b5e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:05.703805 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7ce50c65-9858-4721-88ba-e6e511c3a1fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:05.712361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7ce50c65-9858-4721-88ba-e6e511c3a1fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.185983 May 12 06:54:05.713236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 164/335] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:05 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:05.845070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-925cbf3c-5219-464e-8fff-71b561686b5e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:05.853438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-925cbf3c-5219-464e-8fff-71b561686b5e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1314 microversion: 2.1 time: 0.174742 May 12 06:54:05.854017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 172/336] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:05 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:05.861033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-280f6c05-3e0d-497c-b75c-b4696f132f2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:05.861645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-280f6c05-3e0d-497c-b75c-b4696f132f2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:05.901887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-78018215-ec83-420e-a0f7-4a1b4b1fe9e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:05.904042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-78018215-ec83-420e-a0f7-4a1b4b1fe9e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:05.910123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78018215-ec83-420e-a0f7-4a1b4b1fe9e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:05.910575 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78018215-ec83-420e-a0f7-4a1b4b1fe9e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:05.911418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78018215-ec83-420e-a0f7-4a1b4b1fe9e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:05.911820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78018215-ec83-420e-a0f7-4a1b4b1fe9e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:05.949197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-280f6c05-3e0d-497c-b75c-b4696f132f2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:05.955979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-280f6c05-3e0d-497c-b75c-b4696f132f2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1089 microversion: 2.1 time: 0.098590 May 12 06:54:05.956572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 165/337] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:05 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1089 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:06.046077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-78018215-ec83-420e-a0f7-4a1b4b1fe9e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:06.053263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-47cd8ba0-daeb-4e17-9dd9-92cf6ce1ca8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:06.054102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-47cd8ba0-daeb-4e17-9dd9-92cf6ce1ca8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:06.057482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-78018215-ec83-420e-a0f7-4a1b4b1fe9e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1556 microversion: 2.1 time: 0.160058 May 12 06:54:06.058163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 173/338] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:05 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:06.060548 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47cd8ba0-daeb-4e17-9dd9-92cf6ce1ca8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:06.061109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47cd8ba0-daeb-4e17-9dd9-92cf6ce1ca8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:06.062037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47cd8ba0-daeb-4e17-9dd9-92cf6ce1ca8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:06.062833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47cd8ba0-daeb-4e17-9dd9-92cf6ce1ca8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:06.081209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-428014fb-2e6f-4ae4-95fa-41c17d145130 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:06.081715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-428014fb-2e6f-4ae4-95fa-41c17d145130 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:06.088605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-428014fb-2e6f-4ae4-95fa-41c17d145130 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:06.089304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-428014fb-2e6f-4ae4-95fa-41c17d145130 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:06.090289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-428014fb-2e6f-4ae4-95fa-41c17d145130 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:06.090743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-428014fb-2e6f-4ae4-95fa-41c17d145130 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:06.209313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-428014fb-2e6f-4ae4-95fa-41c17d145130 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133318 May 12 06:54:06.210788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 174/339] 10.222.0.25 () {58 vars in 1274 bytes} [Thu May 12 06:54:06 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:06.338035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-47cd8ba0-daeb-4e17-9dd9-92cf6ce1ca8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:06.344306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-47cd8ba0-daeb-4e17-9dd9-92cf6ce1ca8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1371 microversion: 2.1 time: 0.294826 May 12 06:54:06.345057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 166/340] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:06.730843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e1671ffb-c89e-40e2-8ca7-55baef8c85a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:06.732205 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e1671ffb-c89e-40e2-8ca7-55baef8c85a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:06.737902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1671ffb-c89e-40e2-8ca7-55baef8c85a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:06.738360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1671ffb-c89e-40e2-8ca7-55baef8c85a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:06.739346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1671ffb-c89e-40e2-8ca7-55baef8c85a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:06.739811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1671ffb-c89e-40e2-8ca7-55baef8c85a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:06.870121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-13d23854-692c-4219-b638-85be5a11206e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:06.871035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-13d23854-692c-4219-b638-85be5a11206e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:06.878437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13d23854-692c-4219-b638-85be5a11206e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:06.878959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13d23854-692c-4219-b638-85be5a11206e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:06.879830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13d23854-692c-4219-b638-85be5a11206e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:06.880332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13d23854-692c-4219-b638-85be5a11206e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:07.019908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e1671ffb-c89e-40e2-8ca7-55baef8c85a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:07.028806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e1671ffb-c89e-40e2-8ca7-55baef8c85a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.302274 May 12 06:54:07.029386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 175/341] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:06 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:07.034494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c153b8d0-6060-4878-813f-bf572862bcf7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:07.035137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c153b8d0-6060-4878-813f-bf572862bcf7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:07.042034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c153b8d0-6060-4878-813f-bf572862bcf7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:07.042797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c153b8d0-6060-4878-813f-bf572862bcf7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:07.043880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c153b8d0-6060-4878-813f-bf572862bcf7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:07.044320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c153b8d0-6060-4878-813f-bf572862bcf7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:07.154749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c153b8d0-6060-4878-813f-bf572862bcf7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:07.165693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c153b8d0-6060-4878-813f-bf572862bcf7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1139 microversion: 2.1 time: 0.135134 May 12 06:54:07.167102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 176/342] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:07 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1139 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:07.191982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-13d23854-692c-4219-b638-85be5a11206e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:07.202647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-13d23854-692c-4219-b638-85be5a11206e tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1314 microversion: 2.1 time: 0.335530 May 12 06:54:07.206483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 167/343] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:06 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:07.361687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-116efcfe-7cc1-40a4-a239-f470e9493c7b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:07.362480 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-116efcfe-7cc1-40a4-a239-f470e9493c7b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:07.369967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-116efcfe-7cc1-40a4-a239-f470e9493c7b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:07.370546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-116efcfe-7cc1-40a4-a239-f470e9493c7b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:07.371586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-116efcfe-7cc1-40a4-a239-f470e9493c7b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:07.372124 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-116efcfe-7cc1-40a4-a239-f470e9493c7b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:07.617492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-116efcfe-7cc1-40a4-a239-f470e9493c7b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:07.624838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-116efcfe-7cc1-40a4-a239-f470e9493c7b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1371 microversion: 2.1 time: 0.266916 May 12 06:54:07.625417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 177/344] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:07 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:07.921771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-4cbf2275-ba39-4f9a-ae28-785524e6ba90 req-18318f52-4fc8-418e-9342-6ef7f587ce8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a57c872-cacc-4345-b372-154b251e3661", "tag": "e115eee1-342f-406a-a608-d498c1303d80"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:07.930355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-4cbf2275-ba39-4f9a-ae28-785524e6ba90 req-18318f52-4fc8-418e-9342-6ef7f587ce8c service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:07.930886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-4cbf2275-ba39-4f9a-ae28-785524e6ba90 req-18318f52-4fc8-418e-9342-6ef7f587ce8c service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:07.943146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-4cbf2275-ba39-4f9a-ae28-785524e6ba90 req-18318f52-4fc8-418e-9342-6ef7f587ce8c service nova] Creating event network-changed:e115eee1-342f-406a-a608-d498c1303d80 for instance 4a57c872-cacc-4345-b372-154b251e3661 on hv-cinder-76606 May 12 06:54:07.948410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-4cbf2275-ba39-4f9a-ae28-785524e6ba90 req-18318f52-4fc8-418e-9342-6ef7f587ce8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030053 May 12 06:54:07.949679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 168/345] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:08.046527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3a5cd0a0-d768-4503-a2e9-97265f1deed0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:08.047278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3a5cd0a0-d768-4503-a2e9-97265f1deed0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:08.054452 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a5cd0a0-d768-4503-a2e9-97265f1deed0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:08.054971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a5cd0a0-d768-4503-a2e9-97265f1deed0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:08.055776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a5cd0a0-d768-4503-a2e9-97265f1deed0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:08.056221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a5cd0a0-d768-4503-a2e9-97265f1deed0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:08.207042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3a5cd0a0-d768-4503-a2e9-97265f1deed0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:08.211479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a0ca6485-c3aa-42bd-add9-f099860c87d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:08.212289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a0ca6485-c3aa-42bd-add9-f099860c87d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:08.226026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3a5cd0a0-d768-4503-a2e9-97265f1deed0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.182735 May 12 06:54:08.247029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0ca6485-c3aa-42bd-add9-f099860c87d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:08.247774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0ca6485-c3aa-42bd-add9-f099860c87d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:08.248357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 178/346] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:08 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:08.254155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-00ce6b8c-8f86-428f-bd45-e67ce6d92571 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:08.254772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-00ce6b8c-8f86-428f-bd45-e67ce6d92571 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:08.258877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0ca6485-c3aa-42bd-add9-f099860c87d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:08.259324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0ca6485-c3aa-42bd-add9-f099860c87d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:08.266752 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00ce6b8c-8f86-428f-bd45-e67ce6d92571 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:08.267435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00ce6b8c-8f86-428f-bd45-e67ce6d92571 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:08.271818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00ce6b8c-8f86-428f-bd45-e67ce6d92571 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:08.271818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00ce6b8c-8f86-428f-bd45-e67ce6d92571 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:08.372741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a0ca6485-c3aa-42bd-add9-f099860c87d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:08.380557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a0ca6485-c3aa-42bd-add9-f099860c87d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1187 microversion: 2.1 time: 0.194383 May 12 06:54:08.390768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 169/347] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:08 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1187 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:08.462870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-00ce6b8c-8f86-428f-bd45-e67ce6d92571 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:08.474195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-00ce6b8c-8f86-428f-bd45-e67ce6d92571 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1314 microversion: 2.1 time: 0.224441 May 12 06:54:08.475371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 179/348] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:08 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:08.643013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c3326f2f-663b-4ca1-82ff-a59065282a2c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:08.643731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c3326f2f-663b-4ca1-82ff-a59065282a2c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:08.650532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3326f2f-663b-4ca1-82ff-a59065282a2c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:08.650996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3326f2f-663b-4ca1-82ff-a59065282a2c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:08.651976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3326f2f-663b-4ca1-82ff-a59065282a2c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:08.652694 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3326f2f-663b-4ca1-82ff-a59065282a2c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:08.789254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c3326f2f-663b-4ca1-82ff-a59065282a2c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:08.797198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c3326f2f-663b-4ca1-82ff-a59065282a2c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1565 microversion: 2.1 time: 0.158374 May 12 06:54:08.797781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 170/349] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:08.814232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1ae3a7dc-e0b1-48b7-b34b-5ce6f6342ce2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:08.814736 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1ae3a7dc-e0b1-48b7-b34b-5ce6f6342ce2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:08.821211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ae3a7dc-e0b1-48b7-b34b-5ce6f6342ce2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:08.821667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ae3a7dc-e0b1-48b7-b34b-5ce6f6342ce2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:08.822497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ae3a7dc-e0b1-48b7-b34b-5ce6f6342ce2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:08.822941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ae3a7dc-e0b1-48b7-b34b-5ce6f6342ce2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:08.913081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1ae3a7dc-e0b1-48b7-b34b-5ce6f6342ce2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102181 May 12 06:54:08.915725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 180/350] 10.222.0.25 () {58 vars in 1274 bytes} [Thu May 12 06:54:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:09.251255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ee261c2b-749d-4555-a266-dc98ca4bb455 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:09.252853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ee261c2b-749d-4555-a266-dc98ca4bb455 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:09.260389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee261c2b-749d-4555-a266-dc98ca4bb455 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:09.261101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee261c2b-749d-4555-a266-dc98ca4bb455 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:09.262133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee261c2b-749d-4555-a266-dc98ca4bb455 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:09.262766 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee261c2b-749d-4555-a266-dc98ca4bb455 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:09.399439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d040a9ec-b883-4344-8e55-70e951d93ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:09.400804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d040a9ec-b883-4344-8e55-70e951d93ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:09.411503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d040a9ec-b883-4344-8e55-70e951d93ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:09.412199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d040a9ec-b883-4344-8e55-70e951d93ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:09.413285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d040a9ec-b883-4344-8e55-70e951d93ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:09.413894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d040a9ec-b883-4344-8e55-70e951d93ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:09.527607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d040a9ec-b883-4344-8e55-70e951d93ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:09.535277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d040a9ec-b883-4344-8e55-70e951d93ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1205 microversion: 2.1 time: 0.140682 May 12 06:54:09.540033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 181/351] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:09 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1205 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:09.545324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-63c1f133-af7d-4d9d-894c-0d3ef250e2da tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:09.547317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-63c1f133-af7d-4d9d-894c-0d3ef250e2da tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:09.566632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-63c1f133-af7d-4d9d-894c-0d3ef250e2da tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:09.567178 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-63c1f133-af7d-4d9d-894c-0d3ef250e2da tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:09.570722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-63c1f133-af7d-4d9d-894c-0d3ef250e2da tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:09.571292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-63c1f133-af7d-4d9d-894c-0d3ef250e2da tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:09.577681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ee261c2b-749d-4555-a266-dc98ca4bb455 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:09.589135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ee261c2b-749d-4555-a266-dc98ca4bb455 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.342130 May 12 06:54:09.595607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 171/352] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:09 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:09.614752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-10437c87-1067-4750-9e17-e5d1318eed23 req-7b0fc743-1f62-4ce3-b1a1-b4a1ccc1e9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbc5457-605d-4013-88c1-18f936b8d0ac", "name": "network-vif-plugged", "status": "completed", "tag": "48da0c84-0c6b-4010-924b-e4f8552570e3"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:09.630085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-10437c87-1067-4750-9e17-e5d1318eed23 req-7b0fc743-1f62-4ce3-b1a1-b4a1ccc1e9d6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:09.632440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-10437c87-1067-4750-9e17-e5d1318eed23 req-7b0fc743-1f62-4ce3-b1a1-b4a1ccc1e9d6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:09.648783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-10437c87-1067-4750-9e17-e5d1318eed23 req-7b0fc743-1f62-4ce3-b1a1-b4a1ccc1e9d6 service nova] Creating event network-vif-plugged:48da0c84-0c6b-4010-924b-e4f8552570e3 for instance 0fbc5457-605d-4013-88c1-18f936b8d0ac on hv-cinder-76606 May 12 06:54:09.655241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-10437c87-1067-4750-9e17-e5d1318eed23 req-7b0fc743-1f62-4ce3-b1a1-b4a1ccc1e9d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043979 May 12 06:54:09.656101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 172/353] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:54:09.827132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-63c1f133-af7d-4d9d-894c-0d3ef250e2da tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:09.835794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-63c1f133-af7d-4d9d-894c-0d3ef250e2da tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1314 microversion: 2.1 time: 0.294408 May 12 06:54:09.836373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 182/354] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:09 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:10.475657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-5107186b-390d-4e28-9b1a-d751d0de599c req-77f1dc35-837b-4357-b7e5-9eb7b581266c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106", "tag": "bb3b7568-76ad-422a-b728-00d4b4baa39a"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:10.484076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-5107186b-390d-4e28-9b1a-d751d0de599c req-77f1dc35-837b-4357-b7e5-9eb7b581266c service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:10.484523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-5107186b-390d-4e28-9b1a-d751d0de599c req-77f1dc35-837b-4357-b7e5-9eb7b581266c service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:10.496387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-5107186b-390d-4e28-9b1a-d751d0de599c req-77f1dc35-837b-4357-b7e5-9eb7b581266c service nova] Creating event network-changed:bb3b7568-76ad-422a-b728-00d4b4baa39a for instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 on hv-cinder-76606 May 12 06:54:10.502736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-5107186b-390d-4e28-9b1a-d751d0de599c req-77f1dc35-837b-4357-b7e5-9eb7b581266c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031846 May 12 06:54:10.503794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 173/355] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:10.557261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0c3f6712-3c23-4cfe-857b-212e763edd4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:10.557965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0c3f6712-3c23-4cfe-857b-212e763edd4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:10.564952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c3f6712-3c23-4cfe-857b-212e763edd4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:10.565717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c3f6712-3c23-4cfe-857b-212e763edd4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:10.566802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c3f6712-3c23-4cfe-857b-212e763edd4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:10.580900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c3f6712-3c23-4cfe-857b-212e763edd4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:10.607412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-639d60e3-dceb-4aea-977b-fcea759bd65f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:10.608149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-639d60e3-dceb-4aea-977b-fcea759bd65f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:10.617582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-639d60e3-dceb-4aea-977b-fcea759bd65f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:10.618037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-639d60e3-dceb-4aea-977b-fcea759bd65f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:10.618828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-639d60e3-dceb-4aea-977b-fcea759bd65f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:10.619271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-639d60e3-dceb-4aea-977b-fcea759bd65f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:10.861905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0c3f6712-3c23-4cfe-857b-212e763edd4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:10.871755 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0c3f6712-3c23-4cfe-857b-212e763edd4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1272 microversion: 2.1 time: 0.318951 May 12 06:54:10.873131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 183/356] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:10 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1272 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:10.878839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f69d750f-3c4a-4137-a879-4c5463517f0a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:10.879704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f69d750f-3c4a-4137-a879-4c5463517f0a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:10.897245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-639d60e3-dceb-4aea-977b-fcea759bd65f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:10.905816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-639d60e3-dceb-4aea-977b-fcea759bd65f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.302577 May 12 06:54:10.916560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69d750f-3c4a-4137-a879-4c5463517f0a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:10.916560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69d750f-3c4a-4137-a879-4c5463517f0a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:10.916560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69d750f-3c4a-4137-a879-4c5463517f0a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:10.916560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69d750f-3c4a-4137-a879-4c5463517f0a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:10.917609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 174/357] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:10 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:11.069219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f69d750f-3c4a-4137-a879-4c5463517f0a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:11.077571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f69d750f-3c4a-4137-a879-4c5463517f0a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1314 microversion: 2.1 time: 0.203276 May 12 06:54:11.078384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 184/358] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:10 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:11.889706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-843f1f94-6229-481e-a8c7-98ecc8d41aa7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:11.890436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-843f1f94-6229-481e-a8c7-98ecc8d41aa7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:11.898438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-843f1f94-6229-481e-a8c7-98ecc8d41aa7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:11.898895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-843f1f94-6229-481e-a8c7-98ecc8d41aa7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:11.899711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-843f1f94-6229-481e-a8c7-98ecc8d41aa7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:11.900146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-843f1f94-6229-481e-a8c7-98ecc8d41aa7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:11.924184 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0581b11e-b409-4d67-8d13-895c737840bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:11.927302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0581b11e-b409-4d67-8d13-895c737840bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:11.936215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0581b11e-b409-4d67-8d13-895c737840bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:11.936935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0581b11e-b409-4d67-8d13-895c737840bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:11.938427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0581b11e-b409-4d67-8d13-895c737840bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:11.939031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0581b11e-b409-4d67-8d13-895c737840bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:12.129077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-843f1f94-6229-481e-a8c7-98ecc8d41aa7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:12.137138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-843f1f94-6229-481e-a8c7-98ecc8d41aa7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.251168 May 12 06:54:12.137722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 175/359] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:11 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:12.150522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-8919dbfe-3993-4723-bff2-9183372a0767 req-15f5ab60-f48a-4758-811f-88ae576a3e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0fa87a-f20f-489f-b64c-04073a58a792", "tag": "bbe011a7-6d2c-4588-95a8-e8d354355950"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:12.159999 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-8919dbfe-3993-4723-bff2-9183372a0767 req-15f5ab60-f48a-4758-811f-88ae576a3e64 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:12.160478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-8919dbfe-3993-4723-bff2-9183372a0767 req-15f5ab60-f48a-4758-811f-88ae576a3e64 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:12.164514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0581b11e-b409-4d67-8d13-895c737840bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:12.174862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0581b11e-b409-4d67-8d13-895c737840bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.252671 May 12 06:54:12.174862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 185/360] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:11 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:12.175089 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-8919dbfe-3993-4723-bff2-9183372a0767 req-15f5ab60-f48a-4758-811f-88ae576a3e64 service nova] Creating event network-changed:bbe011a7-6d2c-4588-95a8-e8d354355950 for instance 0f0fa87a-f20f-489f-b64c-04073a58a792 on hv-cinder-76606 May 12 06:54:12.178367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cbbb7439-8026-4844-8160-8f29226f8168 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:12.179088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cbbb7439-8026-4844-8160-8f29226f8168 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:12.179706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-8919dbfe-3993-4723-bff2-9183372a0767 req-15f5ab60-f48a-4758-811f-88ae576a3e64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036506 May 12 06:54:12.180576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 176/361] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:12.188960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbbb7439-8026-4844-8160-8f29226f8168 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:12.189416 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbbb7439-8026-4844-8160-8f29226f8168 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:12.190210 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbbb7439-8026-4844-8160-8f29226f8168 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:12.190669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbbb7439-8026-4844-8160-8f29226f8168 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:12.324004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cbbb7439-8026-4844-8160-8f29226f8168 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:12.331971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cbbb7439-8026-4844-8160-8f29226f8168 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1499 microversion: 2.1 time: 0.157732 May 12 06:54:12.338780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 186/362] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:12 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1499 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:13.154821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e72c3102-9f4c-442b-9bbd-50ca5e2d03d5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:13.155595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e72c3102-9f4c-442b-9bbd-50ca5e2d03d5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:13.162347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e72c3102-9f4c-442b-9bbd-50ca5e2d03d5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:13.163351 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e72c3102-9f4c-442b-9bbd-50ca5e2d03d5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:13.164150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e72c3102-9f4c-442b-9bbd-50ca5e2d03d5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:13.164585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e72c3102-9f4c-442b-9bbd-50ca5e2d03d5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:13.189727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a86246eb-6328-4c0f-964f-4b675277b04e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:13.190353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a86246eb-6328-4c0f-964f-4b675277b04e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:13.200247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a86246eb-6328-4c0f-964f-4b675277b04e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:13.200700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a86246eb-6328-4c0f-964f-4b675277b04e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:13.201488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a86246eb-6328-4c0f-964f-4b675277b04e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:13.201931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a86246eb-6328-4c0f-964f-4b675277b04e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:13.357732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e72c3102-9f4c-442b-9bbd-50ca5e2d03d5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:13.372687 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e72c3102-9f4c-442b-9bbd-50ca5e2d03d5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.221691 May 12 06:54:13.378353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 177/363] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:13 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:13.395159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a86246eb-6328-4c0f-964f-4b675277b04e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:13.404198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-96a5f029-9102-4ea9-a291-90e13f884de1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:13.406254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-96a5f029-9102-4ea9-a291-90e13f884de1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:13.408720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a86246eb-6328-4c0f-964f-4b675277b04e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.223112 May 12 06:54:13.420094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 187/364] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:13 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:13.420199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96a5f029-9102-4ea9-a291-90e13f884de1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:13.420199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96a5f029-9102-4ea9-a291-90e13f884de1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:13.420199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96a5f029-9102-4ea9-a291-90e13f884de1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:13.420199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96a5f029-9102-4ea9-a291-90e13f884de1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:13.439794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-96a5f029-9102-4ea9-a291-90e13f884de1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Going to try to terminate instance {{(pid=124024) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 06:54:13.748030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-96a5f029-9102-4ea9-a291-90e13f884de1 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 204 len: 0 microversion: 2.1 time: 0.347464 May 12 06:54:13.748630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 178/365] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 06:54:13 2022] DELETE /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 06:54:13.757403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ff29d3f8-0d39-4a92-b729-b0b92213529a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:13.758018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ff29d3f8-0d39-4a92-b729-b0b92213529a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:13.763903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff29d3f8-0d39-4a92-b729-b0b92213529a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:13.764356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff29d3f8-0d39-4a92-b729-b0b92213529a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:13.765123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff29d3f8-0d39-4a92-b729-b0b92213529a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:13.765564 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff29d3f8-0d39-4a92-b729-b0b92213529a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:13.898318 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ff29d3f8-0d39-4a92-b729-b0b92213529a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:13.906107 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ff29d3f8-0d39-4a92-b729-b0b92213529a tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1505 microversion: 2.1 time: 0.153201 May 12 06:54:13.906684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 188/366] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:13 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:14.389803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d08bcf63-b446-4508-9546-1d20581c1311 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:14.390505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d08bcf63-b446-4508-9546-1d20581c1311 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:14.396815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d08bcf63-b446-4508-9546-1d20581c1311 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:14.397271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d08bcf63-b446-4508-9546-1d20581c1311 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:14.398080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d08bcf63-b446-4508-9546-1d20581c1311 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:14.398517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d08bcf63-b446-4508-9546-1d20581c1311 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:14.429283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9f4c9c79-9693-420d-a828-96bf4c6360f9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:14.429899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9f4c9c79-9693-420d-a828-96bf4c6360f9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:14.436268 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f4c9c79-9693-420d-a828-96bf4c6360f9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:14.436720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f4c9c79-9693-420d-a828-96bf4c6360f9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:14.437501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f4c9c79-9693-420d-a828-96bf4c6360f9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:14.437982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f4c9c79-9693-420d-a828-96bf4c6360f9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:14.587555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d08bcf63-b446-4508-9546-1d20581c1311 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:14.596270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d08bcf63-b446-4508-9546-1d20581c1311 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.210411 May 12 06:54:14.597262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 179/367] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:14 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:14.610658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9f4c9c79-9693-420d-a828-96bf4c6360f9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:14.618692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9f4c9c79-9693-420d-a828-96bf4c6360f9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.193871 May 12 06:54:14.619293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 189/368] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:14 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:14.928609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7aeb6c75-de25-41a8-8ef6-fd987c6e87fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:14.928609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7aeb6c75-de25-41a8-8ef6-fd987c6e87fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:14.929032 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aeb6c75-de25-41a8-8ef6-fd987c6e87fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:14.929478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aeb6c75-de25-41a8-8ef6-fd987c6e87fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:14.930244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aeb6c75-de25-41a8-8ef6-fd987c6e87fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:14.930678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aeb6c75-de25-41a8-8ef6-fd987c6e87fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:15.059855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7aeb6c75-de25-41a8-8ef6-fd987c6e87fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:15.067201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7aeb6c75-de25-41a8-8ef6-fd987c6e87fe tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1505 microversion: 2.1 time: 0.148705 May 12 06:54:15.067777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 180/369] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:14 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:15.613156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-38f0da99-82cc-4254-b41f-c7923057077b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:15.613768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-38f0da99-82cc-4254-b41f-c7923057077b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:15.620106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38f0da99-82cc-4254-b41f-c7923057077b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:15.620552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38f0da99-82cc-4254-b41f-c7923057077b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:15.621317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38f0da99-82cc-4254-b41f-c7923057077b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:15.621750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38f0da99-82cc-4254-b41f-c7923057077b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:15.635718 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-92c6ce82-ec04-4136-b790-565e6be8a91b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:15.636558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-92c6ce82-ec04-4136-b790-565e6be8a91b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:15.642885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92c6ce82-ec04-4136-b790-565e6be8a91b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:15.643327 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92c6ce82-ec04-4136-b790-565e6be8a91b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:15.644114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92c6ce82-ec04-4136-b790-565e6be8a91b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:15.644549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92c6ce82-ec04-4136-b790-565e6be8a91b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:16.032929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-38f0da99-82cc-4254-b41f-c7923057077b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:16.046262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-38f0da99-82cc-4254-b41f-c7923057077b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.436873 May 12 06:54:16.047492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 190/370] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:15 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:16.058836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-92c6ce82-ec04-4136-b790-565e6be8a91b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:16.068758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-92c6ce82-ec04-4136-b790-565e6be8a91b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.436724 May 12 06:54:16.069373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 181/371] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:15 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:16.089506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9e314bf3-2c5f-4291-8fdb-048128d1c945 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:16.089506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9e314bf3-2c5f-4291-8fdb-048128d1c945 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:16.091680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e314bf3-2c5f-4291-8fdb-048128d1c945 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:16.092156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e314bf3-2c5f-4291-8fdb-048128d1c945 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:16.092933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e314bf3-2c5f-4291-8fdb-048128d1c945 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:16.093370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e314bf3-2c5f-4291-8fdb-048128d1c945 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:16.226740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9e314bf3-2c5f-4291-8fdb-048128d1c945 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:16.234015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9e314bf3-2c5f-4291-8fdb-048128d1c945 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1505 microversion: 2.1 time: 0.153414 May 12 06:54:16.234577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 191/372] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:16 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:16.256679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b7691fe8-5971-4be7-a811-d696132d002b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:16.257174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b7691fe8-5971-4be7-a811-d696132d002b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:16.263020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7691fe8-5971-4be7-a811-d696132d002b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:16.263474 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7691fe8-5971-4be7-a811-d696132d002b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:16.264268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7691fe8-5971-4be7-a811-d696132d002b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:16.264707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7691fe8-5971-4be7-a811-d696132d002b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:16.287254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b7691fe8-5971-4be7-a811-d696132d002b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/ips" status: 200 len: 151 microversion: 2.20 time: 0.034568 May 12 06:54:16.288505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 182/373] 10.222.0.25 () {60 vars in 1288 bytes} [Thu May 12 06:54:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:54:16.479722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-20d3c5a3-d286-4fde-996b-8cfa77cb3ced req-62e88fcd-580e-426a-85d5-f4db0a315e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbc5457-605d-4013-88c1-18f936b8d0ac", "name": "network-vif-deleted", "tag": "48da0c84-0c6b-4010-924b-e4f8552570e3"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:16.488135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-20d3c5a3-d286-4fde-996b-8cfa77cb3ced req-62e88fcd-580e-426a-85d5-f4db0a315e1d service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:16.488632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-20d3c5a3-d286-4fde-996b-8cfa77cb3ced req-62e88fcd-580e-426a-85d5-f4db0a315e1d service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:16.500325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-20d3c5a3-d286-4fde-996b-8cfa77cb3ced req-62e88fcd-580e-426a-85d5-f4db0a315e1d service nova] Creating event network-vif-deleted:48da0c84-0c6b-4010-924b-e4f8552570e3 for instance 0fbc5457-605d-4013-88c1-18f936b8d0ac on hv-cinder-76606 May 12 06:54:16.505646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-20d3c5a3-d286-4fde-996b-8cfa77cb3ced req-62e88fcd-580e-426a-85d5-f4db0a315e1d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029969 May 12 06:54:16.512135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 192/374] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:17.071775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-52edd5d9-b267-469c-a654-31e1447424c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:17.072399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-52edd5d9-b267-469c-a654-31e1447424c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:17.079018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52edd5d9-b267-469c-a654-31e1447424c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:17.081072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52edd5d9-b267-469c-a654-31e1447424c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:17.081072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52edd5d9-b267-469c-a654-31e1447424c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:17.086335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6c5cf4fe-a17d-444f-ab2d-4cd3a97070c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:17.087028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6c5cf4fe-a17d-444f-ab2d-4cd3a97070c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:17.094041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52edd5d9-b267-469c-a654-31e1447424c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:17.097525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6c5cf4fe-a17d-444f-ab2d-4cd3a97070c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:17.098112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6c5cf4fe-a17d-444f-ab2d-4cd3a97070c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:17.098901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6c5cf4fe-a17d-444f-ab2d-4cd3a97070c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:17.099336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6c5cf4fe-a17d-444f-ab2d-4cd3a97070c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:17.292848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-52edd5d9-b267-469c-a654-31e1447424c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:17.296078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6c5cf4fe-a17d-444f-ab2d-4cd3a97070c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:17.301091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-52edd5d9-b267-469c-a654-31e1447424c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.234738 May 12 06:54:17.306872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 183/375] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:17 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:17.306995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6c5cf4fe-a17d-444f-ab2d-4cd3a97070c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.222472 May 12 06:54:17.306995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 193/376] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:17 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:17.307164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-329dfc3f-79d0-4f7f-9e8a-05d2ad147a1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:17.307520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-329dfc3f-79d0-4f7f-9e8a-05d2ad147a1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:17.313161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-329dfc3f-79d0-4f7f-9e8a-05d2ad147a1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:17.313634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-329dfc3f-79d0-4f7f-9e8a-05d2ad147a1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:17.314409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-329dfc3f-79d0-4f7f-9e8a-05d2ad147a1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:17.314845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-329dfc3f-79d0-4f7f-9e8a-05d2ad147a1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:17.344613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-329dfc3f-79d0-4f7f-9e8a-05d2ad147a1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:17.345064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-329dfc3f-79d0-4f7f-9e8a-05d2ad147a1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:17.345535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-329dfc3f-79d0-4f7f-9e8a-05d2ad147a1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lazy-loading 'fault' on Instance uuid 0fbc5457-605d-4013-88c1-18f936b8d0ac {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:54:17.385908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-329dfc3f-79d0-4f7f-9e8a-05d2ad147a1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16de05b788c42b5979a20ff3b26340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59759391f6e4650b3bbd3059dd3f9f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:17.393077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-329dfc3f-79d0-4f7f-9e8a-05d2ad147a1d tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 200 len: 1304 microversion: 2.1 time: 0.090468 May 12 06:54:17.393642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 184/377] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:17 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:18.318463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ac9dfec0-d248-414f-828d-2de74eba3fb3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:18.319071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ac9dfec0-d248-414f-828d-2de74eba3fb3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:18.322315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bc2045d6-fa40-43ca-8814-51c1b865b4bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:18.323119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bc2045d6-fa40-43ca-8814-51c1b865b4bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:18.325960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac9dfec0-d248-414f-828d-2de74eba3fb3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:18.326416 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac9dfec0-d248-414f-828d-2de74eba3fb3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:18.327211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac9dfec0-d248-414f-828d-2de74eba3fb3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:18.327838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac9dfec0-d248-414f-828d-2de74eba3fb3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:18.329679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc2045d6-fa40-43ca-8814-51c1b865b4bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:18.330200 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc2045d6-fa40-43ca-8814-51c1b865b4bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:18.331047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc2045d6-fa40-43ca-8814-51c1b865b4bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:18.331573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc2045d6-fa40-43ca-8814-51c1b865b4bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:18.522009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ac9dfec0-d248-414f-828d-2de74eba3fb3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:18.528837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bc2045d6-fa40-43ca-8814-51c1b865b4bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:18.529592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ac9dfec0-d248-414f-828d-2de74eba3fb3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.215077 May 12 06:54:18.530167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 194/378] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:18 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:18.534801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3aed52e3-0bf9-4653-b1ab-5e5d0a201123 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:18.535619 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3aed52e3-0bf9-4653-b1ab-5e5d0a201123 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] [instance: 0fbc5457-605d-4013-88c1-18f936b8d0ac] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:18.537075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bc2045d6-fa40-43ca-8814-51c1b865b4bd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1723 microversion: 2.1 time: 0.219167 May 12 06:54:18.537825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 185/379] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:18 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:18.541661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3aed52e3-0bf9-4653-b1ab-5e5d0a201123 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:18.542304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3aed52e3-0bf9-4653-b1ab-5e5d0a201123 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:18.543082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3aed52e3-0bf9-4653-b1ab-5e5d0a201123 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:18.543517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3aed52e3-0bf9-4653-b1ab-5e5d0a201123 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-3aed52e3-0bf9-4653-b1ab-5e5d0a201123 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] HTTP exception thrown: Instance 0fbc5457-605d-4013-88c1-18f936b8d0ac could not be found. May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3aed52e3-0bf9-4653-b1ab-5e5d0a201123 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Request method failure captured: May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac HTTP/1.1 May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK7dTafjPQGyJKeSwOPeOW2Ze_EUwPcB1kkiWsQygeAMeyMpYKOe9h7W7tuVm5PiJ02_AMH6xlEZo82OrE5o_cmYj41_Wi57Jb_YmtajwFry9Iv1eCcrixsMfP5F8hgYdxRKmQNcLk1tt3sTOcwXM3zPN_D5uMkwUytgzfBmImlgQBM May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: e59759391f6e4650b3bbd3059dd3f9f7 May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-VolumesActionsTest-872849924 May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 06:54:18.561898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e59759391f6e4650b3bbd3059dd3f9f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e59759391f6e4650b3bbd3059dd3f9f7", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e59759391f6e4650b3bbd3059dd3f9f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e59759391f6e4650b3bbd3059dd3f9f7"}]}] May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-VolumesActionsTest-872849924 May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: e59759391f6e4650b3bbd3059dd3f9f7 May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-VolumesActionsTest-872849924 May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-VolumesActionsTest-872849924-project May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: d16de05b788c42b5979a20ff3b26340c May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-VolumesActionsTest-872849924-project May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance 0fbc5457-605d-4013-88c1-18f936b8d0ac could not be found. May 12 06:54:18.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': '0fbc5457-605d-4013-88c1-18f936b8d0ac'} May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fbc5457-605d-4013-88c1-18f936b8d0ac could not be found. May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:54:18.564518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fbc5457-605d-4013-88c1-18f936b8d0ac could not be found. May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fbc5457-605d-4013-88c1-18f936b8d0ac could not be found. May 12 06:54:18.565979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:54:18.567288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3aed52e3-0bf9-4653-b1ab-5e5d0a201123 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] Returning 404 to user: Instance 0fbc5457-605d-4013-88c1-18f936b8d0ac could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:54:18.567288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3aed52e3-0bf9-4653-b1ab-5e5d0a201123 tempest-VolumesActionsTest-872849924 tempest-VolumesActionsTest-872849924-project] 10.222.0.25 "GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac" status: 404 len: 111 microversion: 2.1 time: 0.031667 May 12 06:54:18.567288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 195/380] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:18 2022] GET /compute/v2.1/servers/0fbc5457-605d-4013-88c1-18f936b8d0ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 06:54:19.327380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2f4f68b0-4fa2-4b2a-a5c4-59da9e700220 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:19.327921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2f4f68b0-4fa2-4b2a-a5c4-59da9e700220 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:19.338730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f4f68b0-4fa2-4b2a-a5c4-59da9e700220 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:19.338730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f4f68b0-4fa2-4b2a-a5c4-59da9e700220 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:19.338730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f4f68b0-4fa2-4b2a-a5c4-59da9e700220 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:19.338730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f4f68b0-4fa2-4b2a-a5c4-59da9e700220 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:19.359289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-2f4f68b0-4fa2-4b2a-a5c4-59da9e700220 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lazy-loading 'flavor' on Instance uuid d30aa8f3-ada1-42f3-bb93-081f2552b4a3 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:54:19.547591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f398b049-12e0-41e6-8479-a41a236f04f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:19.547591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f398b049-12e0-41e6-8479-a41a236f04f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:19.553793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f398b049-12e0-41e6-8479-a41a236f04f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:19.554248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f398b049-12e0-41e6-8479-a41a236f04f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:19.555031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f398b049-12e0-41e6-8479-a41a236f04f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:19.555475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f398b049-12e0-41e6-8479-a41a236f04f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:19.688225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f398b049-12e0-41e6-8479-a41a236f04f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:19.695950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f398b049-12e0-41e6-8479-a41a236f04f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.153253 May 12 06:54:19.696621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 196/381] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:19 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:19.708562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c9cba7a8-fd72-4434-8d1b-226dc675f958 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:19.709780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c9cba7a8-fd72-4434-8d1b-226dc675f958 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:19.715557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9cba7a8-fd72-4434-8d1b-226dc675f958 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:19.716055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9cba7a8-fd72-4434-8d1b-226dc675f958 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:19.716821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9cba7a8-fd72-4434-8d1b-226dc675f958 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:19.717318 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9cba7a8-fd72-4434-8d1b-226dc675f958 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:19.860969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c9cba7a8-fd72-4434-8d1b-226dc675f958 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:19.868989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c9cba7a8-fd72-4434-8d1b-226dc675f958 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1700 microversion: 2.1 time: 0.171354 May 12 06:54:19.877549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 197/382] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:19 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1700 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:19.886012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3a1cdb67-a4d7-44b9-be88-be40499c847c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:19.891912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a1cdb67-a4d7-44b9-be88-be40499c847c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:19.892376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a1cdb67-a4d7-44b9-be88-be40499c847c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:19.952635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3a1cdb67-a4d7-44b9-be88-be40499c847c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Going to try to start instance {{(pid=124025) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 06:54:19.998112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2f4f68b0-4fa2-4b2a-a5c4-59da9e700220 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "POST /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/action" status: 202 len: 0 microversion: 2.20 time: 0.674494 May 12 06:54:19.999725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 186/383] 10.222.0.25 () {62 vars in 1318 bytes} [Thu May 12 06:54:19 2022] POST /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 06:54:20.008125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fba7016f-c5b0-44b3-b811-7db7351d6589 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:20.009121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fba7016f-c5b0-44b3-b811-7db7351d6589 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:20.016824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fba7016f-c5b0-44b3-b811-7db7351d6589 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:20.017405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fba7016f-c5b0-44b3-b811-7db7351d6589 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:20.018345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fba7016f-c5b0-44b3-b811-7db7351d6589 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:20.022855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fba7016f-c5b0-44b3-b811-7db7351d6589 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:20.186296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3a1cdb67-a4d7-44b9-be88-be40499c847c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "POST /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/action" status: 202 len: 0 microversion: 2.1 time: 0.304115 May 12 06:54:20.187139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 198/384] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 06:54:19 2022] POST /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 06:54:20.192433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fba7016f-c5b0-44b3-b811-7db7351d6589 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:20.198223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a587e4ee-9212-4020-af66-65795b11a90c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:20.199068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a587e4ee-9212-4020-af66-65795b11a90c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:20.203621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fba7016f-c5b0-44b3-b811-7db7351d6589 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:20.206216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fba7016f-c5b0-44b3-b811-7db7351d6589 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:20.207550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fba7016f-c5b0-44b3-b811-7db7351d6589 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.204432 May 12 06:54:20.208141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a587e4ee-9212-4020-af66-65795b11a90c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:20.208744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a587e4ee-9212-4020-af66-65795b11a90c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:20.210992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a587e4ee-9212-4020-af66-65795b11a90c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:20.211656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a587e4ee-9212-4020-af66-65795b11a90c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:20.219192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 187/385] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:54:20.346567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a587e4ee-9212-4020-af66-65795b11a90c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:20.354492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a587e4ee-9212-4020-af66-65795b11a90c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1709 microversion: 2.1 time: 0.162700 May 12 06:54:20.355057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 199/386] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:20 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:20.712618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0dd266b8-954c-469f-a6f7-148620988deb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:20.713153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0dd266b8-954c-469f-a6f7-148620988deb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:20.719530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dd266b8-954c-469f-a6f7-148620988deb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:20.720016 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dd266b8-954c-469f-a6f7-148620988deb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:20.720786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dd266b8-954c-469f-a6f7-148620988deb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:20.721227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dd266b8-954c-469f-a6f7-148620988deb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:20.864121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0dd266b8-954c-469f-a6f7-148620988deb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:20.871855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0dd266b8-954c-469f-a6f7-148620988deb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.163116 May 12 06:54:20.872421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 188/387] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:20 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:21.226774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e981ca64-24e4-41cb-b0b1-07b9088c7f02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:21.227398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e981ca64-24e4-41cb-b0b1-07b9088c7f02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:21.234558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e981ca64-24e4-41cb-b0b1-07b9088c7f02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:21.235019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e981ca64-24e4-41cb-b0b1-07b9088c7f02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:21.235841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e981ca64-24e4-41cb-b0b1-07b9088c7f02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:21.236289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e981ca64-24e4-41cb-b0b1-07b9088c7f02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:21.371205 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e981ca64-24e4-41cb-b0b1-07b9088c7f02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:21.374022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-47207692-462b-462e-af64-179b2d9ea166 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:21.374022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-47207692-462b-462e-af64-179b2d9ea166 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:21.378377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47207692-462b-462e-af64-179b2d9ea166 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:21.379087 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47207692-462b-462e-af64-179b2d9ea166 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:21.380182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47207692-462b-462e-af64-179b2d9ea166 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:21.380931 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47207692-462b-462e-af64-179b2d9ea166 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:21.381950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e981ca64-24e4-41cb-b0b1-07b9088c7f02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:21.383925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e981ca64-24e4-41cb-b0b1-07b9088c7f02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:21.385183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e981ca64-24e4-41cb-b0b1-07b9088c7f02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.162936 May 12 06:54:21.398299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 200/388] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:21.565532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-47207692-462b-462e-af64-179b2d9ea166 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:21.574228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-47207692-462b-462e-af64-179b2d9ea166 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1709 microversion: 2.1 time: 0.206673 May 12 06:54:21.584204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 189/389] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:21 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1709 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:21.887533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8b6f033a-b4a9-49f3-924d-5289d1074b96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:21.888182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8b6f033a-b4a9-49f3-924d-5289d1074b96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:21.893992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b6f033a-b4a9-49f3-924d-5289d1074b96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:21.894436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b6f033a-b4a9-49f3-924d-5289d1074b96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:21.895203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b6f033a-b4a9-49f3-924d-5289d1074b96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:21.895637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b6f033a-b4a9-49f3-924d-5289d1074b96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:22.034076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8b6f033a-b4a9-49f3-924d-5289d1074b96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:22.043078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8b6f033a-b4a9-49f3-924d-5289d1074b96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.159225 May 12 06:54:22.043703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 201/390] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:21 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:22.403988 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-33393e07-017a-4acd-a5bd-eaaff6ed3bc7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:22.404597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-33393e07-017a-4acd-a5bd-eaaff6ed3bc7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:22.410812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33393e07-017a-4acd-a5bd-eaaff6ed3bc7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:22.411261 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33393e07-017a-4acd-a5bd-eaaff6ed3bc7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:22.412054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33393e07-017a-4acd-a5bd-eaaff6ed3bc7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:22.413067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33393e07-017a-4acd-a5bd-eaaff6ed3bc7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:22.540267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-33393e07-017a-4acd-a5bd-eaaff6ed3bc7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:22.548241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-33393e07-017a-4acd-a5bd-eaaff6ed3bc7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:22.549741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-33393e07-017a-4acd-a5bd-eaaff6ed3bc7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:22.550894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-33393e07-017a-4acd-a5bd-eaaff6ed3bc7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.150815 May 12 06:54:22.551457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 190/391] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:22 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:22.591475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-10248776-fcee-4180-b987-dd9a24b8a609 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:22.592132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-10248776-fcee-4180-b987-dd9a24b8a609 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:22.598440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10248776-fcee-4180-b987-dd9a24b8a609 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:22.598887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10248776-fcee-4180-b987-dd9a24b8a609 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:22.599725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10248776-fcee-4180-b987-dd9a24b8a609 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:22.600153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10248776-fcee-4180-b987-dd9a24b8a609 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:22.723109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-10248776-fcee-4180-b987-dd9a24b8a609 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:22.730714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-10248776-fcee-4180-b987-dd9a24b8a609 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1709 microversion: 2.1 time: 0.143059 May 12 06:54:22.731278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 202/392] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:22 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1709 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:23.059738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-35bad46d-8f15-41f5-873a-290b4f063f79 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:23.060357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-35bad46d-8f15-41f5-873a-290b4f063f79 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:23.067023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35bad46d-8f15-41f5-873a-290b4f063f79 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:23.068621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35bad46d-8f15-41f5-873a-290b4f063f79 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:23.068621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35bad46d-8f15-41f5-873a-290b4f063f79 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:23.068824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35bad46d-8f15-41f5-873a-290b4f063f79 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:23.200123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-35bad46d-8f15-41f5-873a-290b4f063f79 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:23.207589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-35bad46d-8f15-41f5-873a-290b4f063f79 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.151616 May 12 06:54:23.208072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 191/393] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:23 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:23.570032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-545a2f28-470c-43db-bd3c-d2273c4b9252 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:23.570724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-545a2f28-470c-43db-bd3c-d2273c4b9252 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:23.577222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-545a2f28-470c-43db-bd3c-d2273c4b9252 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:23.577805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-545a2f28-470c-43db-bd3c-d2273c4b9252 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:23.578800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-545a2f28-470c-43db-bd3c-d2273c4b9252 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:23.579438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-545a2f28-470c-43db-bd3c-d2273c4b9252 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:23.727519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-545a2f28-470c-43db-bd3c-d2273c4b9252 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:23.735713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-545a2f28-470c-43db-bd3c-d2273c4b9252 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:23.737356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-545a2f28-470c-43db-bd3c-d2273c4b9252 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:23.738596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-545a2f28-470c-43db-bd3c-d2273c4b9252 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.173423 May 12 06:54:23.739263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 203/394] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:23 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:23.747523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-04a55a1c-6f35-4152-8402-0e3ce6c6f473 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:23.753793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-04a55a1c-6f35-4152-8402-0e3ce6c6f473 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:23.754726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a55a1c-6f35-4152-8402-0e3ce6c6f473 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:23.755361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a55a1c-6f35-4152-8402-0e3ce6c6f473 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:23.756905 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a55a1c-6f35-4152-8402-0e3ce6c6f473 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:23.757521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a55a1c-6f35-4152-8402-0e3ce6c6f473 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:23.885605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-04a55a1c-6f35-4152-8402-0e3ce6c6f473 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:23.893333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-04a55a1c-6f35-4152-8402-0e3ce6c6f473 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1709 microversion: 2.1 time: 0.149781 May 12 06:54:23.893887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 192/395] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:23 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:24.223886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e59fecb2-8d54-4450-92a5-9d2a4d9aed06 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:24.224502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e59fecb2-8d54-4450-92a5-9d2a4d9aed06 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:24.230765 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e59fecb2-8d54-4450-92a5-9d2a4d9aed06 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:24.231207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e59fecb2-8d54-4450-92a5-9d2a4d9aed06 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:24.232053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e59fecb2-8d54-4450-92a5-9d2a4d9aed06 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:24.232487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e59fecb2-8d54-4450-92a5-9d2a4d9aed06 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:24.362449 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e59fecb2-8d54-4450-92a5-9d2a4d9aed06 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:24.370275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e59fecb2-8d54-4450-92a5-9d2a4d9aed06 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.149925 May 12 06:54:24.372682 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 204/396] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:24 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:24.756920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b7e30538-e9fc-4337-aef3-fe59aeecec5a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:24.758136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b7e30538-e9fc-4337-aef3-fe59aeecec5a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:24.764357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7e30538-e9fc-4337-aef3-fe59aeecec5a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:24.764808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7e30538-e9fc-4337-aef3-fe59aeecec5a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:24.765616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7e30538-e9fc-4337-aef3-fe59aeecec5a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:24.766463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7e30538-e9fc-4337-aef3-fe59aeecec5a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:24.901302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b7e30538-e9fc-4337-aef3-fe59aeecec5a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:24.910387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3426e1cd-4c08-426d-9285-3c377de96ee7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:24.910912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3426e1cd-4c08-426d-9285-3c377de96ee7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:24.919671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b7e30538-e9fc-4337-aef3-fe59aeecec5a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:24.923078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3426e1cd-4c08-426d-9285-3c377de96ee7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:24.923527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3426e1cd-4c08-426d-9285-3c377de96ee7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:24.924332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3426e1cd-4c08-426d-9285-3c377de96ee7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:24.924796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3426e1cd-4c08-426d-9285-3c377de96ee7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:24.929372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b7e30538-e9fc-4337-aef3-fe59aeecec5a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:24.930543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b7e30538-e9fc-4337-aef3-fe59aeecec5a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.177646 May 12 06:54:24.931108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 193/397] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:24 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:54:25.072560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3426e1cd-4c08-426d-9285-3c377de96ee7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:25.081689 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3426e1cd-4c08-426d-9285-3c377de96ee7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1713 microversion: 2.1 time: 0.175312 May 12 06:54:25.083196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 205/398] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:24 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1713 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:25.387516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4b479a42-57a2-46d9-9b96-a951b56df6ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:25.388316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4b479a42-57a2-46d9-9b96-a951b56df6ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:25.401467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b479a42-57a2-46d9-9b96-a951b56df6ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:25.402974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b479a42-57a2-46d9-9b96-a951b56df6ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:25.404424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b479a42-57a2-46d9-9b96-a951b56df6ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:25.406086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b479a42-57a2-46d9-9b96-a951b56df6ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:25.531661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-005cbb73-b9d2-43bb-a019-6c1403143fe0 req-06cb3602-461f-4deb-a66a-e1843e655a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0fa87a-f20f-489f-b64c-04073a58a792", "name": "network-vif-plugged", "status": "completed", "tag": "bbe011a7-6d2c-4588-95a8-e8d354355950"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:25.543027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-005cbb73-b9d2-43bb-a019-6c1403143fe0 req-06cb3602-461f-4deb-a66a-e1843e655a91 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:25.543735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-005cbb73-b9d2-43bb-a019-6c1403143fe0 req-06cb3602-461f-4deb-a66a-e1843e655a91 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:25.556762 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-005cbb73-b9d2-43bb-a019-6c1403143fe0 req-06cb3602-461f-4deb-a66a-e1843e655a91 service nova] Creating event network-vif-plugged:bbe011a7-6d2c-4588-95a8-e8d354355950 for instance 0f0fa87a-f20f-489f-b64c-04073a58a792 on hv-cinder-76606 May 12 06:54:25.562427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-005cbb73-b9d2-43bb-a019-6c1403143fe0 req-06cb3602-461f-4deb-a66a-e1843e655a91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034451 May 12 06:54:25.563226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 206/399] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:25.650452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4b479a42-57a2-46d9-9b96-a951b56df6ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:25.660501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4b479a42-57a2-46d9-9b96-a951b56df6ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.276592 May 12 06:54:25.661729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 194/400] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:25 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:25.950067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-54f0ad29-0ce8-4c85-84bd-e49732e14101 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:25.950659 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-54f0ad29-0ce8-4c85-84bd-e49732e14101 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:25.958037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54f0ad29-0ce8-4c85-84bd-e49732e14101 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:25.958826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54f0ad29-0ce8-4c85-84bd-e49732e14101 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:25.960907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54f0ad29-0ce8-4c85-84bd-e49732e14101 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:25.961464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54f0ad29-0ce8-4c85-84bd-e49732e14101 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:26.110864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-54f0ad29-0ce8-4c85-84bd-e49732e14101 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:26.126664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-54f0ad29-0ce8-4c85-84bd-e49732e14101 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:26.128355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-54f0ad29-0ce8-4c85-84bd-e49732e14101 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:26.130046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-54f0ad29-0ce8-4c85-84bd-e49732e14101 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.184760 May 12 06:54:26.142565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 207/401] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:25 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:26.682017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-67c577b6-5cbf-4b28-930b-8d6a511af7f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:26.683542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-67c577b6-5cbf-4b28-930b-8d6a511af7f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:26.690394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-67c577b6-5cbf-4b28-930b-8d6a511af7f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:26.691134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-67c577b6-5cbf-4b28-930b-8d6a511af7f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:26.692128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-67c577b6-5cbf-4b28-930b-8d6a511af7f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:26.692714 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-67c577b6-5cbf-4b28-930b-8d6a511af7f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:26.869631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-67c577b6-5cbf-4b28-930b-8d6a511af7f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:26.879058 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-67c577b6-5cbf-4b28-930b-8d6a511af7f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.200882 May 12 06:54:26.879950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 195/402] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:26 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:27.150229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-00e25b91-5f2c-4e00-a282-c17754ffa5dd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:27.150954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-00e25b91-5f2c-4e00-a282-c17754ffa5dd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:27.156952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00e25b91-5f2c-4e00-a282-c17754ffa5dd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:27.157463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00e25b91-5f2c-4e00-a282-c17754ffa5dd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:27.158238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00e25b91-5f2c-4e00-a282-c17754ffa5dd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:27.158860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00e25b91-5f2c-4e00-a282-c17754ffa5dd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:27.299743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-00e25b91-5f2c-4e00-a282-c17754ffa5dd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:27.309298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-00e25b91-5f2c-4e00-a282-c17754ffa5dd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:27.311140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-00e25b91-5f2c-4e00-a282-c17754ffa5dd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:27.312731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-00e25b91-5f2c-4e00-a282-c17754ffa5dd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.166533 May 12 06:54:27.313526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 208/403] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:27 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:27.902146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3b6f9f6d-80e5-4a36-b258-4e5c78ad7d2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:27.902944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3b6f9f6d-80e5-4a36-b258-4e5c78ad7d2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:27.911122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b6f9f6d-80e5-4a36-b258-4e5c78ad7d2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:27.911799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b6f9f6d-80e5-4a36-b258-4e5c78ad7d2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:27.912884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b6f9f6d-80e5-4a36-b258-4e5c78ad7d2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:27.913325 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b6f9f6d-80e5-4a36-b258-4e5c78ad7d2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:28.098420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3b6f9f6d-80e5-4a36-b258-4e5c78ad7d2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:28.107376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3b6f9f6d-80e5-4a36-b258-4e5c78ad7d2d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1260 microversion: 2.1 time: 0.214394 May 12 06:54:28.111951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 196/404] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:27 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:28.339657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-de84f4f7-85d4-4a0b-8e7a-d0b4dc3fcabf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:28.340351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-de84f4f7-85d4-4a0b-8e7a-d0b4dc3fcabf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:28.346969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de84f4f7-85d4-4a0b-8e7a-d0b4dc3fcabf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:28.347413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de84f4f7-85d4-4a0b-8e7a-d0b4dc3fcabf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:28.348204 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de84f4f7-85d4-4a0b-8e7a-d0b4dc3fcabf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:28.348637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de84f4f7-85d4-4a0b-8e7a-d0b4dc3fcabf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:28.482654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de84f4f7-85d4-4a0b-8e7a-d0b4dc3fcabf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:28.491937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de84f4f7-85d4-4a0b-8e7a-d0b4dc3fcabf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:28.493770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de84f4f7-85d4-4a0b-8e7a-d0b4dc3fcabf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:28.494923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-de84f4f7-85d4-4a0b-8e7a-d0b4dc3fcabf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.159737 May 12 06:54:28.495504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 209/405] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:28 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:29.125442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-012189c6-9033-4d78-a912-fb8202261fcb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:29.126126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-012189c6-9033-4d78-a912-fb8202261fcb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:29.132668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-012189c6-9033-4d78-a912-fb8202261fcb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:29.133211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-012189c6-9033-4d78-a912-fb8202261fcb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:29.134087 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-012189c6-9033-4d78-a912-fb8202261fcb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:29.134626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-012189c6-9033-4d78-a912-fb8202261fcb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:29.326245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-012189c6-9033-4d78-a912-fb8202261fcb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:29.345681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-012189c6-9033-4d78-a912-fb8202261fcb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1444 microversion: 2.1 time: 0.216186 May 12 06:54:29.345681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 197/406] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:29 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1444 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:29.360645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-30ec1227-bbde-4556-97a6-bdf2b2504868 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:29.362656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-30ec1227-bbde-4556-97a6-bdf2b2504868 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:29.369717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-30ec1227-bbde-4556-97a6-bdf2b2504868 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:29.370415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-30ec1227-bbde-4556-97a6-bdf2b2504868 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:29.371453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-30ec1227-bbde-4556-97a6-bdf2b2504868 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:29.372347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-30ec1227-bbde-4556-97a6-bdf2b2504868 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:29.514803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c423818f-a8d3-43ae-bb17-7ced318b5182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:29.515522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c423818f-a8d3-43ae-bb17-7ced318b5182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:29.526054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c423818f-a8d3-43ae-bb17-7ced318b5182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:29.526703 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c423818f-a8d3-43ae-bb17-7ced318b5182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:29.529397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c423818f-a8d3-43ae-bb17-7ced318b5182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:29.530216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c423818f-a8d3-43ae-bb17-7ced318b5182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:29.560613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-30ec1227-bbde-4556-97a6-bdf2b2504868 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:29.571023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-30ec1227-bbde-4556-97a6-bdf2b2504868 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1444 microversion: 2.1 time: 0.213973 May 12 06:54:29.579889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 210/407] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:29 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1444 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:29.707488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c423818f-a8d3-43ae-bb17-7ced318b5182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:29.716944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c423818f-a8d3-43ae-bb17-7ced318b5182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:29.718888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c423818f-a8d3-43ae-bb17-7ced318b5182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:29.720477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c423818f-a8d3-43ae-bb17-7ced318b5182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.210338 May 12 06:54:29.721254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 198/408] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:29 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:54:30.742340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-47eb7d97-37b8-43dc-bc89-5bbba3f13d24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:30.743104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-47eb7d97-37b8-43dc-bc89-5bbba3f13d24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:30.755968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-47eb7d97-37b8-43dc-bc89-5bbba3f13d24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:30.756642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-47eb7d97-37b8-43dc-bc89-5bbba3f13d24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:30.757447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-47eb7d97-37b8-43dc-bc89-5bbba3f13d24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:30.757891 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-47eb7d97-37b8-43dc-bc89-5bbba3f13d24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:30.999410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-47eb7d97-37b8-43dc-bc89-5bbba3f13d24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:31.013888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-47eb7d97-37b8-43dc-bc89-5bbba3f13d24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:31.015757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-47eb7d97-37b8-43dc-bc89-5bbba3f13d24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:31.017261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-47eb7d97-37b8-43dc-bc89-5bbba3f13d24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.281552 May 12 06:54:31.018129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 211/409] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:30 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:32.038490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e8a90882-18f5-4f52-a3f3-9b3bdde6c4f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:32.039774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e8a90882-18f5-4f52-a3f3-9b3bdde6c4f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:32.046169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8a90882-18f5-4f52-a3f3-9b3bdde6c4f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:32.046708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8a90882-18f5-4f52-a3f3-9b3bdde6c4f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:32.047602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8a90882-18f5-4f52-a3f3-9b3bdde6c4f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:32.048158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8a90882-18f5-4f52-a3f3-9b3bdde6c4f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:32.259407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e8a90882-18f5-4f52-a3f3-9b3bdde6c4f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:32.270500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e8a90882-18f5-4f52-a3f3-9b3bdde6c4f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:32.272616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e8a90882-18f5-4f52-a3f3-9b3bdde6c4f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:32.274385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e8a90882-18f5-4f52-a3f3-9b3bdde6c4f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.241886 May 12 06:54:32.286545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 199/410] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:32 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:32.400333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-e017b6fe-015a-4080-a381-0c59829f2c1b req-42040bf0-6fda-4778-8e81-ea74730035c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0fa87a-f20f-489f-b64c-04073a58a792", "tag": "bbe011a7-6d2c-4588-95a8-e8d354355950"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:32.413081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-e017b6fe-015a-4080-a381-0c59829f2c1b req-42040bf0-6fda-4778-8e81-ea74730035c4 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:32.413875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-e017b6fe-015a-4080-a381-0c59829f2c1b req-42040bf0-6fda-4778-8e81-ea74730035c4 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:32.428649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-e017b6fe-015a-4080-a381-0c59829f2c1b req-42040bf0-6fda-4778-8e81-ea74730035c4 service nova] Creating event network-changed:bbe011a7-6d2c-4588-95a8-e8d354355950 for instance 0f0fa87a-f20f-489f-b64c-04073a58a792 on hv-cinder-76606 May 12 06:54:32.434684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-e017b6fe-015a-4080-a381-0c59829f2c1b req-42040bf0-6fda-4778-8e81-ea74730035c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038115 May 12 06:54:32.436232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 212/411] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:33.297341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7bfbb639-3daf-441b-b965-436030b1e280 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:33.298070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7bfbb639-3daf-441b-b965-436030b1e280 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:33.305126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bfbb639-3daf-441b-b965-436030b1e280 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:33.305660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bfbb639-3daf-441b-b965-436030b1e280 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:33.306530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bfbb639-3daf-441b-b965-436030b1e280 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:33.306976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bfbb639-3daf-441b-b965-436030b1e280 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:33.480642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7bfbb639-3daf-441b-b965-436030b1e280 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:33.493351 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7bfbb639-3daf-441b-b965-436030b1e280 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:33.495803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7bfbb639-3daf-441b-b965-436030b1e280 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:33.498025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7bfbb639-3daf-441b-b965-436030b1e280 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.207267 May 12 06:54:33.510599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 200/412] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:33 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:34.526154 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aa6f9f76-ad70-4f38-ad3e-12379e06a1f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:34.527718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-aa6f9f76-ad70-4f38-ad3e-12379e06a1f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:34.534632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa6f9f76-ad70-4f38-ad3e-12379e06a1f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:34.542219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa6f9f76-ad70-4f38-ad3e-12379e06a1f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:34.542219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa6f9f76-ad70-4f38-ad3e-12379e06a1f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:34.542219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa6f9f76-ad70-4f38-ad3e-12379e06a1f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:34.722892 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-aa6f9f76-ad70-4f38-ad3e-12379e06a1f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:34.734806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-aa6f9f76-ad70-4f38-ad3e-12379e06a1f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:34.735896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-aa6f9f76-ad70-4f38-ad3e-12379e06a1f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:34.737392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aa6f9f76-ad70-4f38-ad3e-12379e06a1f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.222601 May 12 06:54:34.738515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 213/413] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:34 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:35.758852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0dc4aa78-2116-47cb-a7f0-ccfee6e5d188 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:35.759836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0dc4aa78-2116-47cb-a7f0-ccfee6e5d188 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:35.766892 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dc4aa78-2116-47cb-a7f0-ccfee6e5d188 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:35.767614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dc4aa78-2116-47cb-a7f0-ccfee6e5d188 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:35.770684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dc4aa78-2116-47cb-a7f0-ccfee6e5d188 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:35.771266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dc4aa78-2116-47cb-a7f0-ccfee6e5d188 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:35.949314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0dc4aa78-2116-47cb-a7f0-ccfee6e5d188 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:35.976232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0dc4aa78-2116-47cb-a7f0-ccfee6e5d188 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:35.976232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0dc4aa78-2116-47cb-a7f0-ccfee6e5d188 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:35.976232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0dc4aa78-2116-47cb-a7f0-ccfee6e5d188 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.217895 May 12 06:54:35.976556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 201/414] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:35 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:36.993605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1e738832-6029-4e9d-b161-87013b4ec5a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:36.994223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1e738832-6029-4e9d-b161-87013b4ec5a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:37.009577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e738832-6029-4e9d-b161-87013b4ec5a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:37.010034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e738832-6029-4e9d-b161-87013b4ec5a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:37.010996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e738832-6029-4e9d-b161-87013b4ec5a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:37.011278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e738832-6029-4e9d-b161-87013b4ec5a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:37.545094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1e738832-6029-4e9d-b161-87013b4ec5a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:37.557100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1e738832-6029-4e9d-b161-87013b4ec5a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:37.559889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1e738832-6029-4e9d-b161-87013b4ec5a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:37.561398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1e738832-6029-4e9d-b161-87013b4ec5a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.572331 May 12 06:54:37.562132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 214/415] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:36 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:38.579814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-87491b33-cc77-4d71-a521-a86983b29118 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:38.580428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-87491b33-cc77-4d71-a521-a86983b29118 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:38.588062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87491b33-cc77-4d71-a521-a86983b29118 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:38.588730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87491b33-cc77-4d71-a521-a86983b29118 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:38.589666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87491b33-cc77-4d71-a521-a86983b29118 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:38.590271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87491b33-cc77-4d71-a521-a86983b29118 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:38.737261 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-87491b33-cc77-4d71-a521-a86983b29118 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:38.745937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-87491b33-cc77-4d71-a521-a86983b29118 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:38.747921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-87491b33-cc77-4d71-a521-a86983b29118 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:38.749305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-87491b33-cc77-4d71-a521-a86983b29118 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.173486 May 12 06:54:38.750362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 202/416] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:38 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:39.772237 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-51623ec8-505e-4dbc-82f1-58f77e674996 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:39.773347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-51623ec8-505e-4dbc-82f1-58f77e674996 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:39.781103 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51623ec8-505e-4dbc-82f1-58f77e674996 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:39.781921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51623ec8-505e-4dbc-82f1-58f77e674996 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:39.782926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51623ec8-505e-4dbc-82f1-58f77e674996 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:39.783597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51623ec8-505e-4dbc-82f1-58f77e674996 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:39.922866 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-51623ec8-505e-4dbc-82f1-58f77e674996 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:39.936731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-51623ec8-505e-4dbc-82f1-58f77e674996 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:39.940330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-51623ec8-505e-4dbc-82f1-58f77e674996 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:39.942156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-51623ec8-505e-4dbc-82f1-58f77e674996 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1722 microversion: 2.20 time: 0.173876 May 12 06:54:39.942861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 215/417] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:39 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:40.138907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-103784513", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "networks": [{"uuid": "973f5621-bf66-4578-9295-4e6ff69b4b81"}]}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:40.199246 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.network.neutron [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] validate_networks() for [('973f5621-bf66-4578-9295-4e6ff69b4b81', None, None, None, None, None)] {{(pid=124024) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:54:40.585032 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Flavor limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:54:40.585385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Image limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:54:40.585839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Flavor pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:54:40.586674 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Image pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:54:40.587257 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:54:40.607967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:40.608421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:40.609229 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:40.609664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:40.627539 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Getting quotas for project ff1faa1fff1642a0b9c78bc88800cbd4. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:54:40.632217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Getting quotas for user e392ce5fe3514e7996676d8bcd5cceb2 and project ff1faa1fff1642a0b9c78bc88800cbd4. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:54:40.644239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Going to run 1 instances... {{(pid=124024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:54:40.646569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:54:40.768731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-52c1c0ef-6f62-4867-a79a-08366c9a34ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634241 May 12 06:54:40.769655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 203/418] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 06:54:40.780135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-decc7b76-5679-4354-bd5f-223a0a112c56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:40.781329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-decc7b76-5679-4354-bd5f-223a0a112c56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:40.856917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-decc7b76-5679-4354-bd5f-223a0a112c56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:40.871889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-decc7b76-5679-4354-bd5f-223a0a112c56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1218 microversion: 2.1 time: 0.095445 May 12 06:54:40.873546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 216/419] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:40 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:40.968093 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-eb9ac089-6241-43c7-8051-ce2543ff41c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:40.970355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-eb9ac089-6241-43c7-8051-ce2543ff41c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:40.977158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb9ac089-6241-43c7-8051-ce2543ff41c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:40.977873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb9ac089-6241-43c7-8051-ce2543ff41c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:40.978906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb9ac089-6241-43c7-8051-ce2543ff41c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:40.979443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb9ac089-6241-43c7-8051-ce2543ff41c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:41.132796 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eb9ac089-6241-43c7-8051-ce2543ff41c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:41.144001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eb9ac089-6241-43c7-8051-ce2543ff41c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:41.147522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eb9ac089-6241-43c7-8051-ce2543ff41c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:41.150559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-eb9ac089-6241-43c7-8051-ce2543ff41c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1743 microversion: 2.20 time: 0.192346 May 12 06:54:41.150559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 204/420] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:40 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:54:41.889088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e35cf3dc-4863-442a-b13f-5bb8307b8ecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:41.890378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e35cf3dc-4863-442a-b13f-5bb8307b8ecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:41.981152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e35cf3dc-4863-442a-b13f-5bb8307b8ecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:41.988620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e35cf3dc-4863-442a-b13f-5bb8307b8ecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1218 microversion: 2.1 time: 0.103370 May 12 06:54:41.989734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 217/421] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:41 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:42.171215 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ac72fd1e-d5da-485d-b500-66bc9dc28d97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:42.171862 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ac72fd1e-d5da-485d-b500-66bc9dc28d97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:42.178570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ac72fd1e-d5da-485d-b500-66bc9dc28d97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:42.179225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ac72fd1e-d5da-485d-b500-66bc9dc28d97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:42.180235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ac72fd1e-d5da-485d-b500-66bc9dc28d97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:42.180829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ac72fd1e-d5da-485d-b500-66bc9dc28d97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:42.333033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ac72fd1e-d5da-485d-b500-66bc9dc28d97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:42.341291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ac72fd1e-d5da-485d-b500-66bc9dc28d97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:42.342892 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ac72fd1e-d5da-485d-b500-66bc9dc28d97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:42.344154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ac72fd1e-d5da-485d-b500-66bc9dc28d97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1743 microversion: 2.20 time: 0.177124 May 12 06:54:42.344793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 205/422] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:42 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:43.005880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f3433864-8544-4f38-9d02-5e2332de7133 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:43.007031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f3433864-8544-4f38-9d02-5e2332de7133 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:43.013376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f3433864-8544-4f38-9d02-5e2332de7133 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:43.013899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f3433864-8544-4f38-9d02-5e2332de7133 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:43.014683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f3433864-8544-4f38-9d02-5e2332de7133 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:43.015118 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f3433864-8544-4f38-9d02-5e2332de7133 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:43.076502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f3433864-8544-4f38-9d02-5e2332de7133 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:43.083669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f3433864-8544-4f38-9d02-5e2332de7133 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1270 microversion: 2.1 time: 0.081796 May 12 06:54:43.084251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 218/423] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:43 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:43.362314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7a32e453-7fbb-4669-9d27-aa8264225499 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:43.362920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7a32e453-7fbb-4669-9d27-aa8264225499 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:43.370067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a32e453-7fbb-4669-9d27-aa8264225499 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:43.370512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a32e453-7fbb-4669-9d27-aa8264225499 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:43.371280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a32e453-7fbb-4669-9d27-aa8264225499 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:43.371732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a32e453-7fbb-4669-9d27-aa8264225499 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:43.498500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7a32e453-7fbb-4669-9d27-aa8264225499 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:43.506256 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7a32e453-7fbb-4669-9d27-aa8264225499 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:43.507790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7a32e453-7fbb-4669-9d27-aa8264225499 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:43.508998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7a32e453-7fbb-4669-9d27-aa8264225499 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1743 microversion: 2.20 time: 0.150480 May 12 06:54:43.509555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 206/424] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:43 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:44.100439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-39c50a49-ba99-4ff8-bcda-2cc1da66964b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:44.103211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-39c50a49-ba99-4ff8-bcda-2cc1da66964b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:44.109582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-39c50a49-ba99-4ff8-bcda-2cc1da66964b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:44.110033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-39c50a49-ba99-4ff8-bcda-2cc1da66964b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:44.110816 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-39c50a49-ba99-4ff8-bcda-2cc1da66964b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:44.111259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-39c50a49-ba99-4ff8-bcda-2cc1da66964b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:44.182832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-39c50a49-ba99-4ff8-bcda-2cc1da66964b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:44.190516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-39c50a49-ba99-4ff8-bcda-2cc1da66964b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1278 microversion: 2.1 time: 0.093936 May 12 06:54:44.191127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 219/425] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:44 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:44.527481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d8318244-4af5-49a1-a6bc-413c6354d71b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:44.528327 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d8318244-4af5-49a1-a6bc-413c6354d71b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:44.535373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d8318244-4af5-49a1-a6bc-413c6354d71b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:44.536038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d8318244-4af5-49a1-a6bc-413c6354d71b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:44.536921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d8318244-4af5-49a1-a6bc-413c6354d71b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:44.537462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d8318244-4af5-49a1-a6bc-413c6354d71b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:44.677068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d8318244-4af5-49a1-a6bc-413c6354d71b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:44.685578 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d8318244-4af5-49a1-a6bc-413c6354d71b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:44.687135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d8318244-4af5-49a1-a6bc-413c6354d71b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:44.688342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d8318244-4af5-49a1-a6bc-413c6354d71b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1743 microversion: 2.20 time: 0.165513 May 12 06:54:44.688899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 207/426] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:44 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:45.208003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a40038f8-244d-4795-927d-f9371af0a8ff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:45.208819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a40038f8-244d-4795-927d-f9371af0a8ff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:45.217040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a40038f8-244d-4795-927d-f9371af0a8ff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:45.217571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a40038f8-244d-4795-927d-f9371af0a8ff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:45.218607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a40038f8-244d-4795-927d-f9371af0a8ff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:45.219233 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a40038f8-244d-4795-927d-f9371af0a8ff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:45.386258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a40038f8-244d-4795-927d-f9371af0a8ff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:45.395555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a40038f8-244d-4795-927d-f9371af0a8ff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1318 microversion: 2.1 time: 0.191266 May 12 06:54:45.403846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 220/427] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:45 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:45.642535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-a6d084a2-3a76-431f-b8f1-8b31ba8645dc req-0c579d3d-2668-4e0d-9544-be06b9b4c9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30aa8f3-ada1-42f3-bb93-081f2552b4a3", "name": "network-vif-plugged", "status": "completed", "tag": "d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:45.652304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-a6d084a2-3a76-431f-b8f1-8b31ba8645dc req-0c579d3d-2668-4e0d-9544-be06b9b4c9ae service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:45.652775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-a6d084a2-3a76-431f-b8f1-8b31ba8645dc req-0c579d3d-2668-4e0d-9544-be06b9b4c9ae service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:45.664353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-a6d084a2-3a76-431f-b8f1-8b31ba8645dc req-0c579d3d-2668-4e0d-9544-be06b9b4c9ae service nova] Creating event network-vif-plugged:d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36 for instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 on hv-cinder-76606 May 12 06:54:45.670982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-a6d084a2-3a76-431f-b8f1-8b31ba8645dc req-0c579d3d-2668-4e0d-9544-be06b9b4c9ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032430 May 12 06:54:45.671676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 208/428] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:45.706633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2933e694-d020-40aa-8a2b-f1dc8ad31990 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:45.707248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2933e694-d020-40aa-8a2b-f1dc8ad31990 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:45.713836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2933e694-d020-40aa-8a2b-f1dc8ad31990 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:45.717465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2933e694-d020-40aa-8a2b-f1dc8ad31990 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:45.717465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2933e694-d020-40aa-8a2b-f1dc8ad31990 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:45.717465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2933e694-d020-40aa-8a2b-f1dc8ad31990 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:45.864493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2933e694-d020-40aa-8a2b-f1dc8ad31990 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:45.873535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2933e694-d020-40aa-8a2b-f1dc8ad31990 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:45.875388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2933e694-d020-40aa-8a2b-f1dc8ad31990 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:45.876657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2933e694-d020-40aa-8a2b-f1dc8ad31990 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1738 microversion: 2.20 time: 0.174135 May 12 06:54:45.877290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 221/429] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:45 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:45.917666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-55f40621-6960-44b2-b9fc-ef3785126835 req-c2247f5d-88f4-4539-852d-3e9f1a1cc05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ebfe3f-ca98-4256-96c2-2bdb6f5a838f", "tag": "263cd19a-6ce0-4caf-b2ff-5fc0bc9aeb45"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:45.925589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-55f40621-6960-44b2-b9fc-ef3785126835 req-c2247f5d-88f4-4539-852d-3e9f1a1cc05b service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:45.926048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-55f40621-6960-44b2-b9fc-ef3785126835 req-c2247f5d-88f4-4539-852d-3e9f1a1cc05b service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:45.937279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-55f40621-6960-44b2-b9fc-ef3785126835 req-c2247f5d-88f4-4539-852d-3e9f1a1cc05b service nova] Creating event network-changed:263cd19a-6ce0-4caf-b2ff-5fc0bc9aeb45 for instance 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f on hv-cinder-76606 May 12 06:54:45.941910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-55f40621-6960-44b2-b9fc-ef3785126835 req-c2247f5d-88f4-4539-852d-3e9f1a1cc05b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028956 May 12 06:54:45.942573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 209/430] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:54:46.414436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4b2092f7-5435-4b1b-af87-e2f062410884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:46.415365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4b2092f7-5435-4b1b-af87-e2f062410884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:46.422321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b2092f7-5435-4b1b-af87-e2f062410884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:46.422964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b2092f7-5435-4b1b-af87-e2f062410884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:46.423768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b2092f7-5435-4b1b-af87-e2f062410884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:46.425090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b2092f7-5435-4b1b-af87-e2f062410884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:46.585681 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4b2092f7-5435-4b1b-af87-e2f062410884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:46.595779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4b2092f7-5435-4b1b-af87-e2f062410884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1318 microversion: 2.1 time: 0.185053 May 12 06:54:46.596364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 222/431] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:46 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:54:46.895939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-69c5f64d-08bc-4d9a-8c89-7b8b8ae673e2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:46.896501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-69c5f64d-08bc-4d9a-8c89-7b8b8ae673e2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:46.908105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69c5f64d-08bc-4d9a-8c89-7b8b8ae673e2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:46.909283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69c5f64d-08bc-4d9a-8c89-7b8b8ae673e2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:46.910202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69c5f64d-08bc-4d9a-8c89-7b8b8ae673e2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:46.910719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69c5f64d-08bc-4d9a-8c89-7b8b8ae673e2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:47.097447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-69c5f64d-08bc-4d9a-8c89-7b8b8ae673e2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:47.106478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-69c5f64d-08bc-4d9a-8c89-7b8b8ae673e2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:47.108623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-69c5f64d-08bc-4d9a-8c89-7b8b8ae673e2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:47.110022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-69c5f64d-08bc-4d9a-8c89-7b8b8ae673e2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1738 microversion: 2.20 time: 0.218674 May 12 06:54:47.111496 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 210/432] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:46 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:47.612916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5b010860-b2aa-4853-a8a8-600545be54b2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:47.613812 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5b010860-b2aa-4853-a8a8-600545be54b2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:47.620718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b010860-b2aa-4853-a8a8-600545be54b2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:47.621463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b010860-b2aa-4853-a8a8-600545be54b2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:47.622329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b010860-b2aa-4853-a8a8-600545be54b2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:47.622929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b010860-b2aa-4853-a8a8-600545be54b2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:47.766483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5b010860-b2aa-4853-a8a8-600545be54b2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:47.775043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5b010860-b2aa-4853-a8a8-600545be54b2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1318 microversion: 2.1 time: 0.166331 May 12 06:54:47.775625 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 223/433] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:47 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:48.169203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cd6e54e5-ed7e-45fc-9a96-fd497fffc649 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:48.169203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cd6e54e5-ed7e-45fc-9a96-fd497fffc649 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:48.169203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd6e54e5-ed7e-45fc-9a96-fd497fffc649 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:48.169203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd6e54e5-ed7e-45fc-9a96-fd497fffc649 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:48.172189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd6e54e5-ed7e-45fc-9a96-fd497fffc649 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:48.172790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd6e54e5-ed7e-45fc-9a96-fd497fffc649 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:48.355042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cd6e54e5-ed7e-45fc-9a96-fd497fffc649 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:48.363876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cd6e54e5-ed7e-45fc-9a96-fd497fffc649 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:48.365659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cd6e54e5-ed7e-45fc-9a96-fd497fffc649 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:48.367609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cd6e54e5-ed7e-45fc-9a96-fd497fffc649 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1738 microversion: 2.20 time: 0.229229 May 12 06:54:48.368198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 211/434] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:48 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:48.792641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f23b45d4-cc17-443c-85df-aec64c070505 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:48.794818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f23b45d4-cc17-443c-85df-aec64c070505 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:48.799577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f23b45d4-cc17-443c-85df-aec64c070505 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:48.800057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f23b45d4-cc17-443c-85df-aec64c070505 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:48.800831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f23b45d4-cc17-443c-85df-aec64c070505 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:48.801269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f23b45d4-cc17-443c-85df-aec64c070505 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:48.936732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f23b45d4-cc17-443c-85df-aec64c070505 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:48.946188 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f23b45d4-cc17-443c-85df-aec64c070505 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1318 microversion: 2.1 time: 0.158087 May 12 06:54:48.946793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 224/435] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:48 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:49.386722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-88fe49ef-9f20-42da-8c37-c1c7ef424f66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:49.388109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-88fe49ef-9f20-42da-8c37-c1c7ef424f66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:49.395629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88fe49ef-9f20-42da-8c37-c1c7ef424f66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:49.396524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88fe49ef-9f20-42da-8c37-c1c7ef424f66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:49.397961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88fe49ef-9f20-42da-8c37-c1c7ef424f66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:49.398634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88fe49ef-9f20-42da-8c37-c1c7ef424f66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:49.549099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-88fe49ef-9f20-42da-8c37-c1c7ef424f66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:49.557555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-88fe49ef-9f20-42da-8c37-c1c7ef424f66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:49.559350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-88fe49ef-9f20-42da-8c37-c1c7ef424f66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:49.560704 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-88fe49ef-9f20-42da-8c37-c1c7ef424f66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1738 microversion: 2.20 time: 0.179044 May 12 06:54:49.573254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 212/436] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:49 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:54:49.968415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aaad9315-8e7c-4fa0-a931-325a7e26daca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:49.969036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-aaad9315-8e7c-4fa0-a931-325a7e26daca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:49.975677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aaad9315-8e7c-4fa0-a931-325a7e26daca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:49.976650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aaad9315-8e7c-4fa0-a931-325a7e26daca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:49.978204 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aaad9315-8e7c-4fa0-a931-325a7e26daca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:49.978645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aaad9315-8e7c-4fa0-a931-325a7e26daca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:50.157104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-aaad9315-8e7c-4fa0-a931-325a7e26daca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:50.164945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aaad9315-8e7c-4fa0-a931-325a7e26daca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1318 microversion: 2.1 time: 0.204635 May 12 06:54:50.176219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 225/437] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:49 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:50.578973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d91debff-76f6-4030-b119-f837c10d9246 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:50.579799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d91debff-76f6-4030-b119-f837c10d9246 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:50.586414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d91debff-76f6-4030-b119-f837c10d9246 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:50.586974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d91debff-76f6-4030-b119-f837c10d9246 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:50.588030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d91debff-76f6-4030-b119-f837c10d9246 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:50.588576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d91debff-76f6-4030-b119-f837c10d9246 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:50.728749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d91debff-76f6-4030-b119-f837c10d9246 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:50.737672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d91debff-76f6-4030-b119-f837c10d9246 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:50.739411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d91debff-76f6-4030-b119-f837c10d9246 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:50.740782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d91debff-76f6-4030-b119-f837c10d9246 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1738 microversion: 2.20 time: 0.165832 May 12 06:54:50.752260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 213/438] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:50 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:54:51.183319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8647a4d9-77b9-4951-819e-510fb2e86557 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:51.184847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8647a4d9-77b9-4951-819e-510fb2e86557 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:51.191793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8647a4d9-77b9-4951-819e-510fb2e86557 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:51.192226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8647a4d9-77b9-4951-819e-510fb2e86557 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:51.193116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8647a4d9-77b9-4951-819e-510fb2e86557 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:51.193563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8647a4d9-77b9-4951-819e-510fb2e86557 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:51.335662 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8647a4d9-77b9-4951-819e-510fb2e86557 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:51.344424 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8647a4d9-77b9-4951-819e-510fb2e86557 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1318 microversion: 2.1 time: 0.165582 May 12 06:54:51.345097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 226/439] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:51 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:51.529363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-cda449c8-299d-40a2-8c66-dc1b50f9bdf1 req-a0e9d9c2-8a28-4df0-9da0-cf477d7d02b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ebfe3f-ca98-4256-96c2-2bdb6f5a838f", "name": "network-vif-plugged", "status": "completed", "tag": "263cd19a-6ce0-4caf-b2ff-5fc0bc9aeb45"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:54:51.537746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-cda449c8-299d-40a2-8c66-dc1b50f9bdf1 req-a0e9d9c2-8a28-4df0-9da0-cf477d7d02b3 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:51.538193 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-cda449c8-299d-40a2-8c66-dc1b50f9bdf1 req-a0e9d9c2-8a28-4df0-9da0-cf477d7d02b3 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:51.550526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-cda449c8-299d-40a2-8c66-dc1b50f9bdf1 req-a0e9d9c2-8a28-4df0-9da0-cf477d7d02b3 service nova] Creating event network-vif-plugged:263cd19a-6ce0-4caf-b2ff-5fc0bc9aeb45 for instance 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f on hv-cinder-76606 May 12 06:54:51.556076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-cda449c8-299d-40a2-8c66-dc1b50f9bdf1 req-a0e9d9c2-8a28-4df0-9da0-cf477d7d02b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029868 May 12 06:54:51.557054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 214/440] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:54:51.759821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a3f6de5a-a9d7-4866-bc0e-64a3a17348f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:51.760436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a3f6de5a-a9d7-4866-bc0e-64a3a17348f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:51.766427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3f6de5a-a9d7-4866-bc0e-64a3a17348f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:51.766876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3f6de5a-a9d7-4866-bc0e-64a3a17348f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:51.767656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3f6de5a-a9d7-4866-bc0e-64a3a17348f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:51.768121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3f6de5a-a9d7-4866-bc0e-64a3a17348f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:51.896585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a3f6de5a-a9d7-4866-bc0e-64a3a17348f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:51.907971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a3f6de5a-a9d7-4866-bc0e-64a3a17348f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:51.909708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a3f6de5a-a9d7-4866-bc0e-64a3a17348f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:51.911385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a3f6de5a-a9d7-4866-bc0e-64a3a17348f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1738 microversion: 2.20 time: 0.155711 May 12 06:54:51.912170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 227/441] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:51 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:52.361389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-52340769-5857-4bdf-8b9f-d574e935b843 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:52.362091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-52340769-5857-4bdf-8b9f-d574e935b843 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:52.368675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52340769-5857-4bdf-8b9f-d574e935b843 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:52.369131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52340769-5857-4bdf-8b9f-d574e935b843 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:52.369900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52340769-5857-4bdf-8b9f-d574e935b843 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:52.370338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52340769-5857-4bdf-8b9f-d574e935b843 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:52.501246 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-52340769-5857-4bdf-8b9f-d574e935b843 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:52.509707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-52340769-5857-4bdf-8b9f-d574e935b843 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1318 microversion: 2.1 time: 0.152433 May 12 06:54:52.510514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 215/442] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:52 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:52.933065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6a675005-c910-4387-adb2-30eec9800691 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:52.934013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6a675005-c910-4387-adb2-30eec9800691 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:52.940837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6a675005-c910-4387-adb2-30eec9800691 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:52.941536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6a675005-c910-4387-adb2-30eec9800691 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:52.942551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6a675005-c910-4387-adb2-30eec9800691 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:52.943085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6a675005-c910-4387-adb2-30eec9800691 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:53.093522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6a675005-c910-4387-adb2-30eec9800691 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:53.103190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6a675005-c910-4387-adb2-30eec9800691 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:53.104960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6a675005-c910-4387-adb2-30eec9800691 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:53.106610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6a675005-c910-4387-adb2-30eec9800691 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1738 microversion: 2.20 time: 0.177379 May 12 06:54:53.112305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 228/443] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:52 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:53.526758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d1bd1507-3ed3-4f2c-8964-ee229e224fcb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:53.528022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d1bd1507-3ed3-4f2c-8964-ee229e224fcb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:53.538579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1bd1507-3ed3-4f2c-8964-ee229e224fcb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:53.539038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1bd1507-3ed3-4f2c-8964-ee229e224fcb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:53.540363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1bd1507-3ed3-4f2c-8964-ee229e224fcb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:53.540820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1bd1507-3ed3-4f2c-8964-ee229e224fcb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:53.682117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d1bd1507-3ed3-4f2c-8964-ee229e224fcb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:53.691997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d1bd1507-3ed3-4f2c-8964-ee229e224fcb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1318 microversion: 2.1 time: 0.169141 May 12 06:54:53.692762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 216/444] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:53 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:54.126414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9f342392-502c-48e8-a835-abef118f410a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:54.127068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9f342392-502c-48e8-a835-abef118f410a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:54.134412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f342392-502c-48e8-a835-abef118f410a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:54.134861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f342392-502c-48e8-a835-abef118f410a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:54.137143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f342392-502c-48e8-a835-abef118f410a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:54.137143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f342392-502c-48e8-a835-abef118f410a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:54.300293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9f342392-502c-48e8-a835-abef118f410a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:54.309666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9f342392-502c-48e8-a835-abef118f410a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:54.314703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9f342392-502c-48e8-a835-abef118f410a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:54.316373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9f342392-502c-48e8-a835-abef118f410a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1738 microversion: 2.20 time: 0.194696 May 12 06:54:54.317137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 229/445] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:54 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:54.709474 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bb7a40e3-2320-47d1-9746-5dcfce708a09 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:54.710008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bb7a40e3-2320-47d1-9746-5dcfce708a09 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:54.717884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb7a40e3-2320-47d1-9746-5dcfce708a09 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:54.718322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb7a40e3-2320-47d1-9746-5dcfce708a09 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:54.719092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb7a40e3-2320-47d1-9746-5dcfce708a09 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:54.719548 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb7a40e3-2320-47d1-9746-5dcfce708a09 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:54.861425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bb7a40e3-2320-47d1-9746-5dcfce708a09 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:54.870021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bb7a40e3-2320-47d1-9746-5dcfce708a09 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1508 microversion: 2.1 time: 0.164679 May 12 06:54:54.870634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 217/446] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:54:54 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:54:55.335963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-66c8e4bd-e1db-4781-aaae-cc71f0ee86e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:55.337277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-66c8e4bd-e1db-4781-aaae-cc71f0ee86e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:55.343883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66c8e4bd-e1db-4781-aaae-cc71f0ee86e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:55.349740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66c8e4bd-e1db-4781-aaae-cc71f0ee86e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:55.349740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66c8e4bd-e1db-4781-aaae-cc71f0ee86e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:55.349740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66c8e4bd-e1db-4781-aaae-cc71f0ee86e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:55.483190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-66c8e4bd-e1db-4781-aaae-cc71f0ee86e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:55.490888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-66c8e4bd-e1db-4781-aaae-cc71f0ee86e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:55.492436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-66c8e4bd-e1db-4781-aaae-cc71f0ee86e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:55.493595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-66c8e4bd-e1db-4781-aaae-cc71f0ee86e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1738 microversion: 2.20 time: 0.161580 May 12 06:54:55.494160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 230/447] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:55 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:56.512925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-36313575-e68d-4bbd-8386-3ad86ca2ed8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:56.513505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-36313575-e68d-4bbd-8386-3ad86ca2ed8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:56.519819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-36313575-e68d-4bbd-8386-3ad86ca2ed8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:56.520494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-36313575-e68d-4bbd-8386-3ad86ca2ed8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:56.521443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-36313575-e68d-4bbd-8386-3ad86ca2ed8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:56.521887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-36313575-e68d-4bbd-8386-3ad86ca2ed8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:56.653029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-36313575-e68d-4bbd-8386-3ad86ca2ed8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:56.661338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-36313575-e68d-4bbd-8386-3ad86ca2ed8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:56.662852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-36313575-e68d-4bbd-8386-3ad86ca2ed8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:56.664118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-36313575-e68d-4bbd-8386-3ad86ca2ed8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1738 microversion: 2.20 time: 0.155373 May 12 06:54:56.665270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 218/448] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:56 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:57.683898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5e0f9453-529f-44ab-9ea3-c59dfbeec081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:57.684615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5e0f9453-529f-44ab-9ea3-c59dfbeec081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:57.691229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e0f9453-529f-44ab-9ea3-c59dfbeec081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:57.691679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e0f9453-529f-44ab-9ea3-c59dfbeec081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:57.692481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e0f9453-529f-44ab-9ea3-c59dfbeec081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:57.692926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e0f9453-529f-44ab-9ea3-c59dfbeec081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:57.825263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5e0f9453-529f-44ab-9ea3-c59dfbeec081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:57.833142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5e0f9453-529f-44ab-9ea3-c59dfbeec081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:57.834681 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5e0f9453-529f-44ab-9ea3-c59dfbeec081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:57.835863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5e0f9453-529f-44ab-9ea3-c59dfbeec081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1720 microversion: 2.20 time: 0.156443 May 12 06:54:57.836470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 231/449] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:57 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:54:58.855359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dca75c23-1c16-483f-8564-3a491466d1af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:54:58.855907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dca75c23-1c16-483f-8564-3a491466d1af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:54:58.862130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dca75c23-1c16-483f-8564-3a491466d1af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:58.862572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dca75c23-1c16-483f-8564-3a491466d1af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:58.863329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dca75c23-1c16-483f-8564-3a491466d1af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:54:58.863794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dca75c23-1c16-483f-8564-3a491466d1af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:54:58.999109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dca75c23-1c16-483f-8564-3a491466d1af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:59.006969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dca75c23-1c16-483f-8564-3a491466d1af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:59.008568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dca75c23-1c16-483f-8564-3a491466d1af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:54:59.009710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dca75c23-1c16-483f-8564-3a491466d1af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1720 microversion: 2.20 time: 0.158981 May 12 06:54:59.010258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 219/450] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:54:58 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:00.028493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3490c8cc-7f72-4cb5-8bed-2a43c758149c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:00.029133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3490c8cc-7f72-4cb5-8bed-2a43c758149c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:00.035477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3490c8cc-7f72-4cb5-8bed-2a43c758149c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:00.035966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3490c8cc-7f72-4cb5-8bed-2a43c758149c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:00.036734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3490c8cc-7f72-4cb5-8bed-2a43c758149c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:00.037172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3490c8cc-7f72-4cb5-8bed-2a43c758149c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:00.165522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3490c8cc-7f72-4cb5-8bed-2a43c758149c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:00.173541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3490c8cc-7f72-4cb5-8bed-2a43c758149c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:00.175083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3490c8cc-7f72-4cb5-8bed-2a43c758149c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:00.176247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3490c8cc-7f72-4cb5-8bed-2a43c758149c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1720 microversion: 2.20 time: 0.151665 May 12 06:55:00.176806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 232/451] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:00 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:01.194645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9d0fbb50-28ff-4625-acb9-5c4d921e64d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:01.195287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9d0fbb50-28ff-4625-acb9-5c4d921e64d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:01.201302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d0fbb50-28ff-4625-acb9-5c4d921e64d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:01.201742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d0fbb50-28ff-4625-acb9-5c4d921e64d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:01.202538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d0fbb50-28ff-4625-acb9-5c4d921e64d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:01.202974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d0fbb50-28ff-4625-acb9-5c4d921e64d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:01.336475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9d0fbb50-28ff-4625-acb9-5c4d921e64d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:01.344561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9d0fbb50-28ff-4625-acb9-5c4d921e64d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:01.346127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9d0fbb50-28ff-4625-acb9-5c4d921e64d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:01.347326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9d0fbb50-28ff-4625-acb9-5c4d921e64d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1723 microversion: 2.20 time: 0.156945 May 12 06:55:01.348025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 220/452] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:01 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:01.365490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7ee422ba-0c23-4bcf-99bd-24b364191098 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0a6390b-f839-4178-bd7c-8adf4be85e75"}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:55:01.366614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7ee422ba-0c23-4bcf-99bd-24b364191098 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:01.373556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ee422ba-0c23-4bcf-99bd-24b364191098 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:01.374058 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ee422ba-0c23-4bcf-99bd-24b364191098 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:01.374871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ee422ba-0c23-4bcf-99bd-24b364191098 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:01.375313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ee422ba-0c23-4bcf-99bd-24b364191098 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:01.430451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-4aba45c9-bf13-4340-a6fc-9bc80a0631e2 req-ffe1d4bd-f8b3-4ff7-8df5-6286d6276d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30aa8f3-ada1-42f3-bb93-081f2552b4a3", "name": "network-vif-unplugged", "status": "completed", "tag": "d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:55:01.438869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-4aba45c9-bf13-4340-a6fc-9bc80a0631e2 req-ffe1d4bd-f8b3-4ff7-8df5-6286d6276d66 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:01.439378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-4aba45c9-bf13-4340-a6fc-9bc80a0631e2 req-ffe1d4bd-f8b3-4ff7-8df5-6286d6276d66 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:01.453576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.compute.server_external_events [req-4aba45c9-bf13-4340-a6fc-9bc80a0631e2 req-ffe1d4bd-f8b3-4ff7-8df5-6286d6276d66 service nova] Unable to find a host for instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3. Dropping event network-vif-unplugged {{(pid=124024) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 12 06:55:01.454609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-4aba45c9-bf13-4340-a6fc-9bc80a0631e2 req-ffe1d4bd-f8b3-4ff7-8df5-6286d6276d66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029035 May 12 06:55:01.455274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 221/453] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 12 06:55:02.456517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7ee422ba-0c23-4bcf-99bd-24b364191098 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "POST /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.094898 May 12 06:55:02.457241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 233/454] 10.222.0.25 () {62 vars in 1363 bytes} [Thu May 12 06:55:01 2022] POST /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 188 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:55:02.569243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-11da959e-d5ff-41ab-904b-8156875424f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:55:02.569925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-11da959e-d5ff-41ab-904b-8156875424f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:02.577473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-11da959e-d5ff-41ab-904b-8156875424f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:02.577953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-11da959e-d5ff-41ab-904b-8156875424f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:02.578731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-11da959e-d5ff-41ab-904b-8156875424f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:02.579196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-11da959e-d5ff-41ab-904b-8156875424f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:02.824621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-11da959e-d5ff-41ab-904b-8156875424f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "POST /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/action" status: 202 len: 0 microversion: 2.20 time: 0.260457 May 12 06:55:02.825247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 222/455] 10.222.0.25 () {62 vars in 1318 bytes} [Thu May 12 06:55:02 2022] POST /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 06:55:02.833817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-22bf562a-7c2a-433e-b83c-d7867966308d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:02.834445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-22bf562a-7c2a-433e-b83c-d7867966308d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:02.840515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22bf562a-7c2a-433e-b83c-d7867966308d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:02.840953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22bf562a-7c2a-433e-b83c-d7867966308d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:02.841728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22bf562a-7c2a-433e-b83c-d7867966308d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:02.842166 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22bf562a-7c2a-433e-b83c-d7867966308d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:02.973484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-22bf562a-7c2a-433e-b83c-d7867966308d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:02.982475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-22bf562a-7c2a-433e-b83c-d7867966308d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:02.984015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-22bf562a-7c2a-433e-b83c-d7867966308d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:02.985174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-22bf562a-7c2a-433e-b83c-d7867966308d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1749 microversion: 2.20 time: 0.155632 May 12 06:55:02.985728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 234/456] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:02 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:04.004985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2a056cdd-ca58-4bf4-b72c-c7c8d96cbf28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:04.005454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2a056cdd-ca58-4bf4-b72c-c7c8d96cbf28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:04.011811 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a056cdd-ca58-4bf4-b72c-c7c8d96cbf28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:04.012561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a056cdd-ca58-4bf4-b72c-c7c8d96cbf28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:04.013506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a056cdd-ca58-4bf4-b72c-c7c8d96cbf28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:04.013964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a056cdd-ca58-4bf4-b72c-c7c8d96cbf28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:04.147206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2a056cdd-ca58-4bf4-b72c-c7c8d96cbf28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:04.157683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2a056cdd-ca58-4bf4-b72c-c7c8d96cbf28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:04.159214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2a056cdd-ca58-4bf4-b72c-c7c8d96cbf28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:04.160688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2a056cdd-ca58-4bf4-b72c-c7c8d96cbf28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1749 microversion: 2.20 time: 0.160885 May 12 06:55:04.161458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 223/457] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:05.181580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-92a99057-9d8f-4111-ab54-dee0dfb91160 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:05.182159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-92a99057-9d8f-4111-ab54-dee0dfb91160 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:05.188639 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92a99057-9d8f-4111-ab54-dee0dfb91160 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:05.189085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92a99057-9d8f-4111-ab54-dee0dfb91160 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:05.189883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92a99057-9d8f-4111-ab54-dee0dfb91160 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:05.190316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92a99057-9d8f-4111-ab54-dee0dfb91160 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:05.323041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-92a99057-9d8f-4111-ab54-dee0dfb91160 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:05.331294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-92a99057-9d8f-4111-ab54-dee0dfb91160 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:05.332829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-92a99057-9d8f-4111-ab54-dee0dfb91160 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:05.333971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-92a99057-9d8f-4111-ab54-dee0dfb91160 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1751 microversion: 2.20 time: 0.157140 May 12 06:55:05.334519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 235/458] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:05 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:06.352407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-072e0c45-a300-4d7e-b618-cf41b0d81d87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:06.353021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-072e0c45-a300-4d7e-b618-cf41b0d81d87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:06.359395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-072e0c45-a300-4d7e-b618-cf41b0d81d87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:06.359878 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-072e0c45-a300-4d7e-b618-cf41b0d81d87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:06.360643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-072e0c45-a300-4d7e-b618-cf41b0d81d87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:06.361074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-072e0c45-a300-4d7e-b618-cf41b0d81d87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:06.490392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-072e0c45-a300-4d7e-b618-cf41b0d81d87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:06.500253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-072e0c45-a300-4d7e-b618-cf41b0d81d87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:06.501741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-072e0c45-a300-4d7e-b618-cf41b0d81d87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:06.502903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-072e0c45-a300-4d7e-b618-cf41b0d81d87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.154377 May 12 06:55:06.503450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 224/459] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:06 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:06.788705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-df6b18e1-b9ff-4f93-99fa-5385a453f00c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:06.789964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-df6b18e1-b9ff-4f93-99fa-5385a453f00c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:06.796551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df6b18e1-b9ff-4f93-99fa-5385a453f00c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:06.797101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df6b18e1-b9ff-4f93-99fa-5385a453f00c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:06.797944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df6b18e1-b9ff-4f93-99fa-5385a453f00c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:06.798380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df6b18e1-b9ff-4f93-99fa-5385a453f00c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:06.825709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-df6b18e1-b9ff-4f93-99fa-5385a453f00c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661/ips" status: 200 len: 150 microversion: 2.1 time: 0.040954 May 12 06:55:06.828463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 236/460] 10.222.0.25 () {58 vars in 1247 bytes} [Thu May 12 06:55:06 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:06.838572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-034b0191-8355-49a4-b414-a014a26c7c4b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfc3da97-0d0b-4645-a5af-d6ac93d70b08"}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:55:06.839705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-034b0191-8355-49a4-b414-a014a26c7c4b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:06.845821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-034b0191-8355-49a4-b414-a014a26c7c4b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:06.846271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-034b0191-8355-49a4-b414-a014a26c7c4b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:06.847056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-034b0191-8355-49a4-b414-a014a26c7c4b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:06.847481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-034b0191-8355-49a4-b414-a014a26c7c4b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:06.932511 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-034b0191-8355-49a4-b414-a014a26c7c4b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Invalid volume: volume dfc3da97-0d0b-4645-a5af-d6ac93d70b08 is already attached to instances: 0baa16c3-ab5a-4e93-a65d-1e038d4af279 May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-034b0191-8355-49a4-b414-a014a26c7c4b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: POST /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661/os-volume_attachments HTTP/1.1 May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 74 May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 06:55:06.934264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {"volumeAttachment": {"volumeId": "dfc3da97-0d0b-4645-a5af-d6ac93d70b08"}} May 12 06:55:06.935924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Invalid volume: volume dfc3da97-0d0b-4645-a5af-d6ac93d70b08 is already attached to instances: 0baa16c3-ab5a-4e93-a65d-1e038d4af279 May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'server_id': '4a57c872-cacc-4345-b372-154b251e3661', 'body': {'volumeAttachment': {'volumeId': 'dfc3da97-0d0b-4645-a5af-d6ac93d70b08'}}} May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dfc3da97-0d0b-4645-a5af-d6ac93d70b08 is already attached to instances: 0baa16c3-ab5a-4e93-a65d-1e038d4af279 May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:55:06.940514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dfc3da97-0d0b-4645-a5af-d6ac93d70b08 is already attached to instances: 0baa16c3-ab5a-4e93-a65d-1e038d4af279 May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:55:06.941991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:55:06.943384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:55:06.943384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:55:06.943384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:55:06.943384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dfc3da97-0d0b-4645-a5af-d6ac93d70b08 is already attached to instances: 0baa16c3-ab5a-4e93-a65d-1e038d4af279 May 12 06:55:06.943384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:55:06.943384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-034b0191-8355-49a4-b414-a014a26c7c4b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 400 to user: Invalid volume: volume dfc3da97-0d0b-4645-a5af-d6ac93d70b08 is already attached to instances: 0baa16c3-ab5a-4e93-a65d-1e038d4af279 {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:55:06.943384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-034b0191-8355-49a4-b414-a014a26c7c4b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "POST /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101340 May 12 06:55:06.943384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 225/461] 10.222.0.25 () {60 vars in 1322 bytes} [Thu May 12 06:55:06 2022] POST /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 06:55:06.945280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ead2e070-e728-4153-a6c1-0d6b6fe40e60 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:06.945750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ead2e070-e728-4153-a6c1-0d6b6fe40e60 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:06.951823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ead2e070-e728-4153-a6c1-0d6b6fe40e60 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:06.952272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ead2e070-e728-4153-a6c1-0d6b6fe40e60 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:06.954378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ead2e070-e728-4153-a6c1-0d6b6fe40e60 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:06.954378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ead2e070-e728-4153-a6c1-0d6b6fe40e60 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:06.980985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ead2e070-e728-4153-a6c1-0d6b6fe40e60 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 06:55:07.110444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-323b308a-d943-4637-a42a-9ea2e8110769 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce7be931-41dc-455d-b15d-fbd24ac0f57c"}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:55:07.115631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-323b308a-d943-4637-a42a-9ea2e8110769 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:07.118419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-323b308a-d943-4637-a42a-9ea2e8110769 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:07.118877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-323b308a-d943-4637-a42a-9ea2e8110769 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:07.119658 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-323b308a-d943-4637-a42a-9ea2e8110769 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:07.120150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-323b308a-d943-4637-a42a-9ea2e8110769 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:07.400170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ead2e070-e728-4153-a6c1-0d6b6fe40e60 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 204 len: 0 microversion: 2.1 time: 0.458753 May 12 06:55:07.400666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 237/462] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 06:55:06 2022] DELETE /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 06:55:07.409708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-68e05b4c-cc84-4935-bf0a-49c0705a02bf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:07.410411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-68e05b4c-cc84-4935-bf0a-49c0705a02bf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:07.417229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68e05b4c-cc84-4935-bf0a-49c0705a02bf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:07.417941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68e05b4c-cc84-4935-bf0a-49c0705a02bf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:07.419099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68e05b4c-cc84-4935-bf0a-49c0705a02bf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:07.419727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68e05b4c-cc84-4935-bf0a-49c0705a02bf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:07.555575 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-68e05b4c-cc84-4935-bf0a-49c0705a02bf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:07.564179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-68e05b4c-cc84-4935-bf0a-49c0705a02bf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1681 microversion: 2.1 time: 0.158594 May 12 06:55:07.564843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 238/463] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:07 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:07.569758 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e1194609-eb3e-4424-a031-919f4faa97e6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:07.570869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e1194609-eb3e-4424-a031-919f4faa97e6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:07.576936 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1194609-eb3e-4424-a031-919f4faa97e6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:07.577409 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1194609-eb3e-4424-a031-919f4faa97e6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:07.578177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1194609-eb3e-4424-a031-919f4faa97e6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:07.578609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1194609-eb3e-4424-a031-919f4faa97e6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:07.705920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e1194609-eb3e-4424-a031-919f4faa97e6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:07.714688 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e1194609-eb3e-4424-a031-919f4faa97e6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:07.716299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e1194609-eb3e-4424-a031-919f4faa97e6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:07.717591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e1194609-eb3e-4424-a031-919f4faa97e6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.151561 May 12 06:55:07.718003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 239/464] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:07 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:07.919297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-323b308a-d943-4637-a42a-9ea2e8110769 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812520 May 12 06:55:07.919875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 226/465] 10.222.0.25 () {60 vars in 1322 bytes} [Thu May 12 06:55:07 2022] POST /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:55:08.582442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-524fb232-8285-449a-9bb2-87d5c60ab09f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:08.583060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-524fb232-8285-449a-9bb2-87d5c60ab09f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:08.589504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-524fb232-8285-449a-9bb2-87d5c60ab09f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:08.589951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-524fb232-8285-449a-9bb2-87d5c60ab09f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:08.590723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-524fb232-8285-449a-9bb2-87d5c60ab09f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:08.591158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-524fb232-8285-449a-9bb2-87d5c60ab09f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:08.718932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-524fb232-8285-449a-9bb2-87d5c60ab09f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:08.726296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-524fb232-8285-449a-9bb2-87d5c60ab09f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1681 microversion: 2.1 time: 0.147697 May 12 06:55:08.726853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 240/466] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:08 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:08.738935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a7842ebc-5ee1-44c3-bfe1-c5b887be60ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:08.739705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a7842ebc-5ee1-44c3-bfe1-c5b887be60ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:08.746923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7842ebc-5ee1-44c3-bfe1-c5b887be60ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:08.747374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7842ebc-5ee1-44c3-bfe1-c5b887be60ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:08.748181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7842ebc-5ee1-44c3-bfe1-c5b887be60ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:08.748621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7842ebc-5ee1-44c3-bfe1-c5b887be60ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:08.879389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a7842ebc-5ee1-44c3-bfe1-c5b887be60ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:08.888239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a7842ebc-5ee1-44c3-bfe1-c5b887be60ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:08.889753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a7842ebc-5ee1-44c3-bfe1-c5b887be60ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:08.890906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a7842ebc-5ee1-44c3-bfe1-c5b887be60ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.156461 May 12 06:55:08.891449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 227/467] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:09.743886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5ec41044-33f4-483c-834d-4c2f05b0178d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:09.744562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5ec41044-33f4-483c-834d-4c2f05b0178d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:09.751946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ec41044-33f4-483c-834d-4c2f05b0178d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:09.753066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ec41044-33f4-483c-834d-4c2f05b0178d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:09.754879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ec41044-33f4-483c-834d-4c2f05b0178d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:09.755479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ec41044-33f4-483c-834d-4c2f05b0178d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:09.909185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-78393027-ebcd-4b8b-acf5-46215d18bcc2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:09.910433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-78393027-ebcd-4b8b-acf5-46215d18bcc2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:09.924880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78393027-ebcd-4b8b-acf5-46215d18bcc2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:09.925698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78393027-ebcd-4b8b-acf5-46215d18bcc2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:09.926735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78393027-ebcd-4b8b-acf5-46215d18bcc2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:09.927414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78393027-ebcd-4b8b-acf5-46215d18bcc2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:09.961810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5ec41044-33f4-483c-834d-4c2f05b0178d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:09.971116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5ec41044-33f4-483c-834d-4c2f05b0178d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1681 microversion: 2.1 time: 0.231365 May 12 06:55:09.972047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 241/468] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:09 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1681 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:09.992135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 06:55:09.994201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 06:55:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 (ip 10.222.0.25) !!! May 12 06:55:10.146383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-78393027-ebcd-4b8b-acf5-46215d18bcc2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:10.154771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-78393027-ebcd-4b8b-acf5-46215d18bcc2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:10.156319 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-78393027-ebcd-4b8b-acf5-46215d18bcc2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:10.157536 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-78393027-ebcd-4b8b-acf5-46215d18bcc2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.252301 May 12 06:55:10.158098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 228/469] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:10.734398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-22678529-4123-4e55-8b9f-14901d74b4e6 req-a025d392-34a4-4807-84ac-c309e9452c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a57c872-cacc-4345-b372-154b251e3661", "name": "network-vif-deleted", "tag": "e115eee1-342f-406a-a608-d498c1303d80"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:55:10.754039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-22678529-4123-4e55-8b9f-14901d74b4e6 req-a025d392-34a4-4807-84ac-c309e9452c84 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:10.755407 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-22678529-4123-4e55-8b9f-14901d74b4e6 req-a025d392-34a4-4807-84ac-c309e9452c84 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:10.778078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-22678529-4123-4e55-8b9f-14901d74b4e6 req-a025d392-34a4-4807-84ac-c309e9452c84 service nova] Creating event network-vif-deleted:e115eee1-342f-406a-a608-d498c1303d80 for instance 4a57c872-cacc-4345-b372-154b251e3661 on hv-cinder-76606 May 12 06:55:10.791326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-22678529-4123-4e55-8b9f-14901d74b4e6 req-a025d392-34a4-4807-84ac-c309e9452c84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059094 May 12 06:55:10.794163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 242/470] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:10.989509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-51c76b16-8f08-45a1-a1a8-b2428bcc1bf9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:10.991296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-51c76b16-8f08-45a1-a1a8-b2428bcc1bf9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:11.000776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51c76b16-8f08-45a1-a1a8-b2428bcc1bf9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:11.001398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51c76b16-8f08-45a1-a1a8-b2428bcc1bf9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:11.002377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51c76b16-8f08-45a1-a1a8-b2428bcc1bf9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:11.002989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51c76b16-8f08-45a1-a1a8-b2428bcc1bf9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:11.090482 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-51c76b16-8f08-45a1-a1a8-b2428bcc1bf9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:11.100044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-51c76b16-8f08-45a1-a1a8-b2428bcc1bf9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1615 microversion: 2.1 time: 0.114360 May 12 06:55:11.107362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 229/471] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:10 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1615 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:11.177183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-70e3790d-934a-466c-b650-fcf491317e6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:11.182595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-70e3790d-934a-466c-b650-fcf491317e6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:11.192605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70e3790d-934a-466c-b650-fcf491317e6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:11.201028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70e3790d-934a-466c-b650-fcf491317e6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:11.202312 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70e3790d-934a-466c-b650-fcf491317e6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:11.203059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70e3790d-934a-466c-b650-fcf491317e6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:11.356821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-70e3790d-934a-466c-b650-fcf491317e6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:11.367097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-70e3790d-934a-466c-b650-fcf491317e6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:11.369626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-70e3790d-934a-466c-b650-fcf491317e6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:11.371161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-70e3790d-934a-466c-b650-fcf491317e6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.198605 May 12 06:55:11.372459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 243/472] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:12.119410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-68b7f69d-8cf9-44a3-badc-85b17e2bb3da tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:12.119410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-68b7f69d-8cf9-44a3-badc-85b17e2bb3da tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:12.129974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68b7f69d-8cf9-44a3-badc-85b17e2bb3da tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:12.130458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68b7f69d-8cf9-44a3-badc-85b17e2bb3da tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:12.131232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68b7f69d-8cf9-44a3-badc-85b17e2bb3da tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:12.131673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68b7f69d-8cf9-44a3-badc-85b17e2bb3da tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:12.263358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-68b7f69d-8cf9-44a3-badc-85b17e2bb3da tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:12.279968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-68b7f69d-8cf9-44a3-badc-85b17e2bb3da tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1615 microversion: 2.1 time: 0.157659 May 12 06:55:12.281145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 230/473] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:12 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1615 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:12.389982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-efcd6b38-2c9f-4ac0-a6e4-0fb33874c86d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:12.390642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-efcd6b38-2c9f-4ac0-a6e4-0fb33874c86d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:12.398511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-efcd6b38-2c9f-4ac0-a6e4-0fb33874c86d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:12.401802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-efcd6b38-2c9f-4ac0-a6e4-0fb33874c86d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:12.401802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-efcd6b38-2c9f-4ac0-a6e4-0fb33874c86d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:12.401802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-efcd6b38-2c9f-4ac0-a6e4-0fb33874c86d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:12.577060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-efcd6b38-2c9f-4ac0-a6e4-0fb33874c86d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:12.593756 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-efcd6b38-2c9f-4ac0-a6e4-0fb33874c86d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:12.595738 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-efcd6b38-2c9f-4ac0-a6e4-0fb33874c86d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:12.597309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-efcd6b38-2c9f-4ac0-a6e4-0fb33874c86d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.211297 May 12 06:55:12.614604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 244/474] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:12 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:13.298641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-87033a34-f56e-4592-91fc-fc86f65c9fbc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:13.299258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-87033a34-f56e-4592-91fc-fc86f65c9fbc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:13.305906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87033a34-f56e-4592-91fc-fc86f65c9fbc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:13.306642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87033a34-f56e-4592-91fc-fc86f65c9fbc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:13.307639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87033a34-f56e-4592-91fc-fc86f65c9fbc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:13.308398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87033a34-f56e-4592-91fc-fc86f65c9fbc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:13.401591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-87033a34-f56e-4592-91fc-fc86f65c9fbc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:13.410392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-87033a34-f56e-4592-91fc-fc86f65c9fbc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1615 microversion: 2.1 time: 0.115580 May 12 06:55:13.411303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 231/475] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:13 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1615 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:13.618879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8d8bebbd-069a-4ce7-ac07-cc0118e2b081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:13.619712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8d8bebbd-069a-4ce7-ac07-cc0118e2b081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:13.626126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d8bebbd-069a-4ce7-ac07-cc0118e2b081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:13.626583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d8bebbd-069a-4ce7-ac07-cc0118e2b081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:13.627365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d8bebbd-069a-4ce7-ac07-cc0118e2b081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:13.627839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d8bebbd-069a-4ce7-ac07-cc0118e2b081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:13.771942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8d8bebbd-069a-4ce7-ac07-cc0118e2b081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:13.780889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8d8bebbd-069a-4ce7-ac07-cc0118e2b081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:13.782440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8d8bebbd-069a-4ce7-ac07-cc0118e2b081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:13.783616 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8d8bebbd-069a-4ce7-ac07-cc0118e2b081 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.169050 May 12 06:55:13.791167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 245/476] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:14.429908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bc0a0264-5c76-4122-935a-59fda1d4e405 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:14.431713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bc0a0264-5c76-4122-935a-59fda1d4e405 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:14.438264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc0a0264-5c76-4122-935a-59fda1d4e405 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:14.438718 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc0a0264-5c76-4122-935a-59fda1d4e405 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:14.439498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc0a0264-5c76-4122-935a-59fda1d4e405 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:14.439970 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc0a0264-5c76-4122-935a-59fda1d4e405 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:14.502929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bc0a0264-5c76-4122-935a-59fda1d4e405 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:14.510427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bc0a0264-5c76-4122-935a-59fda1d4e405 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1615 microversion: 2.1 time: 0.084526 May 12 06:55:14.511001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 232/477] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:14 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:14.725900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-137bed86-fb10-4ee8-b961-85be3b80fbbb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2e3b708-5eaf-4e1e-a129-282f8a70bcaa", "device": "/dev/sdb"}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:55:14.728279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-137bed86-fb10-4ee8-b961-85be3b80fbbb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:14.734910 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-137bed86-fb10-4ee8-b961-85be3b80fbbb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:14.735374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-137bed86-fb10-4ee8-b961-85be3b80fbbb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:14.736183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-137bed86-fb10-4ee8-b961-85be3b80fbbb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:14.736617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-137bed86-fb10-4ee8-b961-85be3b80fbbb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:14.803570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e3aef024-e895-4e22-aa3c-c02b4d3ba7a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:14.804506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e3aef024-e895-4e22-aa3c-c02b4d3ba7a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:14.810686 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e3aef024-e895-4e22-aa3c-c02b4d3ba7a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:14.811326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e3aef024-e895-4e22-aa3c-c02b4d3ba7a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:14.816721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e3aef024-e895-4e22-aa3c-c02b4d3ba7a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:14.822863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e3aef024-e895-4e22-aa3c-c02b4d3ba7a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:14.959551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e3aef024-e895-4e22-aa3c-c02b4d3ba7a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:14.971066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e3aef024-e895-4e22-aa3c-c02b4d3ba7a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:14.972862 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e3aef024-e895-4e22-aa3c-c02b4d3ba7a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:14.974033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e3aef024-e895-4e22-aa3c-c02b4d3ba7a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.175320 May 12 06:55:14.974587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 233/478] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:14 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:15.527656 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6e9c5458-e6e8-4e3b-b788-ae5c40a5069d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:15.528359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6e9c5458-e6e8-4e3b-b788-ae5c40a5069d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:15.534542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e9c5458-e6e8-4e3b-b788-ae5c40a5069d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:15.535000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e9c5458-e6e8-4e3b-b788-ae5c40a5069d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:15.535787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e9c5458-e6e8-4e3b-b788-ae5c40a5069d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:15.536224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e9c5458-e6e8-4e3b-b788-ae5c40a5069d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:15.603723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6e9c5458-e6e8-4e3b-b788-ae5c40a5069d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:15.611517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6e9c5458-e6e8-4e3b-b788-ae5c40a5069d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1615 microversion: 2.1 time: 0.087678 May 12 06:55:15.612155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 234/479] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:15 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:15.992543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3adc60c4-7bb3-4179-8e0f-2f46b48d7b22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:15.993410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3adc60c4-7bb3-4179-8e0f-2f46b48d7b22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:15.999576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3adc60c4-7bb3-4179-8e0f-2f46b48d7b22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:16.000219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3adc60c4-7bb3-4179-8e0f-2f46b48d7b22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:16.001005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3adc60c4-7bb3-4179-8e0f-2f46b48d7b22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:16.001487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3adc60c4-7bb3-4179-8e0f-2f46b48d7b22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:16.134215 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3adc60c4-7bb3-4179-8e0f-2f46b48d7b22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:16.142739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3adc60c4-7bb3-4179-8e0f-2f46b48d7b22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:16.144278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3adc60c4-7bb3-4179-8e0f-2f46b48d7b22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:16.145462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3adc60c4-7bb3-4179-8e0f-2f46b48d7b22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.156865 May 12 06:55:16.146016 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 235/480] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:16.630178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-056c525e-b7b6-4259-a631-1b358a453af6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:16.630870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-056c525e-b7b6-4259-a631-1b358a453af6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:16.637767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-056c525e-b7b6-4259-a631-1b358a453af6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:16.638217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-056c525e-b7b6-4259-a631-1b358a453af6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:16.638987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-056c525e-b7b6-4259-a631-1b358a453af6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:16.639433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-056c525e-b7b6-4259-a631-1b358a453af6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:16.704476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-056c525e-b7b6-4259-a631-1b358a453af6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:16.712951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-056c525e-b7b6-4259-a631-1b358a453af6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1615 microversion: 2.1 time: 0.086651 May 12 06:55:16.713777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 236/481] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:16 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:17.165277 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a7ca869a-a470-4df2-95a4-25ef82646638 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:17.165880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a7ca869a-a470-4df2-95a4-25ef82646638 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:17.172066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7ca869a-a470-4df2-95a4-25ef82646638 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:17.172521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7ca869a-a470-4df2-95a4-25ef82646638 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:17.173278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7ca869a-a470-4df2-95a4-25ef82646638 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:17.173715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7ca869a-a470-4df2-95a4-25ef82646638 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:17.315771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a7ca869a-a470-4df2-95a4-25ef82646638 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:17.326515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a7ca869a-a470-4df2-95a4-25ef82646638 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:17.328345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a7ca869a-a470-4df2-95a4-25ef82646638 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:17.330033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a7ca869a-a470-4df2-95a4-25ef82646638 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.169167 May 12 06:55:17.337953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 237/482] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:17 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:17.730983 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e65d63ed-be77-4a80-be17-41da925ce2b4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:17.731674 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e65d63ed-be77-4a80-be17-41da925ce2b4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:17.738061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e65d63ed-be77-4a80-be17-41da925ce2b4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:17.738508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e65d63ed-be77-4a80-be17-41da925ce2b4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:17.739273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e65d63ed-be77-4a80-be17-41da925ce2b4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:17.739749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e65d63ed-be77-4a80-be17-41da925ce2b4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:17.802112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e65d63ed-be77-4a80-be17-41da925ce2b4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:17.809492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e65d63ed-be77-4a80-be17-41da925ce2b4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1615 microversion: 2.1 time: 0.083018 May 12 06:55:17.810054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 238/483] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:17 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1615 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:18.348816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a461e583-33e2-4f7c-be34-1f5c733b9e26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:18.349693 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a461e583-33e2-4f7c-be34-1f5c733b9e26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:18.364701 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a461e583-33e2-4f7c-be34-1f5c733b9e26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:18.365262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a461e583-33e2-4f7c-be34-1f5c733b9e26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:18.366125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a461e583-33e2-4f7c-be34-1f5c733b9e26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:18.366659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a461e583-33e2-4f7c-be34-1f5c733b9e26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:18.497437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a461e583-33e2-4f7c-be34-1f5c733b9e26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:18.506532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a461e583-33e2-4f7c-be34-1f5c733b9e26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:18.508052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a461e583-33e2-4f7c-be34-1f5c733b9e26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:18.509778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a461e583-33e2-4f7c-be34-1f5c733b9e26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.165163 May 12 06:55:18.510335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 239/484] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:18.826417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2ca78b57-046d-4118-bc1f-43f9480030fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:18.827288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2ca78b57-046d-4118-bc1f-43f9480030fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:18.833697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ca78b57-046d-4118-bc1f-43f9480030fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:18.834152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ca78b57-046d-4118-bc1f-43f9480030fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:18.834937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ca78b57-046d-4118-bc1f-43f9480030fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:18.835380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ca78b57-046d-4118-bc1f-43f9480030fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:18.903442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2ca78b57-046d-4118-bc1f-43f9480030fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:18.910895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2ca78b57-046d-4118-bc1f-43f9480030fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1615 microversion: 2.1 time: 0.088422 May 12 06:55:18.911497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 240/485] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:18 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1615 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:19.528188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e3c8f7df-79d8-4c88-9505-21bbd7e3da16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:19.528715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e3c8f7df-79d8-4c88-9505-21bbd7e3da16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:19.534567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e3c8f7df-79d8-4c88-9505-21bbd7e3da16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:19.535008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e3c8f7df-79d8-4c88-9505-21bbd7e3da16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:19.535786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e3c8f7df-79d8-4c88-9505-21bbd7e3da16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:19.536224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e3c8f7df-79d8-4c88-9505-21bbd7e3da16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:19.660250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e3c8f7df-79d8-4c88-9505-21bbd7e3da16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:19.669171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e3c8f7df-79d8-4c88-9505-21bbd7e3da16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:19.670656 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e3c8f7df-79d8-4c88-9505-21bbd7e3da16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:19.671819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e3c8f7df-79d8-4c88-9505-21bbd7e3da16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.147633 May 12 06:55:19.672363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 241/486] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:19 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:19.929002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5fe81dca-32e0-4414-9fe2-fb925d6edcc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:19.933144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5fe81dca-32e0-4414-9fe2-fb925d6edcc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:19.936266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5fe81dca-32e0-4414-9fe2-fb925d6edcc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:19.936715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5fe81dca-32e0-4414-9fe2-fb925d6edcc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:19.937478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5fe81dca-32e0-4414-9fe2-fb925d6edcc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:19.937913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5fe81dca-32e0-4414-9fe2-fb925d6edcc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:20.000427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5fe81dca-32e0-4414-9fe2-fb925d6edcc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:20.007863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5fe81dca-32e0-4414-9fe2-fb925d6edcc2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1615 microversion: 2.1 time: 0.082695 May 12 06:55:20.008434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 242/487] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:19 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1615 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:20.690755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-08bfd4fb-7a52-4fc1-93c9-9ad347a6ffa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:20.691409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-08bfd4fb-7a52-4fc1-93c9-9ad347a6ffa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:20.698107 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08bfd4fb-7a52-4fc1-93c9-9ad347a6ffa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:20.698563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08bfd4fb-7a52-4fc1-93c9-9ad347a6ffa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:20.699328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08bfd4fb-7a52-4fc1-93c9-9ad347a6ffa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:20.699801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08bfd4fb-7a52-4fc1-93c9-9ad347a6ffa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:20.828361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-08bfd4fb-7a52-4fc1-93c9-9ad347a6ffa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:20.836929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-08bfd4fb-7a52-4fc1-93c9-9ad347a6ffa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:20.840532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-08bfd4fb-7a52-4fc1-93c9-9ad347a6ffa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:20.840532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-08bfd4fb-7a52-4fc1-93c9-9ad347a6ffa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.153245 May 12 06:55:20.840532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 243/488] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:21.025094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e244846e-9efe-4379-875f-622a06f0dc40 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:21.025712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e244846e-9efe-4379-875f-622a06f0dc40 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:21.032244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e244846e-9efe-4379-875f-622a06f0dc40 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:21.032817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e244846e-9efe-4379-875f-622a06f0dc40 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:21.034495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e244846e-9efe-4379-875f-622a06f0dc40 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:21.035171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e244846e-9efe-4379-875f-622a06f0dc40 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:21.068310 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e244846e-9efe-4379-875f-622a06f0dc40 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:21.069010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e244846e-9efe-4379-875f-622a06f0dc40 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:21.069462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-e244846e-9efe-4379-875f-622a06f0dc40 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lazy-loading 'fault' on Instance uuid 4a57c872-cacc-4345-b372-154b251e3661 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:55:21.109696 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e244846e-9efe-4379-875f-622a06f0dc40 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:21.117095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e244846e-9efe-4379-875f-622a06f0dc40 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1332 microversion: 2.1 time: 0.095811 May 12 06:55:21.118349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 244/489] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:21 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:21.693095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-137bed86-fb10-4ee8-b961-85be3b80fbbb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "POST /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.971023 May 12 06:55:21.693756 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 246/490] 10.222.0.25 () {60 vars in 1322 bytes} [Thu May 12 06:55:14 2022] POST /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments => generated 194 bytes in 6973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:21.857665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-26decd30-2c0e-4a46-ba52-30911061d453 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:21.858204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-26decd30-2c0e-4a46-ba52-30911061d453 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:21.864097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26decd30-2c0e-4a46-ba52-30911061d453 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:21.864547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26decd30-2c0e-4a46-ba52-30911061d453 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:21.865313 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26decd30-2c0e-4a46-ba52-30911061d453 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:21.865755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26decd30-2c0e-4a46-ba52-30911061d453 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:21.993115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-26decd30-2c0e-4a46-ba52-30911061d453 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:22.001569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-26decd30-2c0e-4a46-ba52-30911061d453 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:22.003108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-26decd30-2c0e-4a46-ba52-30911061d453 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:22.004296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-26decd30-2c0e-4a46-ba52-30911061d453 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.150586 May 12 06:55:22.004890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 245/491] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:22.146385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fa7a8d95-61e1-4add-87e7-6acb8e568cef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:22.147187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fa7a8d95-61e1-4add-87e7-6acb8e568cef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:22.153504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa7a8d95-61e1-4add-87e7-6acb8e568cef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:22.154017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa7a8d95-61e1-4add-87e7-6acb8e568cef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:22.160982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa7a8d95-61e1-4add-87e7-6acb8e568cef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:22.160982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa7a8d95-61e1-4add-87e7-6acb8e568cef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:22.188964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa7a8d95-61e1-4add-87e7-6acb8e568cef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:22.189613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa7a8d95-61e1-4add-87e7-6acb8e568cef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:22.190066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-fa7a8d95-61e1-4add-87e7-6acb8e568cef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lazy-loading 'fault' on Instance uuid 4a57c872-cacc-4345-b372-154b251e3661 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:55:22.234283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fa7a8d95-61e1-4add-87e7-6acb8e568cef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:22.241606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fa7a8d95-61e1-4add-87e7-6acb8e568cef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 200 len: 1332 microversion: 2.1 time: 0.100537 May 12 06:55:22.242167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 247/492] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:22 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:22.897397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-12c2c0a9-ad2b-43a4-99a3-03b81c7b277c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:55:22.898422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-12c2c0a9-ad2b-43a4-99a3-03b81c7b277c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:22.904763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-12c2c0a9-ad2b-43a4-99a3-03b81c7b277c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:22.905210 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-12c2c0a9-ad2b-43a4-99a3-03b81c7b277c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:22.905969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-12c2c0a9-ad2b-43a4-99a3-03b81c7b277c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:22.906401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-12c2c0a9-ad2b-43a4-99a3-03b81c7b277c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:22.928422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-12c2c0a9-ad2b-43a4-99a3-03b81c7b277c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'flavor' on Instance uuid d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:55:23.023613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9c8ac93b-87ed-4942-ac26-66670347c344 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:23.023613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9c8ac93b-87ed-4942-ac26-66670347c344 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:23.029189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c8ac93b-87ed-4942-ac26-66670347c344 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:23.029638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c8ac93b-87ed-4942-ac26-66670347c344 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:23.030405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c8ac93b-87ed-4942-ac26-66670347c344 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:23.030844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c8ac93b-87ed-4942-ac26-66670347c344 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:23.159305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9c8ac93b-87ed-4942-ac26-66670347c344 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:23.167488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9c8ac93b-87ed-4942-ac26-66670347c344 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:23.169281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9c8ac93b-87ed-4942-ac26-66670347c344 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:23.170439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9c8ac93b-87ed-4942-ac26-66670347c344 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.151909 May 12 06:55:23.171001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 248/493] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:23 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:23.258687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-49dcb97e-e158-449e-a6cd-b886d1e63ff8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:23.259290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-49dcb97e-e158-449e-a6cd-b886d1e63ff8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:23.265222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49dcb97e-e158-449e-a6cd-b886d1e63ff8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:23.265675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49dcb97e-e158-449e-a6cd-b886d1e63ff8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:23.266451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49dcb97e-e158-449e-a6cd-b886d1e63ff8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:23.266893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49dcb97e-e158-449e-a6cd-b886d1e63ff8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:23.282388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-49dcb97e-e158-449e-a6cd-b886d1e63ff8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-49dcb97e-e158-449e-a6cd-b886d1e63ff8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 HTTP/1.1 May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 06:55:23.283975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 06:55:23.285636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': '4a57c872-cacc-4345-b372-154b251e3661'} May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:55:23.286633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 06:55:23.288142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 06:55:23.289577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-49dcb97e-e158-449e-a6cd-b886d1e63ff8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:55:23.289577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-49dcb97e-e158-449e-a6cd-b886d1e63ff8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 404 len: 111 microversion: 2.1 time: 0.030900 May 12 06:55:23.289577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 249/494] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:23 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 06:55:23.293870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d1c6bf2c-299e-4eaa-93fc-b60d8ce3dc99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '.version_select at 0x7f89da430700>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:23.339909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-12c2c0a9-ad2b-43a4-99a3-03b81c7b277c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/action" status: 200 len: 32 microversion: 2.1 time: 0.446322 May 12 06:55:23.340573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 246/495] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 06:55:22 2022] POST /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/action => generated 32 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 06:55:23.349880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5f671747-2c46-4355-a1b1-af312506888f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:23.350515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5f671747-2c46-4355-a1b1-af312506888f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:23.356913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f671747-2c46-4355-a1b1-af312506888f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:23.357363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f671747-2c46-4355-a1b1-af312506888f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:23.358130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f671747-2c46-4355-a1b1-af312506888f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:23.358562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f671747-2c46-4355-a1b1-af312506888f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:23.394943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d1c6bf2c-299e-4eaa-93fc-b60d8ce3dc99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039778787" status: 202 len: 0 microversion: 2.1 time: 0.104638 May 12 06:55:23.395782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 250/496] 10.222.0.25 () {58 vars in 1220 bytes} [Thu May 12 06:55:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039778787 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 06:55:23.488998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5f671747-2c46-4355-a1b1-af312506888f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:23.501397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5f671747-2c46-4355-a1b1-af312506888f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.155593 May 12 06:55:23.501987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 247/497] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:24.188999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-12542178-1a59-42a4-b1d7-5c829a79d6fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:24.189930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-12542178-1a59-42a4-b1d7-5c829a79d6fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:24.196563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12542178-1a59-42a4-b1d7-5c829a79d6fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:24.197023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12542178-1a59-42a4-b1d7-5c829a79d6fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:24.197801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12542178-1a59-42a4-b1d7-5c829a79d6fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:24.198245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12542178-1a59-42a4-b1d7-5c829a79d6fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:24.364624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-12542178-1a59-42a4-b1d7-5c829a79d6fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:24.373552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-12542178-1a59-42a4-b1d7-5c829a79d6fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:24.375340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-12542178-1a59-42a4-b1d7-5c829a79d6fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:24.376776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-12542178-1a59-42a4-b1d7-5c829a79d6fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.191998 May 12 06:55:24.377408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 251/498] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:24 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:24.385122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-221456d2-e3a8-4f47-b870-ba19bd2bf1cb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:24.385694 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-221456d2-e3a8-4f47-b870-ba19bd2bf1cb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:24.392131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-221456d2-e3a8-4f47-b870-ba19bd2bf1cb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:24.392587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-221456d2-e3a8-4f47-b870-ba19bd2bf1cb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:24.393361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-221456d2-e3a8-4f47-b870-ba19bd2bf1cb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:24.393803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-221456d2-e3a8-4f47-b870-ba19bd2bf1cb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:24.513689 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-221456d2-e3a8-4f47-b870-ba19bd2bf1cb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lazy-loading 'services' on Instance uuid 0baa16c3-ab5a-4e93-a65d-1e038d4af279 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:55:24.519371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-09de1897-7f80-4efa-81a7-aa797bd9a584 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:24.520014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-09de1897-7f80-4efa-81a7-aa797bd9a584 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:24.526313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09de1897-7f80-4efa-81a7-aa797bd9a584 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:24.526768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09de1897-7f80-4efa-81a7-aa797bd9a584 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:24.527542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09de1897-7f80-4efa-81a7-aa797bd9a584 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:24.528007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09de1897-7f80-4efa-81a7-aa797bd9a584 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:24.658231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-09de1897-7f80-4efa-81a7-aa797bd9a584 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:24.665921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-09de1897-7f80-4efa-81a7-aa797bd9a584 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150508 May 12 06:55:24.666476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 252/499] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:24.781700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-221456d2-e3a8-4f47-b870-ba19bd2bf1cb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments/dfc3da97-0d0b-4645-a5af-d6ac93d70b08" status: 202 len: 0 microversion: 2.1 time: 0.400213 May 12 06:55:24.782333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 248/500] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 06:55:24 2022] DELETE /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments/dfc3da97-0d0b-4645-a5af-d6ac93d70b08 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 06:55:24.790833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-10be7c58-ab66-466f-b6e4-37e80d4083c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:24.791966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-10be7c58-ab66-466f-b6e4-37e80d4083c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:24.797985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10be7c58-ab66-466f-b6e4-37e80d4083c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:24.798434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10be7c58-ab66-466f-b6e4-37e80d4083c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:24.799208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10be7c58-ab66-466f-b6e4-37e80d4083c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:24.799645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10be7c58-ab66-466f-b6e4-37e80d4083c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:24.828825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-10be7c58-ab66-466f-b6e4-37e80d4083c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041959 May 12 06:55:24.829386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 253/501] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:24 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:25.395712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-72a7aabf-fd6a-4193-b960-a39b430fb51c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:25.396425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-72a7aabf-fd6a-4193-b960-a39b430fb51c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:25.403433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-72a7aabf-fd6a-4193-b960-a39b430fb51c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:25.403926 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-72a7aabf-fd6a-4193-b960-a39b430fb51c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:25.404706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-72a7aabf-fd6a-4193-b960-a39b430fb51c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:25.405150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-72a7aabf-fd6a-4193-b960-a39b430fb51c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:25.528181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-72a7aabf-fd6a-4193-b960-a39b430fb51c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:25.536355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-72a7aabf-fd6a-4193-b960-a39b430fb51c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:25.537859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-72a7aabf-fd6a-4193-b960-a39b430fb51c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:25.539010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-72a7aabf-fd6a-4193-b960-a39b430fb51c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.147551 May 12 06:55:25.540095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 249/502] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:25 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:25.633089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c358125c-d59d-4214-a701-4c85e91a0240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:25.633615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c358125c-d59d-4214-a701-4c85e91a0240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:25.639876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c358125c-d59d-4214-a701-4c85e91a0240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:25.640325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c358125c-d59d-4214-a701-4c85e91a0240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:25.641085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c358125c-d59d-4214-a701-4c85e91a0240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:25.641550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c358125c-d59d-4214-a701-4c85e91a0240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:25.684045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-726214c6-7d7f-4fc5-896a-68f3604498d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:25.684585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-726214c6-7d7f-4fc5-896a-68f3604498d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:25.690469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-726214c6-7d7f-4fc5-896a-68f3604498d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:25.690920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-726214c6-7d7f-4fc5-896a-68f3604498d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:25.691703 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-726214c6-7d7f-4fc5-896a-68f3604498d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:25.692150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-726214c6-7d7f-4fc5-896a-68f3604498d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:25.761737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-c358125c-d59d-4214-a701-4c85e91a0240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lazy-loading 'services' on Instance uuid 7f4aebcd-2d12-4d12-941a-12261cb855af {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:55:25.824581 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-726214c6-7d7f-4fc5-896a-68f3604498d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:25.834334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-726214c6-7d7f-4fc5-896a-68f3604498d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.153420 May 12 06:55:25.834334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 250/503] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:25.848339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a19711d3-f4ea-436d-ab45-465753467a81 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:25.849347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a19711d3-f4ea-436d-ab45-465753467a81 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:25.855906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a19711d3-f4ea-436d-ab45-465753467a81 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:25.856353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a19711d3-f4ea-436d-ab45-465753467a81 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:25.857122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a19711d3-f4ea-436d-ab45-465753467a81 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:25.857557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a19711d3-f4ea-436d-ab45-465753467a81 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:25.886855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a19711d3-f4ea-436d-ab45-465753467a81 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042213 May 12 06:55:25.887406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 251/504] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:25 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:26.032835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c358125c-d59d-4214-a701-4c85e91a0240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments/823a4f88-bcf6-4890-8292-6b03da40f027" status: 202 len: 0 microversion: 2.1 time: 0.403439 May 12 06:55:26.033420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 254/505] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 06:55:25 2022] DELETE /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments/823a4f88-bcf6-4890-8292-6b03da40f027 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 06:55:26.565421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dc3e1d66-14bf-42b1-9f2c-6dd1a0f1512d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:26.566033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dc3e1d66-14bf-42b1-9f2c-6dd1a0f1512d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:26.573061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc3e1d66-14bf-42b1-9f2c-6dd1a0f1512d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:26.573508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc3e1d66-14bf-42b1-9f2c-6dd1a0f1512d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:26.574274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc3e1d66-14bf-42b1-9f2c-6dd1a0f1512d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:26.574708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc3e1d66-14bf-42b1-9f2c-6dd1a0f1512d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:26.700739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dc3e1d66-14bf-42b1-9f2c-6dd1a0f1512d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:26.708871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dc3e1d66-14bf-42b1-9f2c-6dd1a0f1512d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:26.710377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dc3e1d66-14bf-42b1-9f2c-6dd1a0f1512d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:26.711531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dc3e1d66-14bf-42b1-9f2c-6dd1a0f1512d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.149972 May 12 06:55:26.712133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 252/506] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:26 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:26.851302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-16d8fe6b-e80a-42a1-be22-c1417db6b309 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:26.852447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-16d8fe6b-e80a-42a1-be22-c1417db6b309 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:26.858952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16d8fe6b-e80a-42a1-be22-c1417db6b309 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:26.859396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16d8fe6b-e80a-42a1-be22-c1417db6b309 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:26.860217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16d8fe6b-e80a-42a1-be22-c1417db6b309 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:26.860652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16d8fe6b-e80a-42a1-be22-c1417db6b309 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:26.897542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ebc70374-80df-4d79-9ad1-032b650cb03d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:26.898460 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ebc70374-80df-4d79-9ad1-032b650cb03d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:26.904389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebc70374-80df-4d79-9ad1-032b650cb03d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:26.904833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebc70374-80df-4d79-9ad1-032b650cb03d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:26.905604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebc70374-80df-4d79-9ad1-032b650cb03d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:26.906034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebc70374-80df-4d79-9ad1-032b650cb03d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:26.935222 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ebc70374-80df-4d79-9ad1-032b650cb03d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041559 May 12 06:55:26.935808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 253/507] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:26 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:55:26.993746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-16d8fe6b-e80a-42a1-be22-c1417db6b309 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:27.001721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-16d8fe6b-e80a-42a1-be22-c1417db6b309 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.154608 May 12 06:55:27.002319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 255/508] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:27.729037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6df989fc-6e87-4438-9ebd-377054482d4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:27.729638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6df989fc-6e87-4438-9ebd-377054482d4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:27.736514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6df989fc-6e87-4438-9ebd-377054482d4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:27.737201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6df989fc-6e87-4438-9ebd-377054482d4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:27.738225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6df989fc-6e87-4438-9ebd-377054482d4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:27.738659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6df989fc-6e87-4438-9ebd-377054482d4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:27.868420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6df989fc-6e87-4438-9ebd-377054482d4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:27.876550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6df989fc-6e87-4438-9ebd-377054482d4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:27.878046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6df989fc-6e87-4438-9ebd-377054482d4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:27.879194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6df989fc-6e87-4438-9ebd-377054482d4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.154166 May 12 06:55:27.879773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 254/509] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:27 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:27.946911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-69679c36-0d2a-4d9a-ae50-97b6a873adb4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:27.947950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-69679c36-0d2a-4d9a-ae50-97b6a873adb4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:27.954149 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69679c36-0d2a-4d9a-ae50-97b6a873adb4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:27.954593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69679c36-0d2a-4d9a-ae50-97b6a873adb4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:27.955355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69679c36-0d2a-4d9a-ae50-97b6a873adb4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:27.955814 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69679c36-0d2a-4d9a-ae50-97b6a873adb4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:27.985212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-69679c36-0d2a-4d9a-ae50-97b6a873adb4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042608 May 12 06:55:27.985701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 256/510] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:27 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:28.019102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-aa867be4-f1c1-40fa-83cf-734e9709703f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:28.019518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-aa867be4-f1c1-40fa-83cf-734e9709703f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:28.025472 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa867be4-f1c1-40fa-83cf-734e9709703f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:28.025927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa867be4-f1c1-40fa-83cf-734e9709703f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:28.026701 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa867be4-f1c1-40fa-83cf-734e9709703f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:28.027143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa867be4-f1c1-40fa-83cf-734e9709703f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:28.151555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aa867be4-f1c1-40fa-83cf-734e9709703f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:28.159180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-aa867be4-f1c1-40fa-83cf-734e9709703f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144299 May 12 06:55:28.159770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 255/511] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:28.899077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c8e7bdb4-2953-477f-b491-cfa5aa8ffa06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:28.899591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c8e7bdb4-2953-477f-b491-cfa5aa8ffa06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:28.905565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8e7bdb4-2953-477f-b491-cfa5aa8ffa06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:28.906016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8e7bdb4-2953-477f-b491-cfa5aa8ffa06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:28.906783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8e7bdb4-2953-477f-b491-cfa5aa8ffa06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:28.907216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8e7bdb4-2953-477f-b491-cfa5aa8ffa06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:28.995841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b4b037f1-cbe0-4e5a-b17f-47bca0b5e6f2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:28.996798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b4b037f1-cbe0-4e5a-b17f-47bca0b5e6f2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:29.002952 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4b037f1-cbe0-4e5a-b17f-47bca0b5e6f2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:29.003394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4b037f1-cbe0-4e5a-b17f-47bca0b5e6f2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:29.004199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4b037f1-cbe0-4e5a-b17f-47bca0b5e6f2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:29.004631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4b037f1-cbe0-4e5a-b17f-47bca0b5e6f2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:29.033721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b4b037f1-cbe0-4e5a-b17f-47bca0b5e6f2 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041828 May 12 06:55:29.034300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 256/512] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:28 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:55:29.035449 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c8e7bdb4-2953-477f-b491-cfa5aa8ffa06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:29.044967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c8e7bdb4-2953-477f-b491-cfa5aa8ffa06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:29.046527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c8e7bdb4-2953-477f-b491-cfa5aa8ffa06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:29.047763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c8e7bdb4-2953-477f-b491-cfa5aa8ffa06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.153257 May 12 06:55:29.052293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 257/513] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:28 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:29.176699 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f3387268-7f36-48a9-bb86-e17a2afdc694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:29.177234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f3387268-7f36-48a9-bb86-e17a2afdc694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:29.183069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f3387268-7f36-48a9-bb86-e17a2afdc694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:29.184306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f3387268-7f36-48a9-bb86-e17a2afdc694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:29.184306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f3387268-7f36-48a9-bb86-e17a2afdc694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:29.184789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f3387268-7f36-48a9-bb86-e17a2afdc694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:29.311965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f3387268-7f36-48a9-bb86-e17a2afdc694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:29.320923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f3387268-7f36-48a9-bb86-e17a2afdc694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147557 May 12 06:55:29.321433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 257/514] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:30.046206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e6e55c1b-7960-431c-b1ba-918d830f3172 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:30.047117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e6e55c1b-7960-431c-b1ba-918d830f3172 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:30.053161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6e55c1b-7960-431c-b1ba-918d830f3172 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:30.053611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6e55c1b-7960-431c-b1ba-918d830f3172 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:30.054386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6e55c1b-7960-431c-b1ba-918d830f3172 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:30.054821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6e55c1b-7960-431c-b1ba-918d830f3172 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:30.068613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3c120179-e548-4ed7-afa3-c0624f6f5879 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:30.069291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3c120179-e548-4ed7-afa3-c0624f6f5879 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:30.075804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c120179-e548-4ed7-afa3-c0624f6f5879 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:30.076323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c120179-e548-4ed7-afa3-c0624f6f5879 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:30.077223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c120179-e548-4ed7-afa3-c0624f6f5879 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:30.077727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c120179-e548-4ed7-afa3-c0624f6f5879 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:30.085353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e6e55c1b-7960-431c-b1ba-918d830f3172 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 May 12 06:55:30.086135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 258/515] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:30 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:30.219118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3c120179-e548-4ed7-afa3-c0624f6f5879 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:30.243549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3c120179-e548-4ed7-afa3-c0624f6f5879 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:30.243549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3c120179-e548-4ed7-afa3-c0624f6f5879 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:30.243549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3c120179-e548-4ed7-afa3-c0624f6f5879 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.167083 May 12 06:55:30.244069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 258/516] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:30 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:30.338353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2770d1a5-c7d1-4da2-bfae-9d7413dfa16c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:30.338970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2770d1a5-c7d1-4da2-bfae-9d7413dfa16c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:30.344883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2770d1a5-c7d1-4da2-bfae-9d7413dfa16c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:30.345333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2770d1a5-c7d1-4da2-bfae-9d7413dfa16c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:30.346108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2770d1a5-c7d1-4da2-bfae-9d7413dfa16c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:30.346555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2770d1a5-c7d1-4da2-bfae-9d7413dfa16c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:30.470884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2770d1a5-c7d1-4da2-bfae-9d7413dfa16c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:30.479429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2770d1a5-c7d1-4da2-bfae-9d7413dfa16c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145393 May 12 06:55:30.480049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 259/517] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:31.096909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3ca04160-e32f-4515-9925-42fc2b56ac82 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:31.097857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3ca04160-e32f-4515-9925-42fc2b56ac82 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:31.104827 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ca04160-e32f-4515-9925-42fc2b56ac82 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:31.105299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ca04160-e32f-4515-9925-42fc2b56ac82 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:31.106129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ca04160-e32f-4515-9925-42fc2b56ac82 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:31.106567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ca04160-e32f-4515-9925-42fc2b56ac82 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:31.134783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3ca04160-e32f-4515-9925-42fc2b56ac82 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041832 May 12 06:55:31.135320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 259/518] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:31 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:31.250472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ea56d4d9-9e2c-41dc-82fc-6495230abf37 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:31.251008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ea56d4d9-9e2c-41dc-82fc-6495230abf37 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:31.257375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ea56d4d9-9e2c-41dc-82fc-6495230abf37 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:31.257824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ea56d4d9-9e2c-41dc-82fc-6495230abf37 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:31.258595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ea56d4d9-9e2c-41dc-82fc-6495230abf37 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:31.259032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ea56d4d9-9e2c-41dc-82fc-6495230abf37 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:31.384765 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ea56d4d9-9e2c-41dc-82fc-6495230abf37 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:31.392939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ea56d4d9-9e2c-41dc-82fc-6495230abf37 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:31.394481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ea56d4d9-9e2c-41dc-82fc-6495230abf37 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:31.395656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ea56d4d9-9e2c-41dc-82fc-6495230abf37 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.149184 May 12 06:55:31.396315 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 260/519] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:31 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:31.496345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cc2879d0-a263-4a60-8148-e2eab56127a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:31.496985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cc2879d0-a263-4a60-8148-e2eab56127a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:31.502901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc2879d0-a263-4a60-8148-e2eab56127a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:31.503289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc2879d0-a263-4a60-8148-e2eab56127a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:31.504077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc2879d0-a263-4a60-8148-e2eab56127a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:31.504513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc2879d0-a263-4a60-8148-e2eab56127a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:31.633832 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cc2879d0-a263-4a60-8148-e2eab56127a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:31.642064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cc2879d0-a263-4a60-8148-e2eab56127a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149512 May 12 06:55:31.642824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 260/520] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:31.645114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-2df52b1b-72af-4932-99dd-fa9a4975dd38 req-32b010f6-67fe-4b34-b720-5af8cc7233f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30aa8f3-ada1-42f3-bb93-081f2552b4a3", "name": "network-vif-plugged", "status": "completed", "tag": "d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:55:31.653800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-2df52b1b-72af-4932-99dd-fa9a4975dd38 req-32b010f6-67fe-4b34-b720-5af8cc7233f6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:31.654243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-2df52b1b-72af-4932-99dd-fa9a4975dd38 req-32b010f6-67fe-4b34-b720-5af8cc7233f6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:31.664777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-2df52b1b-72af-4932-99dd-fa9a4975dd38 req-32b010f6-67fe-4b34-b720-5af8cc7233f6 service nova] Creating event network-vif-plugged:d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36 for instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 on hv-cinder-76606 May 12 06:55:31.670100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-2df52b1b-72af-4932-99dd-fa9a4975dd38 req-32b010f6-67fe-4b34-b720-5af8cc7233f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028898 May 12 06:55:31.670656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 261/521] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:55:32.146522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3cdfa9b7-a8f8-4aca-a6f3-2a670736a769 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:32.147375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3cdfa9b7-a8f8-4aca-a6f3-2a670736a769 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:32.154394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cdfa9b7-a8f8-4aca-a6f3-2a670736a769 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:32.154841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cdfa9b7-a8f8-4aca-a6f3-2a670736a769 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:32.155614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cdfa9b7-a8f8-4aca-a6f3-2a670736a769 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:32.156073 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cdfa9b7-a8f8-4aca-a6f3-2a670736a769 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:32.184732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3cdfa9b7-a8f8-4aca-a6f3-2a670736a769 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042292 May 12 06:55:32.185274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 261/522] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:32 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:32.414587 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-529fb062-c294-44de-857e-f223cb52c45f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:32.415213 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-529fb062-c294-44de-857e-f223cb52c45f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:32.421862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529fb062-c294-44de-857e-f223cb52c45f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:32.422308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529fb062-c294-44de-857e-f223cb52c45f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:32.423139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529fb062-c294-44de-857e-f223cb52c45f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:32.423576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529fb062-c294-44de-857e-f223cb52c45f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:32.545921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-529fb062-c294-44de-857e-f223cb52c45f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:32.553994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-529fb062-c294-44de-857e-f223cb52c45f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:32.555484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-529fb062-c294-44de-857e-f223cb52c45f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:32.557260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-529fb062-c294-44de-857e-f223cb52c45f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.146881 May 12 06:55:32.557819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 262/523] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:32 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:32.659328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7f39ca99-52dd-4e7a-b738-2aa79148ef27 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:32.659958 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7f39ca99-52dd-4e7a-b738-2aa79148ef27 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:32.665812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f39ca99-52dd-4e7a-b738-2aa79148ef27 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:32.666196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f39ca99-52dd-4e7a-b738-2aa79148ef27 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:32.666957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f39ca99-52dd-4e7a-b738-2aa79148ef27 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:32.667388 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f39ca99-52dd-4e7a-b738-2aa79148ef27 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:32.793601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7f39ca99-52dd-4e7a-b738-2aa79148ef27 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:32.801573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7f39ca99-52dd-4e7a-b738-2aa79148ef27 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145996 May 12 06:55:32.802150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 262/524] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:33.196405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-acf19a16-3c3e-45ff-b2f3-ea719b23a6f5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:33.197373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-acf19a16-3c3e-45ff-b2f3-ea719b23a6f5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:33.203294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-acf19a16-3c3e-45ff-b2f3-ea719b23a6f5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:33.203765 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-acf19a16-3c3e-45ff-b2f3-ea719b23a6f5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:33.204530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-acf19a16-3c3e-45ff-b2f3-ea719b23a6f5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:33.204964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-acf19a16-3c3e-45ff-b2f3-ea719b23a6f5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:33.241238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-acf19a16-3c3e-45ff-b2f3-ea719b23a6f5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048726 May 12 06:55:33.241790 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 263/525] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:33 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:33.575662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e0c6fb66-75e3-462d-9940-fbd02b26d0e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:33.576284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e0c6fb66-75e3-462d-9940-fbd02b26d0e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:33.582698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e0c6fb66-75e3-462d-9940-fbd02b26d0e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:33.583167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e0c6fb66-75e3-462d-9940-fbd02b26d0e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:33.583962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e0c6fb66-75e3-462d-9940-fbd02b26d0e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:33.584397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e0c6fb66-75e3-462d-9940-fbd02b26d0e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:33.710104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e0c6fb66-75e3-462d-9940-fbd02b26d0e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:33.718897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e0c6fb66-75e3-462d-9940-fbd02b26d0e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:33.720429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e0c6fb66-75e3-462d-9940-fbd02b26d0e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:33.721577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e0c6fb66-75e3-462d-9940-fbd02b26d0e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.150243 May 12 06:55:33.722136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 263/526] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:33 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:33.819002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-28abaa2d-f5e1-44ea-8f3f-1ab855b410da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:33.819623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-28abaa2d-f5e1-44ea-8f3f-1ab855b410da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:33.826552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28abaa2d-f5e1-44ea-8f3f-1ab855b410da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:33.827008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28abaa2d-f5e1-44ea-8f3f-1ab855b410da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:33.827814 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28abaa2d-f5e1-44ea-8f3f-1ab855b410da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:33.828256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28abaa2d-f5e1-44ea-8f3f-1ab855b410da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:33.957126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-28abaa2d-f5e1-44ea-8f3f-1ab855b410da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:33.965150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-28abaa2d-f5e1-44ea-8f3f-1ab855b410da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150022 May 12 06:55:33.965729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 264/527] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:33 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:34.252854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-16b45b7f-1aba-495b-9100-bcdc172171e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:34.253783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-16b45b7f-1aba-495b-9100-bcdc172171e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:34.260314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16b45b7f-1aba-495b-9100-bcdc172171e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:34.260764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16b45b7f-1aba-495b-9100-bcdc172171e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:34.261538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16b45b7f-1aba-495b-9100-bcdc172171e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:34.261972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16b45b7f-1aba-495b-9100-bcdc172171e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:34.289110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-16b45b7f-1aba-495b-9100-bcdc172171e6 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040210 May 12 06:55:34.289656 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 264/528] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:34 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:34.739620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-de765c4b-3420-41ec-8ec0-fe9c6f83cb17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:34.740260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-de765c4b-3420-41ec-8ec0-fe9c6f83cb17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:34.746132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de765c4b-3420-41ec-8ec0-fe9c6f83cb17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:34.746579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de765c4b-3420-41ec-8ec0-fe9c6f83cb17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:34.747350 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de765c4b-3420-41ec-8ec0-fe9c6f83cb17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:34.747817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de765c4b-3420-41ec-8ec0-fe9c6f83cb17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:34.983217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d37ba419-304b-4201-9ddc-ae2f5390c538 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:34.983866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d37ba419-304b-4201-9ddc-ae2f5390c538 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:34.990614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d37ba419-304b-4201-9ddc-ae2f5390c538 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:34.991108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d37ba419-304b-4201-9ddc-ae2f5390c538 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:34.992085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d37ba419-304b-4201-9ddc-ae2f5390c538 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:34.992520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d37ba419-304b-4201-9ddc-ae2f5390c538 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:35.152517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de765c4b-3420-41ec-8ec0-fe9c6f83cb17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:35.160898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de765c4b-3420-41ec-8ec0-fe9c6f83cb17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:35.162390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de765c4b-3420-41ec-8ec0-fe9c6f83cb17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:35.163145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d37ba419-304b-4201-9ddc-ae2f5390c538 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:35.163553 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-de765c4b-3420-41ec-8ec0-fe9c6f83cb17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.427823 May 12 06:55:35.164147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 265/529] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:34 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:35.171970 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d37ba419-304b-4201-9ddc-ae2f5390c538 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.192676 May 12 06:55:35.172531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 265/530] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:35.300504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8853bc00-b6a7-4c3f-aa4f-c9632f7dec17 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:35.301593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8853bc00-b6a7-4c3f-aa4f-c9632f7dec17 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:35.307524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8853bc00-b6a7-4c3f-aa4f-c9632f7dec17 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:35.308001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8853bc00-b6a7-4c3f-aa4f-c9632f7dec17 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:35.308768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8853bc00-b6a7-4c3f-aa4f-c9632f7dec17 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:35.309202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8853bc00-b6a7-4c3f-aa4f-c9632f7dec17 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:35.338022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8853bc00-b6a7-4c3f-aa4f-c9632f7dec17 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040843 May 12 06:55:35.338553 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 266/531] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:35 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:36.183743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0b9f0ad1-9ab9-469d-9be5-19f5f52144c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:36.184279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0b9f0ad1-9ab9-469d-9be5-19f5f52144c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:36.188702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dc31c641-4ab5-4779-b820-6eb84d9c3b2f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:36.189318 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dc31c641-4ab5-4779-b820-6eb84d9c3b2f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:36.190858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b9f0ad1-9ab9-469d-9be5-19f5f52144c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:36.191314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b9f0ad1-9ab9-469d-9be5-19f5f52144c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:36.192154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b9f0ad1-9ab9-469d-9be5-19f5f52144c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:36.192598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b9f0ad1-9ab9-469d-9be5-19f5f52144c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:36.195582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc31c641-4ab5-4779-b820-6eb84d9c3b2f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:36.196073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc31c641-4ab5-4779-b820-6eb84d9c3b2f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:36.196853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc31c641-4ab5-4779-b820-6eb84d9c3b2f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:36.197294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc31c641-4ab5-4779-b820-6eb84d9c3b2f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:36.408249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dc31c641-4ab5-4779-b820-6eb84d9c3b2f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:36.412060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0b9f0ad1-9ab9-469d-9be5-19f5f52144c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:36.416693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dc31c641-4ab5-4779-b820-6eb84d9c3b2f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.231806 May 12 06:55:36.417271 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 267/532] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:36.420994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0b9f0ad1-9ab9-469d-9be5-19f5f52144c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:36.422061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b1e2b39e-9562-4ef0-b0cf-e3d0089a3235 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:36.422600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0b9f0ad1-9ab9-469d-9be5-19f5f52144c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:36.422977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b1e2b39e-9562-4ef0-b0cf-e3d0089a3235 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:36.423765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0b9f0ad1-9ab9-469d-9be5-19f5f52144c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.245762 May 12 06:55:36.424450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 266/533] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:36 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:36.428714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1e2b39e-9562-4ef0-b0cf-e3d0089a3235 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:36.429165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1e2b39e-9562-4ef0-b0cf-e3d0089a3235 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:36.429924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1e2b39e-9562-4ef0-b0cf-e3d0089a3235 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:36.430358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1e2b39e-9562-4ef0-b0cf-e3d0089a3235 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:36.458057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b1e2b39e-9562-4ef0-b0cf-e3d0089a3235 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039828 May 12 06:55:36.458607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 268/534] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:36 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:37.434869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6780dade-e872-44fc-9644-022a515f1a9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:37.435509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6780dade-e872-44fc-9644-022a515f1a9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:37.441557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c21c1476-aa55-45e4-8bd8-ba7ab2714b78 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:37.441985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6780dade-e872-44fc-9644-022a515f1a9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:37.442174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c21c1476-aa55-45e4-8bd8-ba7ab2714b78 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:37.442296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6780dade-e872-44fc-9644-022a515f1a9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:37.443077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6780dade-e872-44fc-9644-022a515f1a9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:37.443509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6780dade-e872-44fc-9644-022a515f1a9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:37.448440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c21c1476-aa55-45e4-8bd8-ba7ab2714b78 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:37.448906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c21c1476-aa55-45e4-8bd8-ba7ab2714b78 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:37.449670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c21c1476-aa55-45e4-8bd8-ba7ab2714b78 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:37.450112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c21c1476-aa55-45e4-8bd8-ba7ab2714b78 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:37.627917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6780dade-e872-44fc-9644-022a515f1a9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:37.631405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c21c1476-aa55-45e4-8bd8-ba7ab2714b78 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:37.636548 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6780dade-e872-44fc-9644-022a515f1a9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.206107 May 12 06:55:37.637130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 267/535] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:37.648935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-702cdf89-da75-4349-8f78-588f890ac5db tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:37.649551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c21c1476-aa55-45e4-8bd8-ba7ab2714b78 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:37.649890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-702cdf89-da75-4349-8f78-588f890ac5db tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:37.651047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c21c1476-aa55-45e4-8bd8-ba7ab2714b78 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:37.652303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c21c1476-aa55-45e4-8bd8-ba7ab2714b78 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.214610 May 12 06:55:37.652853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 269/536] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:37 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:37.656126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-702cdf89-da75-4349-8f78-588f890ac5db tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:37.656578 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-702cdf89-da75-4349-8f78-588f890ac5db tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:37.657347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-702cdf89-da75-4349-8f78-588f890ac5db tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:37.657784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-702cdf89-da75-4349-8f78-588f890ac5db tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:37.688721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-702cdf89-da75-4349-8f78-588f890ac5db tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050543 May 12 06:55:37.689208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 268/537] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:37 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:38.653598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cda5e5da-210d-41d5-8b19-7eb17675b9a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:38.654206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cda5e5da-210d-41d5-8b19-7eb17675b9a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:38.660583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cda5e5da-210d-41d5-8b19-7eb17675b9a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:38.661029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cda5e5da-210d-41d5-8b19-7eb17675b9a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:38.661826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cda5e5da-210d-41d5-8b19-7eb17675b9a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:38.662277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cda5e5da-210d-41d5-8b19-7eb17675b9a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:38.670415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f289707e-6052-48b2-850c-61132896a8cc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:38.671104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f289707e-6052-48b2-850c-61132896a8cc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:38.677720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f289707e-6052-48b2-850c-61132896a8cc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:38.678260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f289707e-6052-48b2-850c-61132896a8cc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:38.679111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f289707e-6052-48b2-850c-61132896a8cc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:38.679708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f289707e-6052-48b2-850c-61132896a8cc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:38.857029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cda5e5da-210d-41d5-8b19-7eb17675b9a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:38.860901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f289707e-6052-48b2-850c-61132896a8cc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:38.864865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cda5e5da-210d-41d5-8b19-7eb17675b9a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.215384 May 12 06:55:38.865427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 270/538] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:38 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:38.870540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7ef97bd7-4f1b-4d1f-98e9-73326673e546 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:38.871450 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7ef97bd7-4f1b-4d1f-98e9-73326673e546 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:38.873512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f289707e-6052-48b2-850c-61132896a8cc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:38.875064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f289707e-6052-48b2-850c-61132896a8cc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:38.876298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f289707e-6052-48b2-850c-61132896a8cc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.209989 May 12 06:55:38.876867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 269/539] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:38 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:38.877128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ef97bd7-4f1b-4d1f-98e9-73326673e546 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:38.877567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ef97bd7-4f1b-4d1f-98e9-73326673e546 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:38.878343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ef97bd7-4f1b-4d1f-98e9-73326673e546 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:38.878776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ef97bd7-4f1b-4d1f-98e9-73326673e546 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:38.906162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7ef97bd7-4f1b-4d1f-98e9-73326673e546 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039776 May 12 06:55:38.906705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 271/540] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:38 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:39.881800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-135ff9e8-df27-4162-a4b6-a63ce867568e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:39.882412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-135ff9e8-df27-4162-a4b6-a63ce867568e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:39.889016 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-135ff9e8-df27-4162-a4b6-a63ce867568e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:39.889469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-135ff9e8-df27-4162-a4b6-a63ce867568e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:39.890251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-135ff9e8-df27-4162-a4b6-a63ce867568e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:39.890687 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-135ff9e8-df27-4162-a4b6-a63ce867568e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:39.894079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9d096625-09cb-4e39-b25f-221d749ba5ba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:39.894696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9d096625-09cb-4e39-b25f-221d749ba5ba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:39.901052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d096625-09cb-4e39-b25f-221d749ba5ba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:39.901502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d096625-09cb-4e39-b25f-221d749ba5ba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:39.902279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d096625-09cb-4e39-b25f-221d749ba5ba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:39.902717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d096625-09cb-4e39-b25f-221d749ba5ba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:40.080546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-135ff9e8-df27-4162-a4b6-a63ce867568e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:40.089815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9d096625-09cb-4e39-b25f-221d749ba5ba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:40.089973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-135ff9e8-df27-4162-a4b6-a63ce867568e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.211343 May 12 06:55:40.091120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 270/541] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:40.095708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7eff48d8-0ec3-46c2-a88e-b51de887a3e3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:40.096633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7eff48d8-0ec3-46c2-a88e-b51de887a3e3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:40.097502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9d096625-09cb-4e39-b25f-221d749ba5ba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:40.099434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9d096625-09cb-4e39-b25f-221d749ba5ba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:40.100479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9d096625-09cb-4e39-b25f-221d749ba5ba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.210185 May 12 06:55:40.101982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 272/542] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:39 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:40.104164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7eff48d8-0ec3-46c2-a88e-b51de887a3e3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:40.104620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7eff48d8-0ec3-46c2-a88e-b51de887a3e3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:40.105397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7eff48d8-0ec3-46c2-a88e-b51de887a3e3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:40.105837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7eff48d8-0ec3-46c2-a88e-b51de887a3e3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:40.134836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7eff48d8-0ec3-46c2-a88e-b51de887a3e3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042835 May 12 06:55:40.135413 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 271/543] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:40 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:41.106695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5d396638-e9a3-420e-8256-faf93166767f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:41.107314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5d396638-e9a3-420e-8256-faf93166767f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:41.113936 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d396638-e9a3-420e-8256-faf93166767f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:41.114461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d396638-e9a3-420e-8256-faf93166767f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:41.115172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d396638-e9a3-420e-8256-faf93166767f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:41.115611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d396638-e9a3-420e-8256-faf93166767f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:41.118065 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0ed6c41c-da85-43d2-b517-7cfa753cd444 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:41.118753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0ed6c41c-da85-43d2-b517-7cfa753cd444 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:41.124962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ed6c41c-da85-43d2-b517-7cfa753cd444 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:41.125413 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ed6c41c-da85-43d2-b517-7cfa753cd444 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:41.126187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ed6c41c-da85-43d2-b517-7cfa753cd444 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:41.126624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ed6c41c-da85-43d2-b517-7cfa753cd444 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:41.304636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5d396638-e9a3-420e-8256-faf93166767f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:41.307537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0ed6c41c-da85-43d2-b517-7cfa753cd444 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:41.312433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5d396638-e9a3-420e-8256-faf93166767f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.209538 May 12 06:55:41.313084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 273/544] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:41 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:41.315913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0ed6c41c-da85-43d2-b517-7cfa753cd444 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:41.317424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0ed6c41c-da85-43d2-b517-7cfa753cd444 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:41.317640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d6c849f6-8e18-4eaa-98cd-4cc5c14878b7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:41.318525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d6c849f6-8e18-4eaa-98cd-4cc5c14878b7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:41.318632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0ed6c41c-da85-43d2-b517-7cfa753cd444 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.204357 May 12 06:55:41.319307 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 272/545] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:41 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:41.324631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c849f6-8e18-4eaa-98cd-4cc5c14878b7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:41.325075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c849f6-8e18-4eaa-98cd-4cc5c14878b7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:41.325847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c849f6-8e18-4eaa-98cd-4cc5c14878b7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:41.326282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c849f6-8e18-4eaa-98cd-4cc5c14878b7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:41.354290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d6c849f6-8e18-4eaa-98cd-4cc5c14878b7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040248 May 12 06:55:41.354833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 274/546] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:41 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:42.330372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-aee5f2ba-2dd2-4036-8aa1-ea7fd8cd99fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:42.331013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-aee5f2ba-2dd2-4036-8aa1-ea7fd8cd99fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:42.336969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6351f3a5-c36a-48e3-9af4-05b5fa75d057 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:42.337913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aee5f2ba-2dd2-4036-8aa1-ea7fd8cd99fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:42.338102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6351f3a5-c36a-48e3-9af4-05b5fa75d057 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:42.338349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aee5f2ba-2dd2-4036-8aa1-ea7fd8cd99fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:42.339117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aee5f2ba-2dd2-4036-8aa1-ea7fd8cd99fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:42.339557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aee5f2ba-2dd2-4036-8aa1-ea7fd8cd99fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:42.344361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6351f3a5-c36a-48e3-9af4-05b5fa75d057 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:42.344813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6351f3a5-c36a-48e3-9af4-05b5fa75d057 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:42.345889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6351f3a5-c36a-48e3-9af4-05b5fa75d057 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:42.346329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6351f3a5-c36a-48e3-9af4-05b5fa75d057 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:42.520999 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aee5f2ba-2dd2-4036-8aa1-ea7fd8cd99fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:42.527941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6351f3a5-c36a-48e3-9af4-05b5fa75d057 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:42.529315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-aee5f2ba-2dd2-4036-8aa1-ea7fd8cd99fb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.202717 May 12 06:55:42.530135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 273/547] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:42 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:42.534488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4929a37c-8e99-489d-9f7e-46361edec4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:42.535441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4929a37c-8e99-489d-9f7e-46361edec4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:42.536360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6351f3a5-c36a-48e3-9af4-05b5fa75d057 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:42.537863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6351f3a5-c36a-48e3-9af4-05b5fa75d057 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:42.539043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6351f3a5-c36a-48e3-9af4-05b5fa75d057 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.205945 May 12 06:55:42.539729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 275/548] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:42 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:42.541793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4929a37c-8e99-489d-9f7e-46361edec4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:42.542250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4929a37c-8e99-489d-9f7e-46361edec4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:42.543022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4929a37c-8e99-489d-9f7e-46361edec4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:42.543753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4929a37c-8e99-489d-9f7e-46361edec4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:42.572069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4929a37c-8e99-489d-9f7e-46361edec4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040665 May 12 06:55:42.572615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 274/549] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:42 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:43.547212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-84e81b9b-b3c1-4111-84be-e453b3ae216b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:43.547887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-84e81b9b-b3c1-4111-84be-e453b3ae216b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:43.554247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84e81b9b-b3c1-4111-84be-e453b3ae216b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:43.554694 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84e81b9b-b3c1-4111-84be-e453b3ae216b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:43.555463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84e81b9b-b3c1-4111-84be-e453b3ae216b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:43.556900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84e81b9b-b3c1-4111-84be-e453b3ae216b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:43.560752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a894e56d-b1d4-4b47-8536-8ab5f18add72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:43.560752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a894e56d-b1d4-4b47-8536-8ab5f18add72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:43.567668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a894e56d-b1d4-4b47-8536-8ab5f18add72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:43.568145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a894e56d-b1d4-4b47-8536-8ab5f18add72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:43.569021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a894e56d-b1d4-4b47-8536-8ab5f18add72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:43.569459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a894e56d-b1d4-4b47-8536-8ab5f18add72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:43.759770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-84e81b9b-b3c1-4111-84be-e453b3ae216b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:43.762701 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a894e56d-b1d4-4b47-8536-8ab5f18add72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:43.767573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-84e81b9b-b3c1-4111-84be-e453b3ae216b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.224416 May 12 06:55:43.768185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 276/550] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:43.771453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a894e56d-b1d4-4b47-8536-8ab5f18add72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:43.772771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9eee517a-2f2a-4b92-a225-345c0795ac99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:43.773169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a894e56d-b1d4-4b47-8536-8ab5f18add72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:43.773714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9eee517a-2f2a-4b92-a225-345c0795ac99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:43.774479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a894e56d-b1d4-4b47-8536-8ab5f18add72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.220516 May 12 06:55:43.775948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 275/551] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:43 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:43.779972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9eee517a-2f2a-4b92-a225-345c0795ac99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:43.780441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9eee517a-2f2a-4b92-a225-345c0795ac99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:43.781198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9eee517a-2f2a-4b92-a225-345c0795ac99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:43.781635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9eee517a-2f2a-4b92-a225-345c0795ac99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:43.812181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9eee517a-2f2a-4b92-a225-345c0795ac99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042707 May 12 06:55:43.812710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 277/552] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:43 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:44.785212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1077d0d6-1536-4959-b5a4-48b9e484d97d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:44.785822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1077d0d6-1536-4959-b5a4-48b9e484d97d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:44.792555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1077d0d6-1536-4959-b5a4-48b9e484d97d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:44.792867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d7108862-aab0-4da3-b345-03085760664c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:44.793294 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1077d0d6-1536-4959-b5a4-48b9e484d97d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:44.793727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d7108862-aab0-4da3-b345-03085760664c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:44.794021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1077d0d6-1536-4959-b5a4-48b9e484d97d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:44.794459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1077d0d6-1536-4959-b5a4-48b9e484d97d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:44.799918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7108862-aab0-4da3-b345-03085760664c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:44.800367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7108862-aab0-4da3-b345-03085760664c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:44.801155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7108862-aab0-4da3-b345-03085760664c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:44.801585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7108862-aab0-4da3-b345-03085760664c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:44.983815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1077d0d6-1536-4959-b5a4-48b9e484d97d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:44.986572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d7108862-aab0-4da3-b345-03085760664c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:44.992274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1077d0d6-1536-4959-b5a4-48b9e484d97d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.210862 May 12 06:55:44.993053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 276/553] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:44.998439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-39ee2269-6965-466c-a235-79594d1f72d9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:44.999400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-39ee2269-6965-466c-a235-79594d1f72d9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:45.003065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d7108862-aab0-4da3-b345-03085760664c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:45.004617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d7108862-aab0-4da3-b345-03085760664c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:45.005320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39ee2269-6965-466c-a235-79594d1f72d9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:45.005778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39ee2269-6965-466c-a235-79594d1f72d9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:45.005902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d7108862-aab0-4da3-b345-03085760664c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.217280 May 12 06:55:45.007680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 278/554] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:44 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:45.007836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39ee2269-6965-466c-a235-79594d1f72d9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:45.007836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39ee2269-6965-466c-a235-79594d1f72d9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:45.035828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-39ee2269-6965-466c-a235-79594d1f72d9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041263 May 12 06:55:45.036382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 277/555] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:44 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:46.010629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d58347ca-859f-4904-a237-852f8ca29bb6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:46.011265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d58347ca-859f-4904-a237-852f8ca29bb6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:46.017658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d58347ca-859f-4904-a237-852f8ca29bb6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:46.018123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d58347ca-859f-4904-a237-852f8ca29bb6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:46.018889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d58347ca-859f-4904-a237-852f8ca29bb6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:46.019324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d58347ca-859f-4904-a237-852f8ca29bb6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:46.024178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9a873de3-a189-42c1-bc22-3b45f71dd4f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:46.024867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9a873de3-a189-42c1-bc22-3b45f71dd4f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:46.031114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9a873de3-a189-42c1-bc22-3b45f71dd4f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:46.031565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9a873de3-a189-42c1-bc22-3b45f71dd4f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:46.032409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9a873de3-a189-42c1-bc22-3b45f71dd4f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:46.032845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9a873de3-a189-42c1-bc22-3b45f71dd4f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:46.211033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d58347ca-859f-4904-a237-852f8ca29bb6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:46.219301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d58347ca-859f-4904-a237-852f8ca29bb6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.213131 May 12 06:55:46.219887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 279/556] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:46 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:46.222492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9a873de3-a189-42c1-bc22-3b45f71dd4f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:46.224384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-492fb479-5609-4f56-ae1d-05fe21710258 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:46.225443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-492fb479-5609-4f56-ae1d-05fe21710258 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:46.231602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-492fb479-5609-4f56-ae1d-05fe21710258 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:46.232167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-492fb479-5609-4f56-ae1d-05fe21710258 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:46.233016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-492fb479-5609-4f56-ae1d-05fe21710258 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:46.233514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9a873de3-a189-42c1-bc22-3b45f71dd4f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:46.233642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-492fb479-5609-4f56-ae1d-05fe21710258 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:46.235110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9a873de3-a189-42c1-bc22-3b45f71dd4f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:46.236308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9a873de3-a189-42c1-bc22-3b45f71dd4f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.216027 May 12 06:55:46.236917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 278/557] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:46 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:46.262315 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-492fb479-5609-4f56-ae1d-05fe21710258 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041346 May 12 06:55:46.262776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 280/558] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:46 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:47.236478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-90295346-21d7-46ec-be3a-692ada9253e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:47.237085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-90295346-21d7-46ec-be3a-692ada9253e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:47.244005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90295346-21d7-46ec-be3a-692ada9253e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:47.244375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90295346-21d7-46ec-be3a-692ada9253e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:47.245133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90295346-21d7-46ec-be3a-692ada9253e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:47.245563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90295346-21d7-46ec-be3a-692ada9253e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:47.255362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f852c049-f6ab-46e1-8151-58800519d632 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:47.255990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f852c049-f6ab-46e1-8151-58800519d632 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:47.262136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f852c049-f6ab-46e1-8151-58800519d632 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:47.262578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f852c049-f6ab-46e1-8151-58800519d632 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:47.263340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f852c049-f6ab-46e1-8151-58800519d632 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:47.263795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f852c049-f6ab-46e1-8151-58800519d632 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:47.427657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-90295346-21d7-46ec-be3a-692ada9253e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:47.436009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-90295346-21d7-46ec-be3a-692ada9253e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.203212 May 12 06:55:47.436569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 279/559] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:47.441064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a7456635-0dad-4f0f-92eb-195ddf54d9fe tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:47.442075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a7456635-0dad-4f0f-92eb-195ddf54d9fe tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:47.447639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7456635-0dad-4f0f-92eb-195ddf54d9fe tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:47.448123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7456635-0dad-4f0f-92eb-195ddf54d9fe tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:47.448894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7456635-0dad-4f0f-92eb-195ddf54d9fe tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:47.449334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7456635-0dad-4f0f-92eb-195ddf54d9fe tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:47.449433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f852c049-f6ab-46e1-8151-58800519d632 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:47.457699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f852c049-f6ab-46e1-8151-58800519d632 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:47.459187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f852c049-f6ab-46e1-8151-58800519d632 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:47.460383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f852c049-f6ab-46e1-8151-58800519d632 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.208811 May 12 06:55:47.460945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 281/560] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:47 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:47.478742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a7456635-0dad-4f0f-92eb-195ddf54d9fe tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040561 May 12 06:55:47.479293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 280/561] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:47 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:48.453002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d50ca222-1f93-4ce4-936c-55820e04d984 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:48.453555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d50ca222-1f93-4ce4-936c-55820e04d984 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:48.459846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d50ca222-1f93-4ce4-936c-55820e04d984 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:48.460294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d50ca222-1f93-4ce4-936c-55820e04d984 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:48.461068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d50ca222-1f93-4ce4-936c-55820e04d984 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:48.461506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d50ca222-1f93-4ce4-936c-55820e04d984 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:48.479347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-99a51c39-acec-4394-81c8-c8736fe643f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:48.480067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-99a51c39-acec-4394-81c8-c8736fe643f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:48.486417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99a51c39-acec-4394-81c8-c8736fe643f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:48.486869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99a51c39-acec-4394-81c8-c8736fe643f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:48.487784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99a51c39-acec-4394-81c8-c8736fe643f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:48.488224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99a51c39-acec-4394-81c8-c8736fe643f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:48.650804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d50ca222-1f93-4ce4-936c-55820e04d984 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:48.657814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-99a51c39-acec-4394-81c8-c8736fe643f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:48.658589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d50ca222-1f93-4ce4-936c-55820e04d984 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.209465 May 12 06:55:48.659162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 282/562] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:48 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:48.663653 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-42e57c63-6234-451e-84d2-b547125f6eeb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:48.664581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-42e57c63-6234-451e-84d2-b547125f6eeb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:48.666192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-99a51c39-acec-4394-81c8-c8736fe643f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:48.667711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-99a51c39-acec-4394-81c8-c8736fe643f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:48.669125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-99a51c39-acec-4394-81c8-c8736fe643f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.194238 May 12 06:55:48.669677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 281/563] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:48 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:48.670559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42e57c63-6234-451e-84d2-b547125f6eeb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:48.671014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42e57c63-6234-451e-84d2-b547125f6eeb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:48.671820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42e57c63-6234-451e-84d2-b547125f6eeb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:48.672259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42e57c63-6234-451e-84d2-b547125f6eeb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:48.700278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-42e57c63-6234-451e-84d2-b547125f6eeb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040143 May 12 06:55:48.700830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 283/564] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:48 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:49.675646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e7050c66-0e83-471b-918a-1c82b1977a48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:49.676289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e7050c66-0e83-471b-918a-1c82b1977a48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:49.683236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e7050c66-0e83-471b-918a-1c82b1977a48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:49.683596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e7050c66-0e83-471b-918a-1c82b1977a48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:49.684394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e7050c66-0e83-471b-918a-1c82b1977a48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:49.684836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e7050c66-0e83-471b-918a-1c82b1977a48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:49.687248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-558cd6ec-7551-49dd-8450-1e4595c55a70 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:49.687893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-558cd6ec-7551-49dd-8450-1e4595c55a70 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:49.693849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-558cd6ec-7551-49dd-8450-1e4595c55a70 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:49.694305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-558cd6ec-7551-49dd-8450-1e4595c55a70 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:49.695075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-558cd6ec-7551-49dd-8450-1e4595c55a70 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:49.695511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-558cd6ec-7551-49dd-8450-1e4595c55a70 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:49.868000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e7050c66-0e83-471b-918a-1c82b1977a48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:49.871736 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-558cd6ec-7551-49dd-8450-1e4595c55a70 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:49.876387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e7050c66-0e83-471b-918a-1c82b1977a48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.204614 May 12 06:55:49.876967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 282/565] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:49 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:49.880005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-558cd6ec-7551-49dd-8450-1e4595c55a70 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:49.881501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-133e0888-808b-4a6a-89ee-8be29f9130c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:49.881624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-558cd6ec-7551-49dd-8450-1e4595c55a70 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:49.882404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-133e0888-808b-4a6a-89ee-8be29f9130c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:49.882929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-558cd6ec-7551-49dd-8450-1e4595c55a70 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.199422 May 12 06:55:49.883574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 284/566] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:49 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:49.888630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-133e0888-808b-4a6a-89ee-8be29f9130c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:49.889074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-133e0888-808b-4a6a-89ee-8be29f9130c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:49.889837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-133e0888-808b-4a6a-89ee-8be29f9130c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:49.890274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-133e0888-808b-4a6a-89ee-8be29f9130c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:49.919492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-133e0888-808b-4a6a-89ee-8be29f9130c4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041546 May 12 06:55:49.920064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 283/567] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:49 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:50.894418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0fd542ab-70cf-41e7-8882-75a666d2ff1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:50.894927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0fd542ab-70cf-41e7-8882-75a666d2ff1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:50.900707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-89adfe44-f611-4525-bcd9-36eceb9c6d72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:50.901316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-89adfe44-f611-4525-bcd9-36eceb9c6d72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:50.901442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0fd542ab-70cf-41e7-8882-75a666d2ff1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:50.901883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0fd542ab-70cf-41e7-8882-75a666d2ff1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:50.902658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0fd542ab-70cf-41e7-8882-75a666d2ff1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:50.903092 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0fd542ab-70cf-41e7-8882-75a666d2ff1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:50.907426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-89adfe44-f611-4525-bcd9-36eceb9c6d72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:50.907917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-89adfe44-f611-4525-bcd9-36eceb9c6d72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:50.908681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-89adfe44-f611-4525-bcd9-36eceb9c6d72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:50.909113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-89adfe44-f611-4525-bcd9-36eceb9c6d72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:51.093948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0fd542ab-70cf-41e7-8882-75a666d2ff1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:51.097700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-89adfe44-f611-4525-bcd9-36eceb9c6d72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:51.102261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0fd542ab-70cf-41e7-8882-75a666d2ff1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.211670 May 12 06:55:51.102846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 285/568] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:51.106002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-89adfe44-f611-4525-bcd9-36eceb9c6d72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:51.107367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a4796627-6c52-41ce-b611-343f3f15fda8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:51.107483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-89adfe44-f611-4525-bcd9-36eceb9c6d72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:51.108304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a4796627-6c52-41ce-b611-343f3f15fda8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:51.108691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-89adfe44-f611-4525-bcd9-36eceb9c6d72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.211866 May 12 06:55:51.109400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 284/569] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:50 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:51.114024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4796627-6c52-41ce-b611-343f3f15fda8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:51.114475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4796627-6c52-41ce-b611-343f3f15fda8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:51.115247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4796627-6c52-41ce-b611-343f3f15fda8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:51.115704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4796627-6c52-41ce-b611-343f3f15fda8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:51.144156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a4796627-6c52-41ce-b611-343f3f15fda8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040237 May 12 06:55:51.144763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 286/570] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:51 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:52.120196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-04a3ae50-8e07-491d-9a27-6fbfb12235f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:52.120837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-04a3ae50-8e07-491d-9a27-6fbfb12235f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:52.126227 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-41a37f62-7294-4e9c-80d8-31ef57af919f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:52.126846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-41a37f62-7294-4e9c-80d8-31ef57af919f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:52.127111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a3ae50-8e07-491d-9a27-6fbfb12235f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:52.127558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a3ae50-8e07-491d-9a27-6fbfb12235f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:52.128363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a3ae50-8e07-491d-9a27-6fbfb12235f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:52.128797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a3ae50-8e07-491d-9a27-6fbfb12235f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:52.132948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41a37f62-7294-4e9c-80d8-31ef57af919f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:52.133406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41a37f62-7294-4e9c-80d8-31ef57af919f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:52.134856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41a37f62-7294-4e9c-80d8-31ef57af919f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:52.135294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41a37f62-7294-4e9c-80d8-31ef57af919f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:52.319678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-04a3ae50-8e07-491d-9a27-6fbfb12235f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:52.323541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-41a37f62-7294-4e9c-80d8-31ef57af919f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:52.328409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-04a3ae50-8e07-491d-9a27-6fbfb12235f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.212572 May 12 06:55:52.328998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 285/571] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:52.331952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-41a37f62-7294-4e9c-80d8-31ef57af919f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:52.333563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-41a37f62-7294-4e9c-80d8-31ef57af919f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:52.333700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-62a3c4d5-2278-415d-959e-7d901bd36b06 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:52.334376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-62a3c4d5-2278-415d-959e-7d901bd36b06 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:52.334614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-41a37f62-7294-4e9c-80d8-31ef57af919f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.212336 May 12 06:55:52.345409 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 287/572] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:52 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:52.345600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62a3c4d5-2278-415d-959e-7d901bd36b06 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:52.345600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62a3c4d5-2278-415d-959e-7d901bd36b06 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:52.345600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62a3c4d5-2278-415d-959e-7d901bd36b06 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:52.345600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62a3c4d5-2278-415d-959e-7d901bd36b06 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:52.370749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-62a3c4d5-2278-415d-959e-7d901bd36b06 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040753 May 12 06:55:52.371391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 286/573] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:52 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:53.345846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-61851524-6ec9-4d1d-b325-d806ca27e063 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:53.346447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-61851524-6ec9-4d1d-b325-d806ca27e063 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:53.353319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61851524-6ec9-4d1d-b325-d806ca27e063 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:53.353508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e065cd73-3c37-4d4e-80fe-63557f584827 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:53.353876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61851524-6ec9-4d1d-b325-d806ca27e063 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:53.353961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e065cd73-3c37-4d4e-80fe-63557f584827 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:53.354519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61851524-6ec9-4d1d-b325-d806ca27e063 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:53.354957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61851524-6ec9-4d1d-b325-d806ca27e063 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:53.360180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e065cd73-3c37-4d4e-80fe-63557f584827 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:53.360630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e065cd73-3c37-4d4e-80fe-63557f584827 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:53.361403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e065cd73-3c37-4d4e-80fe-63557f584827 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:53.361841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e065cd73-3c37-4d4e-80fe-63557f584827 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:53.544231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-61851524-6ec9-4d1d-b325-d806ca27e063 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:53.546926 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e065cd73-3c37-4d4e-80fe-63557f584827 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:53.552082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-61851524-6ec9-4d1d-b325-d806ca27e063 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.209890 May 12 06:55:53.552656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 288/574] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:53.559904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e065cd73-3c37-4d4e-80fe-63557f584827 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:53.559904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e065cd73-3c37-4d4e-80fe-63557f584827 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:53.560139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1e7384eb-6dc3-4be9-aa6e-55067bc2c4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:53.560139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1e7384eb-6dc3-4be9-aa6e-55067bc2c4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:53.560290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e065cd73-3c37-4d4e-80fe-63557f584827 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.209090 May 12 06:55:53.560290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 287/575] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:53 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:53.563742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e7384eb-6dc3-4be9-aa6e-55067bc2c4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:53.564195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e7384eb-6dc3-4be9-aa6e-55067bc2c4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:53.564961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e7384eb-6dc3-4be9-aa6e-55067bc2c4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:53.565396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e7384eb-6dc3-4be9-aa6e-55067bc2c4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:53.593327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1e7384eb-6dc3-4be9-aa6e-55067bc2c4ae tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039661 May 12 06:55:53.593804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 289/576] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:53 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:54.569162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-71dce7ac-31b9-41e0-b160-3fa7d47e8e5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:54.569775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-71dce7ac-31b9-41e0-b160-3fa7d47e8e5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:54.576577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-71dce7ac-31b9-41e0-b160-3fa7d47e8e5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:54.576770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1b5414f6-ab67-4983-9bb7-8f1fbfbdda0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:54.577169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-71dce7ac-31b9-41e0-b160-3fa7d47e8e5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:54.577388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1b5414f6-ab67-4983-9bb7-8f1fbfbdda0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:54.577832 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-71dce7ac-31b9-41e0-b160-3fa7d47e8e5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:54.578271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-71dce7ac-31b9-41e0-b160-3fa7d47e8e5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:54.583884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1b5414f6-ab67-4983-9bb7-8f1fbfbdda0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:54.584376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1b5414f6-ab67-4983-9bb7-8f1fbfbdda0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:54.585157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1b5414f6-ab67-4983-9bb7-8f1fbfbdda0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:54.585621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1b5414f6-ab67-4983-9bb7-8f1fbfbdda0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:54.765767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-71dce7ac-31b9-41e0-b160-3fa7d47e8e5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:54.772242 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1b5414f6-ab67-4983-9bb7-8f1fbfbdda0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:54.773532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-71dce7ac-31b9-41e0-b160-3fa7d47e8e5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.208228 May 12 06:55:54.774102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 288/577] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:54.779345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e19bed8d-1cb4-4889-bc97-b5c85917d277 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:54.780275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e19bed8d-1cb4-4889-bc97-b5c85917d277 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:54.781152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1b5414f6-ab67-4983-9bb7-8f1fbfbdda0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:54.782654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1b5414f6-ab67-4983-9bb7-8f1fbfbdda0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:54.783824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1b5414f6-ab67-4983-9bb7-8f1fbfbdda0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.210909 May 12 06:55:54.784490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 290/578] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:54 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:54.785961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e19bed8d-1cb4-4889-bc97-b5c85917d277 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:54.786405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e19bed8d-1cb4-4889-bc97-b5c85917d277 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:54.787167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e19bed8d-1cb4-4889-bc97-b5c85917d277 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:54.787597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e19bed8d-1cb4-4889-bc97-b5c85917d277 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:54.815538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e19bed8d-1cb4-4889-bc97-b5c85917d277 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039787 May 12 06:55:54.816108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 289/579] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:54 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:55.791132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b9f9c8c2-810a-44d0-adb8-52fcb48f515c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:55.791772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b9f9c8c2-810a-44d0-adb8-52fcb48f515c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:55.798577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9f9c8c2-810a-44d0-adb8-52fcb48f515c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:55.799137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9f9c8c2-810a-44d0-adb8-52fcb48f515c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:55.799987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9f9c8c2-810a-44d0-adb8-52fcb48f515c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:55.800425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9f9c8c2-810a-44d0-adb8-52fcb48f515c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:55.801993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ee11bec9-1f66-443b-b508-b67b3a96c14b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:55.802610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ee11bec9-1f66-443b-b508-b67b3a96c14b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:55.809523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee11bec9-1f66-443b-b508-b67b3a96c14b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:55.809980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee11bec9-1f66-443b-b508-b67b3a96c14b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:55.810759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee11bec9-1f66-443b-b508-b67b3a96c14b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:55.811201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee11bec9-1f66-443b-b508-b67b3a96c14b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:56.003388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b9f9c8c2-810a-44d0-adb8-52fcb48f515c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:56.007562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ee11bec9-1f66-443b-b508-b67b3a96c14b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:56.011883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b9f9c8c2-810a-44d0-adb8-52fcb48f515c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.224537 May 12 06:55:56.012655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 291/580] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:55 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:56.017015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7ee5d8cd-0f97-4c81-8cab-e1b6daf407e7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:56.017925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7ee5d8cd-0f97-4c81-8cab-e1b6daf407e7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:56.022732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ee11bec9-1f66-443b-b508-b67b3a96c14b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:56.023509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ee5d8cd-0f97-4c81-8cab-e1b6daf407e7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:56.023999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ee5d8cd-0f97-4c81-8cab-e1b6daf407e7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:56.024525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ee11bec9-1f66-443b-b508-b67b3a96c14b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:56.024776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ee5d8cd-0f97-4c81-8cab-e1b6daf407e7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:56.025227 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ee5d8cd-0f97-4c81-8cab-e1b6daf407e7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:56.025899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ee11bec9-1f66-443b-b508-b67b3a96c14b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.227733 May 12 06:55:56.026787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 290/581] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:55 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:56.054470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7ee5d8cd-0f97-4c81-8cab-e1b6daf407e7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040897 May 12 06:55:56.055045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 292/582] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:56 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:57.029903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a4e28a3a-a97c-4a29-bc2e-4171423b722d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:57.030505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a4e28a3a-a97c-4a29-bc2e-4171423b722d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:57.036886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4e28a3a-a97c-4a29-bc2e-4171423b722d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:57.037321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4e28a3a-a97c-4a29-bc2e-4171423b722d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:57.038134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4e28a3a-a97c-4a29-bc2e-4171423b722d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:57.038605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4e28a3a-a97c-4a29-bc2e-4171423b722d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:57.044303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bad613e8-a4d0-4017-bd42-b561bb89fe4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:57.050125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bad613e8-a4d0-4017-bd42-b561bb89fe4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:57.051310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bad613e8-a4d0-4017-bd42-b561bb89fe4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:57.051805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bad613e8-a4d0-4017-bd42-b561bb89fe4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:57.052625 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bad613e8-a4d0-4017-bd42-b561bb89fe4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:57.053068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bad613e8-a4d0-4017-bd42-b561bb89fe4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:57.227323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a4e28a3a-a97c-4a29-bc2e-4171423b722d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:57.233818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bad613e8-a4d0-4017-bd42-b561bb89fe4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:57.235388 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a4e28a3a-a97c-4a29-bc2e-4171423b722d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.209316 May 12 06:55:57.236000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 291/583] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:55:57.242495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bad613e8-a4d0-4017-bd42-b561bb89fe4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:57.242831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8d7dea7d-cbd6-4bfd-a508-2039f8c81328 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:57.244301 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8d7dea7d-cbd6-4bfd-a508-2039f8c81328 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:57.244575 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bad613e8-a4d0-4017-bd42-b561bb89fe4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:57.245739 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bad613e8-a4d0-4017-bd42-b561bb89fe4d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.205672 May 12 06:55:57.246311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 293/584] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:57 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:57.249943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7dea7d-cbd6-4bfd-a508-2039f8c81328 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:57.250395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7dea7d-cbd6-4bfd-a508-2039f8c81328 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:57.251159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7dea7d-cbd6-4bfd-a508-2039f8c81328 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:57.251600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7dea7d-cbd6-4bfd-a508-2039f8c81328 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:57.280519 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8d7dea7d-cbd6-4bfd-a508-2039f8c81328 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 May 12 06:55:57.281092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 292/585] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:57 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:58.253306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d3eb12fe-aa46-4e03-9351-a42bfd3b396a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:58.253838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d3eb12fe-aa46-4e03-9351-a42bfd3b396a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:58.260363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3eb12fe-aa46-4e03-9351-a42bfd3b396a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:58.260840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3eb12fe-aa46-4e03-9351-a42bfd3b396a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:58.261621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3eb12fe-aa46-4e03-9351-a42bfd3b396a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:58.262053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3eb12fe-aa46-4e03-9351-a42bfd3b396a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:58.263737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bb43fb3d-b761-40de-84a7-7a12a7cb2d10 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:58.264356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bb43fb3d-b761-40de-84a7-7a12a7cb2d10 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:58.270508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb43fb3d-b761-40de-84a7-7a12a7cb2d10 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:58.270962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb43fb3d-b761-40de-84a7-7a12a7cb2d10 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:58.271769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb43fb3d-b761-40de-84a7-7a12a7cb2d10 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:58.272208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb43fb3d-b761-40de-84a7-7a12a7cb2d10 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:58.453319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d3eb12fe-aa46-4e03-9351-a42bfd3b396a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:58.456990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bb43fb3d-b761-40de-84a7-7a12a7cb2d10 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:58.461660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d3eb12fe-aa46-4e03-9351-a42bfd3b396a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.212298 May 12 06:55:58.462972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 294/586] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:58.466019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bb43fb3d-b761-40de-84a7-7a12a7cb2d10 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:58.467530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bb43fb3d-b761-40de-84a7-7a12a7cb2d10 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:58.470896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bb43fb3d-b761-40de-84a7-7a12a7cb2d10 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.208953 May 12 06:55:58.470896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 293/587] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:58 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:55:58.475072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5c14a4aa-85b8-4e90-9ac5-d99572d7fcd7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:58.476024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5c14a4aa-85b8-4e90-9ac5-d99572d7fcd7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:58.481967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5c14a4aa-85b8-4e90-9ac5-d99572d7fcd7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:58.482416 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5c14a4aa-85b8-4e90-9ac5-d99572d7fcd7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:58.483182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5c14a4aa-85b8-4e90-9ac5-d99572d7fcd7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:58.483626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5c14a4aa-85b8-4e90-9ac5-d99572d7fcd7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:58.511658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5c14a4aa-85b8-4e90-9ac5-d99572d7fcd7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041274 May 12 06:55:58.512164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 295/588] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:58 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:55:59.480295 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-786524ee-9258-44aa-9d03-192ba83e3a33 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:59.480913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-786524ee-9258-44aa-9d03-192ba83e3a33 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:59.486360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3aa083f7-6765-40ee-8f0e-15e322e59548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:59.486978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3aa083f7-6765-40ee-8f0e-15e322e59548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:59.487584 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-786524ee-9258-44aa-9d03-192ba83e3a33 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:59.488070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-786524ee-9258-44aa-9d03-192ba83e3a33 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:59.488853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-786524ee-9258-44aa-9d03-192ba83e3a33 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:59.489292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-786524ee-9258-44aa-9d03-192ba83e3a33 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:59.494341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3aa083f7-6765-40ee-8f0e-15e322e59548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:59.494341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3aa083f7-6765-40ee-8f0e-15e322e59548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:59.494341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3aa083f7-6765-40ee-8f0e-15e322e59548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:59.494837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3aa083f7-6765-40ee-8f0e-15e322e59548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:59.676560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-786524ee-9258-44aa-9d03-192ba83e3a33 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:59.679277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3aa083f7-6765-40ee-8f0e-15e322e59548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:59.684839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-786524ee-9258-44aa-9d03-192ba83e3a33 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.208803 May 12 06:55:59.685346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 294/589] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:55:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:55:59.687798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3aa083f7-6765-40ee-8f0e-15e322e59548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:59.689347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3aa083f7-6765-40ee-8f0e-15e322e59548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:55:59.689857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c1875747-7702-4660-811f-d74fc904a525 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:55:59.690661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3aa083f7-6765-40ee-8f0e-15e322e59548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.208168 May 12 06:55:59.690771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c1875747-7702-4660-811f-d74fc904a525 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:55:59.691347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 296/590] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:55:59 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:55:59.697356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1875747-7702-4660-811f-d74fc904a525 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:59.697806 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1875747-7702-4660-811f-d74fc904a525 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:59.698579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1875747-7702-4660-811f-d74fc904a525 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:55:59.699031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1875747-7702-4660-811f-d74fc904a525 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:55:59.728419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c1875747-7702-4660-811f-d74fc904a525 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041431 May 12 06:55:59.728918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 295/591] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:55:59 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:00.702117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f7b7746f-7384-4324-9caf-1d6acd86d57c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:00.702753 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f7b7746f-7384-4324-9caf-1d6acd86d57c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:00.708630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-389d5100-421a-4086-838f-e8f773b664cf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:00.709088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7b7746f-7384-4324-9caf-1d6acd86d57c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:00.709281 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-389d5100-421a-4086-838f-e8f773b664cf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:00.709526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7b7746f-7384-4324-9caf-1d6acd86d57c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:00.710295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7b7746f-7384-4324-9caf-1d6acd86d57c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:00.710731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7b7746f-7384-4324-9caf-1d6acd86d57c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:00.716133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-389d5100-421a-4086-838f-e8f773b664cf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:00.716588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-389d5100-421a-4086-838f-e8f773b664cf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:00.717361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-389d5100-421a-4086-838f-e8f773b664cf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:00.717800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-389d5100-421a-4086-838f-e8f773b664cf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:00.896799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f7b7746f-7384-4324-9caf-1d6acd86d57c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:00.900163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-389d5100-421a-4086-838f-e8f773b664cf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:00.905259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f7b7746f-7384-4324-9caf-1d6acd86d57c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.206943 May 12 06:56:00.905832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 297/592] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:00.908472 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-389d5100-421a-4086-838f-e8f773b664cf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:00.909963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-389d5100-421a-4086-838f-e8f773b664cf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:00.910294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8458fc20-b3c6-4491-ba05-90daddf3aaf0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:00.911121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-389d5100-421a-4086-838f-e8f773b664cf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.206403 May 12 06:56:00.911225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8458fc20-b3c6-4491-ba05-90daddf3aaf0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:00.912330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 296/593] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:00 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:00.916982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8458fc20-b3c6-4491-ba05-90daddf3aaf0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:00.917430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8458fc20-b3c6-4491-ba05-90daddf3aaf0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:00.918200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8458fc20-b3c6-4491-ba05-90daddf3aaf0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:00.918635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8458fc20-b3c6-4491-ba05-90daddf3aaf0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:00.948145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8458fc20-b3c6-4491-ba05-90daddf3aaf0 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041280 May 12 06:56:00.948703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 298/594] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:00 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:01.922418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-528a61a7-3ad9-42d7-9bcb-f704e90ed6fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:01.923093 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-528a61a7-3ad9-42d7-9bcb-f704e90ed6fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:01.929177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-528a61a7-3ad9-42d7-9bcb-f704e90ed6fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:01.929640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-528a61a7-3ad9-42d7-9bcb-f704e90ed6fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:01.930211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0784865f-c81e-4c78-bb7f-2ba79d496cba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:01.930597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-528a61a7-3ad9-42d7-9bcb-f704e90ed6fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:01.930844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-528a61a7-3ad9-42d7-9bcb-f704e90ed6fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:01.930961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0784865f-c81e-4c78-bb7f-2ba79d496cba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:01.936969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0784865f-c81e-4c78-bb7f-2ba79d496cba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:01.937414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0784865f-c81e-4c78-bb7f-2ba79d496cba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:01.938183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0784865f-c81e-4c78-bb7f-2ba79d496cba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:01.938622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0784865f-c81e-4c78-bb7f-2ba79d496cba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:02.123128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-528a61a7-3ad9-42d7-9bcb-f704e90ed6fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:02.129714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0784865f-c81e-4c78-bb7f-2ba79d496cba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:02.131092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-528a61a7-3ad9-42d7-9bcb-f704e90ed6fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.212868 May 12 06:56:02.131663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 297/595] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:02.136906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b3481070-18a3-48e2-bc69-2ff1f7a782a7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:02.137942 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b3481070-18a3-48e2-bc69-2ff1f7a782a7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:02.138750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0784865f-c81e-4c78-bb7f-2ba79d496cba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:02.140572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0784865f-c81e-4c78-bb7f-2ba79d496cba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:02.141489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0784865f-c81e-4c78-bb7f-2ba79d496cba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.215130 May 12 06:56:02.142048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 299/596] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:01 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:02.143801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3481070-18a3-48e2-bc69-2ff1f7a782a7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:02.144258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3481070-18a3-48e2-bc69-2ff1f7a782a7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:02.145046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3481070-18a3-48e2-bc69-2ff1f7a782a7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:02.145479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3481070-18a3-48e2-bc69-2ff1f7a782a7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:02.173915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b3481070-18a3-48e2-bc69-2ff1f7a782a7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041279 May 12 06:56:02.174453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 298/597] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:02 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:03.149067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ebf27669-03d8-4d12-a86c-b7ac0cce1e09 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:03.150231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ebf27669-03d8-4d12-a86c-b7ac0cce1e09 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:03.156537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebf27669-03d8-4d12-a86c-b7ac0cce1e09 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:03.156990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebf27669-03d8-4d12-a86c-b7ac0cce1e09 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:03.157761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebf27669-03d8-4d12-a86c-b7ac0cce1e09 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:03.158194 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebf27669-03d8-4d12-a86c-b7ac0cce1e09 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:03.159909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5b18627c-6e19-4e1b-96c4-c6391a10a272 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:03.160532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5b18627c-6e19-4e1b-96c4-c6391a10a272 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:03.167261 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b18627c-6e19-4e1b-96c4-c6391a10a272 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:03.167732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b18627c-6e19-4e1b-96c4-c6391a10a272 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:03.168512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b18627c-6e19-4e1b-96c4-c6391a10a272 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:03.169206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b18627c-6e19-4e1b-96c4-c6391a10a272 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:03.349889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ebf27669-03d8-4d12-a86c-b7ac0cce1e09 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:03.356801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5b18627c-6e19-4e1b-96c4-c6391a10a272 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:03.358256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ebf27669-03d8-4d12-a86c-b7ac0cce1e09 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.213388 May 12 06:56:03.358839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 300/598] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:56:03.363388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0daee3be-3274-44ca-b168-6bf6336be403 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:03.364326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0daee3be-3274-44ca-b168-6bf6336be403 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:03.369993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5b18627c-6e19-4e1b-96c4-c6391a10a272 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:03.370186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0daee3be-3274-44ca-b168-6bf6336be403 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:03.370499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0daee3be-3274-44ca-b168-6bf6336be403 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:03.371273 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0daee3be-3274-44ca-b168-6bf6336be403 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:03.371527 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5b18627c-6e19-4e1b-96c4-c6391a10a272 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:03.371740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0daee3be-3274-44ca-b168-6bf6336be403 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:03.372751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5b18627c-6e19-4e1b-96c4-c6391a10a272 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.216683 May 12 06:56:03.373309 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 299/599] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:03.400064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0daee3be-3274-44ca-b168-6bf6336be403 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039644 May 12 06:56:03.400545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 301/600] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:03 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:04.375346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-474dcaf0-112e-4ab5-b8ec-3aef09701291 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:04.375985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-474dcaf0-112e-4ab5-b8ec-3aef09701291 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:04.382303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-474dcaf0-112e-4ab5-b8ec-3aef09701291 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:04.382756 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-474dcaf0-112e-4ab5-b8ec-3aef09701291 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:04.384054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-474dcaf0-112e-4ab5-b8ec-3aef09701291 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:04.384497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-474dcaf0-112e-4ab5-b8ec-3aef09701291 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:04.390643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9dcc0d78-b225-4693-9091-b50519540719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:04.391255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9dcc0d78-b225-4693-9091-b50519540719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:04.397514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9dcc0d78-b225-4693-9091-b50519540719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:04.405677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9dcc0d78-b225-4693-9091-b50519540719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:04.405677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9dcc0d78-b225-4693-9091-b50519540719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:04.405677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9dcc0d78-b225-4693-9091-b50519540719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:04.568558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-474dcaf0-112e-4ab5-b8ec-3aef09701291 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:04.577426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-474dcaf0-112e-4ab5-b8ec-3aef09701291 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.205878 May 12 06:56:04.578003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 300/601] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:04.580729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9dcc0d78-b225-4693-9091-b50519540719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:04.582587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-74531972-6b0b-4690-a556-7f4e8e70831b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:04.583740 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-74531972-6b0b-4690-a556-7f4e8e70831b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:04.590861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74531972-6b0b-4690-a556-7f4e8e70831b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:04.591294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9dcc0d78-b225-4693-9091-b50519540719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:04.591446 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74531972-6b0b-4690-a556-7f4e8e70831b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:04.592135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74531972-6b0b-4690-a556-7f4e8e70831b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:04.592568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74531972-6b0b-4690-a556-7f4e8e70831b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:04.592807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9dcc0d78-b225-4693-9091-b50519540719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:04.593968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9dcc0d78-b225-4693-9091-b50519540719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.207369 May 12 06:56:04.594809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 302/602] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:04 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:04.621206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-74531972-6b0b-4690-a556-7f4e8e70831b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 May 12 06:56:04.621770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 301/603] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:04 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:05.594245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c130d911-f5ad-4d24-bfec-82739ac0c7ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:05.594793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c130d911-f5ad-4d24-bfec-82739ac0c7ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:05.601087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c130d911-f5ad-4d24-bfec-82739ac0c7ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:05.601542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c130d911-f5ad-4d24-bfec-82739ac0c7ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:05.602317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c130d911-f5ad-4d24-bfec-82739ac0c7ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:05.602754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c130d911-f5ad-4d24-bfec-82739ac0c7ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:05.612079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d02f7fbf-9448-4e2f-8b71-bb5c78a3cb47 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:05.612798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d02f7fbf-9448-4e2f-8b71-bb5c78a3cb47 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:05.619533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d02f7fbf-9448-4e2f-8b71-bb5c78a3cb47 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:05.620001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d02f7fbf-9448-4e2f-8b71-bb5c78a3cb47 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:05.620765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d02f7fbf-9448-4e2f-8b71-bb5c78a3cb47 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:05.621196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d02f7fbf-9448-4e2f-8b71-bb5c78a3cb47 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:05.793598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c130d911-f5ad-4d24-bfec-82739ac0c7ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:05.800208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d02f7fbf-9448-4e2f-8b71-bb5c78a3cb47 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:05.801795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c130d911-f5ad-4d24-bfec-82739ac0c7ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.211421 May 12 06:56:05.802404 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 303/604] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:05.807977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f78e748b-2bc0-4bf8-a7dc-080373e75e3b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:05.808858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f78e748b-2bc0-4bf8-a7dc-080373e75e3b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:05.809531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d02f7fbf-9448-4e2f-8b71-bb5c78a3cb47 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:05.811456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d02f7fbf-9448-4e2f-8b71-bb5c78a3cb47 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:05.812732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d02f7fbf-9448-4e2f-8b71-bb5c78a3cb47 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.204397 May 12 06:56:05.813290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 302/605] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:05 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:05.814914 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f78e748b-2bc0-4bf8-a7dc-080373e75e3b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:05.815376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f78e748b-2bc0-4bf8-a7dc-080373e75e3b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:05.816197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f78e748b-2bc0-4bf8-a7dc-080373e75e3b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:05.816641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f78e748b-2bc0-4bf8-a7dc-080373e75e3b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:05.845248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f78e748b-2bc0-4bf8-a7dc-080373e75e3b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041749 May 12 06:56:05.845733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 304/606] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:05 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:06.819711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2d6c9778-7855-47b1-bda5-72c58f82a7f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:06.820352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2d6c9778-7855-47b1-bda5-72c58f82a7f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:06.832430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d6c9778-7855-47b1-bda5-72c58f82a7f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:06.832430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d6c9778-7855-47b1-bda5-72c58f82a7f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:06.832430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d6c9778-7855-47b1-bda5-72c58f82a7f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:06.832430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d6c9778-7855-47b1-bda5-72c58f82a7f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:06.832895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e426c72f-3953-41aa-b958-2ecbd2992e6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:06.832895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e426c72f-3953-41aa-b958-2ecbd2992e6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:06.838239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e426c72f-3953-41aa-b958-2ecbd2992e6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:06.838706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e426c72f-3953-41aa-b958-2ecbd2992e6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:06.839481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e426c72f-3953-41aa-b958-2ecbd2992e6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:06.839974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e426c72f-3953-41aa-b958-2ecbd2992e6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:07.232990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2d6c9778-7855-47b1-bda5-72c58f82a7f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:07.236766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e426c72f-3953-41aa-b958-2ecbd2992e6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:07.241031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2d6c9778-7855-47b1-bda5-72c58f82a7f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.425228 May 12 06:56:07.241640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 303/607] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:07.245491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e426c72f-3953-41aa-b958-2ecbd2992e6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:07.246621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bc58fe41-c40f-4d2e-84d2-6cbe0d063c64 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:07.246995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e426c72f-3953-41aa-b958-2ecbd2992e6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:07.247531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bc58fe41-c40f-4d2e-84d2-6cbe0d063c64 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:07.248193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e426c72f-3953-41aa-b958-2ecbd2992e6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.421802 May 12 06:56:07.248905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 305/608] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:06 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:07.253249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc58fe41-c40f-4d2e-84d2-6cbe0d063c64 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:07.253699 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc58fe41-c40f-4d2e-84d2-6cbe0d063c64 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:07.254466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc58fe41-c40f-4d2e-84d2-6cbe0d063c64 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:07.254900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc58fe41-c40f-4d2e-84d2-6cbe0d063c64 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:07.283268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bc58fe41-c40f-4d2e-84d2-6cbe0d063c64 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040662 May 12 06:56:07.283846 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 304/609] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:07 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:08.260134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7ed11472-4984-4443-8629-57b0a15d9720 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:08.260753 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7ed11472-4984-4443-8629-57b0a15d9720 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:08.266328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-12d42380-83d1-4196-aa10-3d29dc477414 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:08.272213 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-12d42380-83d1-4196-aa10-3d29dc477414 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:08.272323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ed11472-4984-4443-8629-57b0a15d9720 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:08.272323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ed11472-4984-4443-8629-57b0a15d9720 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:08.272323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ed11472-4984-4443-8629-57b0a15d9720 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:08.272323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ed11472-4984-4443-8629-57b0a15d9720 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:08.273483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-12d42380-83d1-4196-aa10-3d29dc477414 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:08.273936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-12d42380-83d1-4196-aa10-3d29dc477414 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:08.275247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-12d42380-83d1-4196-aa10-3d29dc477414 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:08.275680 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-12d42380-83d1-4196-aa10-3d29dc477414 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:08.456915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7ed11472-4984-4443-8629-57b0a15d9720 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:08.460609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-12d42380-83d1-4196-aa10-3d29dc477414 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:08.464958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7ed11472-4984-4443-8629-57b0a15d9720 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.209211 May 12 06:56:08.465620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 306/610] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:08.472136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-12d42380-83d1-4196-aa10-3d29dc477414 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:08.472260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e100ebce-b291-4239-9237-885b101908e9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:08.472366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-12d42380-83d1-4196-aa10-3d29dc477414 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:08.472461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e100ebce-b291-4239-9237-885b101908e9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:08.472546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-12d42380-83d1-4196-aa10-3d29dc477414 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.209354 May 12 06:56:08.473069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 305/611] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:08.476912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e100ebce-b291-4239-9237-885b101908e9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:08.477362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e100ebce-b291-4239-9237-885b101908e9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:08.478140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e100ebce-b291-4239-9237-885b101908e9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:08.478578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e100ebce-b291-4239-9237-885b101908e9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:08.507016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e100ebce-b291-4239-9237-885b101908e9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040260 May 12 06:56:08.507478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 307/612] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:08 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:09.482797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e2f25519-0afb-4f01-8001-d4841c91a4de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:09.483330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e2f25519-0afb-4f01-8001-d4841c91a4de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:09.489452 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-84962209-e298-4635-9422-aec1668381c9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:09.489850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e2f25519-0afb-4f01-8001-d4841c91a4de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:09.490084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-84962209-e298-4635-9422-aec1668381c9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:09.490202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e2f25519-0afb-4f01-8001-d4841c91a4de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:09.490865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e2f25519-0afb-4f01-8001-d4841c91a4de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:09.491298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e2f25519-0afb-4f01-8001-d4841c91a4de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:09.496295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84962209-e298-4635-9422-aec1668381c9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:09.496746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84962209-e298-4635-9422-aec1668381c9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:09.497518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84962209-e298-4635-9422-aec1668381c9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:09.497957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84962209-e298-4635-9422-aec1668381c9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:09.681464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e2f25519-0afb-4f01-8001-d4841c91a4de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:09.684552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-84962209-e298-4635-9422-aec1668381c9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:09.689358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e2f25519-0afb-4f01-8001-d4841c91a4de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.210412 May 12 06:56:09.689929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 306/613] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:09.693659 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-84962209-e298-4635-9422-aec1668381c9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:09.694419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3ce16073-3032-40a3-923e-eca5b45fef03 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:09.695323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3ce16073-3032-40a3-923e-eca5b45fef03 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:09.695456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-84962209-e298-4635-9422-aec1668381c9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:09.697248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-84962209-e298-4635-9422-aec1668381c9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.211605 May 12 06:56:09.697921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 308/614] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:09.701516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ce16073-3032-40a3-923e-eca5b45fef03 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:09.701959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ce16073-3032-40a3-923e-eca5b45fef03 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:09.702725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ce16073-3032-40a3-923e-eca5b45fef03 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:09.703153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ce16073-3032-40a3-923e-eca5b45fef03 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:09.731385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3ce16073-3032-40a3-923e-eca5b45fef03 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040497 May 12 06:56:09.731959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 307/615] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:09 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:10.706580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2278ec60-d454-4db4-ae82-68e73ade3eda tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:10.707193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2278ec60-d454-4db4-ae82-68e73ade3eda tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:10.713573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2278ec60-d454-4db4-ae82-68e73ade3eda tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:10.714032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2278ec60-d454-4db4-ae82-68e73ade3eda tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:10.714804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2278ec60-d454-4db4-ae82-68e73ade3eda tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:10.715183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9c52e75b-aaf8-4c44-9084-f70998d52f87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:10.715578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2278ec60-d454-4db4-ae82-68e73ade3eda tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:10.715821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9c52e75b-aaf8-4c44-9084-f70998d52f87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:10.722213 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c52e75b-aaf8-4c44-9084-f70998d52f87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:10.722749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c52e75b-aaf8-4c44-9084-f70998d52f87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:10.723521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c52e75b-aaf8-4c44-9084-f70998d52f87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:10.723981 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c52e75b-aaf8-4c44-9084-f70998d52f87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:10.901610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2278ec60-d454-4db4-ae82-68e73ade3eda tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:10.905339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c52e75b-aaf8-4c44-9084-f70998d52f87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:10.909620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2278ec60-d454-4db4-ae82-68e73ade3eda tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.206859 May 12 06:56:10.910198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 309/616] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:10.913517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c52e75b-aaf8-4c44-9084-f70998d52f87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:10.914931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c08cbaf4-e4d3-4ecb-a42e-cf4703809035 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:10.915056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c52e75b-aaf8-4c44-9084-f70998d52f87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:10.915911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c08cbaf4-e4d3-4ecb-a42e-cf4703809035 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:10.916159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9c52e75b-aaf8-4c44-9084-f70998d52f87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.204848 May 12 06:56:10.916843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 308/617] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:10 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:10.922226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c08cbaf4-e4d3-4ecb-a42e-cf4703809035 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:10.922690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c08cbaf4-e4d3-4ecb-a42e-cf4703809035 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:10.923473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c08cbaf4-e4d3-4ecb-a42e-cf4703809035 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:10.923939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c08cbaf4-e4d3-4ecb-a42e-cf4703809035 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:10.953071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c08cbaf4-e4d3-4ecb-a42e-cf4703809035 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041873 May 12 06:56:10.953630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 310/618] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:10 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:11.926102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1b3a9df7-8f70-479b-943b-8bc3bd6f6faf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:11.926742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1b3a9df7-8f70-479b-943b-8bc3bd6f6faf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:11.933258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b3a9df7-8f70-479b-943b-8bc3bd6f6faf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:11.933712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b3a9df7-8f70-479b-943b-8bc3bd6f6faf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:11.934073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8d72a348-fc5e-466a-94c3-a1fc8faa614d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:11.934498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b3a9df7-8f70-479b-943b-8bc3bd6f6faf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:11.934707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8d72a348-fc5e-466a-94c3-a1fc8faa614d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:11.934911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b3a9df7-8f70-479b-943b-8bc3bd6f6faf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:11.941620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d72a348-fc5e-466a-94c3-a1fc8faa614d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:11.942076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d72a348-fc5e-466a-94c3-a1fc8faa614d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:11.942853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d72a348-fc5e-466a-94c3-a1fc8faa614d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:11.943292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d72a348-fc5e-466a-94c3-a1fc8faa614d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:12.125785 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1b3a9df7-8f70-479b-943b-8bc3bd6f6faf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:12.132578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8d72a348-fc5e-466a-94c3-a1fc8faa614d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:12.133704 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1b3a9df7-8f70-479b-943b-8bc3bd6f6faf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.211393 May 12 06:56:12.134282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 309/619] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:12.138747 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a4bf7670-a406-4eb9-92ad-120cfea1112e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:12.139646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a4bf7670-a406-4eb9-92ad-120cfea1112e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:12.145245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4bf7670-a406-4eb9-92ad-120cfea1112e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:12.145687 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4bf7670-a406-4eb9-92ad-120cfea1112e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:12.146452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4bf7670-a406-4eb9-92ad-120cfea1112e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:12.146882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4bf7670-a406-4eb9-92ad-120cfea1112e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:12.147292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8d72a348-fc5e-466a-94c3-a1fc8faa614d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:12.148818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8d72a348-fc5e-466a-94c3-a1fc8faa614d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:12.150020 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8d72a348-fc5e-466a-94c3-a1fc8faa614d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.219730 May 12 06:56:12.150583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 311/620] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:12.175717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a4bf7670-a406-4eb9-92ad-120cfea1112e tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040430 May 12 06:56:12.176273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 310/621] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:12 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:13.151365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a1b4e946-259c-49f4-8353-b985d74fcb8a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:13.151938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a1b4e946-259c-49f4-8353-b985d74fcb8a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:13.158249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1b4e946-259c-49f4-8353-b985d74fcb8a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:13.158701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1b4e946-259c-49f4-8353-b985d74fcb8a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:13.159469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1b4e946-259c-49f4-8353-b985d74fcb8a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:13.159945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1b4e946-259c-49f4-8353-b985d74fcb8a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:13.168649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f0d1479f-7f2f-4c2b-abe2-9f074afd7e2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:13.169621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f0d1479f-7f2f-4c2b-abe2-9f074afd7e2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:13.175797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0d1479f-7f2f-4c2b-abe2-9f074afd7e2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:13.176243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0d1479f-7f2f-4c2b-abe2-9f074afd7e2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:13.177008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0d1479f-7f2f-4c2b-abe2-9f074afd7e2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:13.177439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0d1479f-7f2f-4c2b-abe2-9f074afd7e2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:13.346785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a1b4e946-259c-49f4-8353-b985d74fcb8a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:13.354225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f0d1479f-7f2f-4c2b-abe2-9f074afd7e2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:13.356784 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a1b4e946-259c-49f4-8353-b985d74fcb8a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.209803 May 12 06:56:13.357370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 312/622] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:13.361879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ad8651be-47fc-43a0-ac5b-23148a423993 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:13.362576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f0d1479f-7f2f-4c2b-abe2-9f074afd7e2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:13.362766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ad8651be-47fc-43a0-ac5b-23148a423993 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:13.364113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f0d1479f-7f2f-4c2b-abe2-9f074afd7e2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:13.365529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f0d1479f-7f2f-4c2b-abe2-9f074afd7e2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.201036 May 12 06:56:13.372459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 311/623] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:13.372606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad8651be-47fc-43a0-ac5b-23148a423993 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:13.372606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad8651be-47fc-43a0-ac5b-23148a423993 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:13.372606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad8651be-47fc-43a0-ac5b-23148a423993 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:13.372606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad8651be-47fc-43a0-ac5b-23148a423993 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:13.398876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ad8651be-47fc-43a0-ac5b-23148a423993 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040438 May 12 06:56:13.400164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 313/624] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:13 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:14.375331 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-da488fb0-abf2-4575-b1e1-7dfa0625b486 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:14.375967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-da488fb0-abf2-4575-b1e1-7dfa0625b486 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:14.382306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da488fb0-abf2-4575-b1e1-7dfa0625b486 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:14.382752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da488fb0-abf2-4575-b1e1-7dfa0625b486 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:14.383359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d2a9826b-efcc-4df8-9a64-011bcfa337af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:14.383835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da488fb0-abf2-4575-b1e1-7dfa0625b486 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:14.384401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da488fb0-abf2-4575-b1e1-7dfa0625b486 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:14.384527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d2a9826b-efcc-4df8-9a64-011bcfa337af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:14.391624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2a9826b-efcc-4df8-9a64-011bcfa337af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:14.392101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2a9826b-efcc-4df8-9a64-011bcfa337af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:14.392877 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2a9826b-efcc-4df8-9a64-011bcfa337af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:14.393310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2a9826b-efcc-4df8-9a64-011bcfa337af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:14.581212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-da488fb0-abf2-4575-b1e1-7dfa0625b486 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:14.585160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d2a9826b-efcc-4df8-9a64-011bcfa337af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:14.589652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-da488fb0-abf2-4575-b1e1-7dfa0625b486 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.219170 May 12 06:56:14.596437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 312/625] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:14.596600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d2a9826b-efcc-4df8-9a64-011bcfa337af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:14.596720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-58151d00-146f-4369-a10a-dd711fb720e8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:14.596810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d2a9826b-efcc-4df8-9a64-011bcfa337af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:14.596903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-58151d00-146f-4369-a10a-dd711fb720e8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:14.596991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d2a9826b-efcc-4df8-9a64-011bcfa337af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.217083 May 12 06:56:14.601750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58151d00-146f-4369-a10a-dd711fb720e8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:14.602850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58151d00-146f-4369-a10a-dd711fb720e8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:14.603154 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 314/626] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:14 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:14.603642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58151d00-146f-4369-a10a-dd711fb720e8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:14.604130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58151d00-146f-4369-a10a-dd711fb720e8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:14.632217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-58151d00-146f-4369-a10a-dd711fb720e8 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040901 May 12 06:56:14.632698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 313/627] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:14 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:15.607581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c05d35b8-0c01-4f91-9f07-cbd69b66718d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:15.608220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c05d35b8-0c01-4f91-9f07-cbd69b66718d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:15.614839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c05d35b8-0c01-4f91-9f07-cbd69b66718d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:15.615298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c05d35b8-0c01-4f91-9f07-cbd69b66718d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:15.615429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dccf361e-26eb-4743-95f0-94e76ad6e6ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:15.615974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dccf361e-26eb-4743-95f0-94e76ad6e6ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:15.616114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c05d35b8-0c01-4f91-9f07-cbd69b66718d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:15.616557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c05d35b8-0c01-4f91-9f07-cbd69b66718d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:15.622831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dccf361e-26eb-4743-95f0-94e76ad6e6ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:15.623289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dccf361e-26eb-4743-95f0-94e76ad6e6ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:15.624108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dccf361e-26eb-4743-95f0-94e76ad6e6ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:15.624547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dccf361e-26eb-4743-95f0-94e76ad6e6ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:15.802959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c05d35b8-0c01-4f91-9f07-cbd69b66718d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:15.806501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dccf361e-26eb-4743-95f0-94e76ad6e6ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:15.811637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c05d35b8-0c01-4f91-9f07-cbd69b66718d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.208118 May 12 06:56:15.812553 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 315/628] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:15.815561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dccf361e-26eb-4743-95f0-94e76ad6e6ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:15.817192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dccf361e-26eb-4743-95f0-94e76ad6e6ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:15.817606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-56df82d4-5a87-460f-82b4-65c1c0128410 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:15.818393 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dccf361e-26eb-4743-95f0-94e76ad6e6ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.207125 May 12 06:56:15.818647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-56df82d4-5a87-460f-82b4-65c1c0128410 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:15.819129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 314/629] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:15.824432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56df82d4-5a87-460f-82b4-65c1c0128410 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:15.831743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56df82d4-5a87-460f-82b4-65c1c0128410 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:15.831743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56df82d4-5a87-460f-82b4-65c1c0128410 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:15.831743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56df82d4-5a87-460f-82b4-65c1c0128410 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:15.855633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-56df82d4-5a87-460f-82b4-65c1c0128410 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041752 May 12 06:56:15.856229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 316/630] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:15 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:16.829021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3a660e4b-49e3-4dcd-80e2-c2a418f742d0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:16.829603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3a660e4b-49e3-4dcd-80e2-c2a418f742d0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:16.836109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a660e4b-49e3-4dcd-80e2-c2a418f742d0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:16.836568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a660e4b-49e3-4dcd-80e2-c2a418f742d0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:16.836691 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6ba21675-2f52-4c64-a495-0c3b3792ede1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:16.837319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6ba21675-2f52-4c64-a495-0c3b3792ede1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:16.837460 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a660e4b-49e3-4dcd-80e2-c2a418f742d0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:16.837766 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a660e4b-49e3-4dcd-80e2-c2a418f742d0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:16.843542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ba21675-2f52-4c64-a495-0c3b3792ede1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:16.844040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ba21675-2f52-4c64-a495-0c3b3792ede1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:16.844853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ba21675-2f52-4c64-a495-0c3b3792ede1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:16.845300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ba21675-2f52-4c64-a495-0c3b3792ede1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:17.025402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3a660e4b-49e3-4dcd-80e2-c2a418f742d0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:17.032192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6ba21675-2f52-4c64-a495-0c3b3792ede1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:17.033143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3a660e4b-49e3-4dcd-80e2-c2a418f742d0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.208075 May 12 06:56:17.033713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 315/631] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:17.038572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f0596f27-b473-4bc3-9d59-eacb5f364137 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:17.040022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f0596f27-b473-4bc3-9d59-eacb5f364137 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:17.041045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6ba21675-2f52-4c64-a495-0c3b3792ede1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:17.042634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6ba21675-2f52-4c64-a495-0c3b3792ede1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:17.043824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6ba21675-2f52-4c64-a495-0c3b3792ede1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.211020 May 12 06:56:17.051746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 317/632] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:17.051904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0596f27-b473-4bc3-9d59-eacb5f364137 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:17.051904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0596f27-b473-4bc3-9d59-eacb5f364137 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:17.051904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0596f27-b473-4bc3-9d59-eacb5f364137 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:17.051904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0596f27-b473-4bc3-9d59-eacb5f364137 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:17.076792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f0596f27-b473-4bc3-9d59-eacb5f364137 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041903 May 12 06:56:17.077350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 316/633] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 06:56:17 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 06:56:17.132927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f432e461-18cf-4413-b3e1-6eb7e31f25b5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:17.133453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f432e461-18cf-4413-b3e1-6eb7e31f25b5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:17.139485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f432e461-18cf-4413-b3e1-6eb7e31f25b5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:17.140003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f432e461-18cf-4413-b3e1-6eb7e31f25b5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:17.140785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f432e461-18cf-4413-b3e1-6eb7e31f25b5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:17.141253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f432e461-18cf-4413-b3e1-6eb7e31f25b5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:17.165693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f432e461-18cf-4413-b3e1-6eb7e31f25b5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 06:56:17.480054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f432e461-18cf-4413-b3e1-6eb7e31f25b5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 204 len: 0 microversion: 2.1 time: 0.350560 May 12 06:56:17.480660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 318/634] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 06:56:17 2022] DELETE /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 06:56:17.488669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4982f4a5-a6ed-41c4-a081-d37c176ee51d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:17.489313 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4982f4a5-a6ed-41c4-a081-d37c176ee51d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:17.495153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4982f4a5-a6ed-41c4-a081-d37c176ee51d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:17.495609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4982f4a5-a6ed-41c4-a081-d37c176ee51d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:17.496412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4982f4a5-a6ed-41c4-a081-d37c176ee51d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:17.496855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4982f4a5-a6ed-41c4-a081-d37c176ee51d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:17.623098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4982f4a5-a6ed-41c4-a081-d37c176ee51d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:17.630341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4982f4a5-a6ed-41c4-a081-d37c176ee51d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1679 microversion: 2.1 time: 0.145491 May 12 06:56:17.630902 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 317/635] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:17 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:18.051615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4ad79bf6-f78a-4cd6-8797-c42d6fa70bc2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:18.052408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4ad79bf6-f78a-4cd6-8797-c42d6fa70bc2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:18.058811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ad79bf6-f78a-4cd6-8797-c42d6fa70bc2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:18.059262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ad79bf6-f78a-4cd6-8797-c42d6fa70bc2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:18.062980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ad79bf6-f78a-4cd6-8797-c42d6fa70bc2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:18.062980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ad79bf6-f78a-4cd6-8797-c42d6fa70bc2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:18.063161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7ed8f50a-4238-4d75-91cf-f1309e41cdf0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:18.063161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7ed8f50a-4238-4d75-91cf-f1309e41cdf0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:18.069219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ed8f50a-4238-4d75-91cf-f1309e41cdf0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:18.069657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ed8f50a-4238-4d75-91cf-f1309e41cdf0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:18.070426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ed8f50a-4238-4d75-91cf-f1309e41cdf0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:18.071406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ed8f50a-4238-4d75-91cf-f1309e41cdf0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:18.251461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4ad79bf6-f78a-4cd6-8797-c42d6fa70bc2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:18.255210 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7ed8f50a-4238-4d75-91cf-f1309e41cdf0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:18.259968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4ad79bf6-f78a-4cd6-8797-c42d6fa70bc2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.212511 May 12 06:56:18.260541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 319/636] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:18.263941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7ed8f50a-4238-4d75-91cf-f1309e41cdf0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:18.265499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7ed8f50a-4238-4d75-91cf-f1309e41cdf0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:18.266650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7ed8f50a-4238-4d75-91cf-f1309e41cdf0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.208335 May 12 06:56:18.267212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 318/637] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:18.649421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5fe82a06-71ac-4212-8e5b-f205d0ea4d09 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:18.650594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5fe82a06-71ac-4212-8e5b-f205d0ea4d09 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:18.657725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fe82a06-71ac-4212-8e5b-f205d0ea4d09 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:18.659523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fe82a06-71ac-4212-8e5b-f205d0ea4d09 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:18.659523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fe82a06-71ac-4212-8e5b-f205d0ea4d09 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:18.659523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fe82a06-71ac-4212-8e5b-f205d0ea4d09 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:18.797403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5fe82a06-71ac-4212-8e5b-f205d0ea4d09 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:18.804822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5fe82a06-71ac-4212-8e5b-f205d0ea4d09 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1679 microversion: 2.1 time: 0.160104 May 12 06:56:18.806052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 320/638] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:18 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:19.277303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-06655df3-2fca-44a7-92ae-e8fc0ff36189 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:19.277947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-06655df3-2fca-44a7-92ae-e8fc0ff36189 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:19.284379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-06655df3-2fca-44a7-92ae-e8fc0ff36189 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:19.284523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1730c54d-199f-40f0-85bf-9fb32b1554af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:19.284911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-06655df3-2fca-44a7-92ae-e8fc0ff36189 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:19.285263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1730c54d-199f-40f0-85bf-9fb32b1554af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:19.285584 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-06655df3-2fca-44a7-92ae-e8fc0ff36189 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:19.286024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-06655df3-2fca-44a7-92ae-e8fc0ff36189 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:19.292070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1730c54d-199f-40f0-85bf-9fb32b1554af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:19.292528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1730c54d-199f-40f0-85bf-9fb32b1554af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:19.293300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1730c54d-199f-40f0-85bf-9fb32b1554af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:19.293738 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1730c54d-199f-40f0-85bf-9fb32b1554af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:19.472650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-06655df3-2fca-44a7-92ae-e8fc0ff36189 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:19.475380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1730c54d-199f-40f0-85bf-9fb32b1554af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:19.481141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-06655df3-2fca-44a7-92ae-e8fc0ff36189 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.207795 May 12 06:56:19.481720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 319/639] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:19.484158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1730c54d-199f-40f0-85bf-9fb32b1554af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:19.485693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1730c54d-199f-40f0-85bf-9fb32b1554af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:19.486841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1730c54d-199f-40f0-85bf-9fb32b1554af tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.206226 May 12 06:56:19.487396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 321/640] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:19 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:19.822298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-51e397b9-f986-46a3-97eb-f4f1e608c428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:19.822914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-51e397b9-f986-46a3-97eb-f4f1e608c428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:19.828857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51e397b9-f986-46a3-97eb-f4f1e608c428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:19.829295 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51e397b9-f986-46a3-97eb-f4f1e608c428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:19.830066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51e397b9-f986-46a3-97eb-f4f1e608c428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:19.830506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51e397b9-f986-46a3-97eb-f4f1e608c428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:19.953501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-51e397b9-f986-46a3-97eb-f4f1e608c428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:19.960841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-51e397b9-f986-46a3-97eb-f4f1e608c428 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1679 microversion: 2.1 time: 0.142347 May 12 06:56:19.961898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 320/641] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:19 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1679 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:20.498695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2c8e1681-b2dc-4f52-9d91-8f355f04bf86 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:20.499439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2c8e1681-b2dc-4f52-9d91-8f355f04bf86 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:20.505659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-121e2511-50ff-4677-a6af-3734634397e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:20.506161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c8e1681-b2dc-4f52-9d91-8f355f04bf86 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:20.506277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c8e1681-b2dc-4f52-9d91-8f355f04bf86 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:20.506370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-121e2511-50ff-4677-a6af-3734634397e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:20.507004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c8e1681-b2dc-4f52-9d91-8f355f04bf86 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:20.507444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c8e1681-b2dc-4f52-9d91-8f355f04bf86 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:20.513614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-121e2511-50ff-4677-a6af-3734634397e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:20.514271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-121e2511-50ff-4677-a6af-3734634397e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:20.515071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-121e2511-50ff-4677-a6af-3734634397e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:20.515502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-121e2511-50ff-4677-a6af-3734634397e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:20.703232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2c8e1681-b2dc-4f52-9d91-8f355f04bf86 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:20.709757 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-121e2511-50ff-4677-a6af-3734634397e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:20.717508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2c8e1681-b2dc-4f52-9d91-8f355f04bf86 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.222620 May 12 06:56:20.718102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 322/642] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:20 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:56:20.718616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-121e2511-50ff-4677-a6af-3734634397e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:20.720293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-121e2511-50ff-4677-a6af-3734634397e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:20.721592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-121e2511-50ff-4677-a6af-3734634397e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.220052 May 12 06:56:20.722189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 321/643] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:56:20.978095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c3902233-fa88-4b25-970a-29d26e769c02 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:20.978627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c3902233-fa88-4b25-970a-29d26e769c02 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:20.984531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3902233-fa88-4b25-970a-29d26e769c02 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:20.985008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3902233-fa88-4b25-970a-29d26e769c02 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:20.985778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3902233-fa88-4b25-970a-29d26e769c02 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:20.986217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3902233-fa88-4b25-970a-29d26e769c02 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:21.113156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c3902233-fa88-4b25-970a-29d26e769c02 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:21.121132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c3902233-fa88-4b25-970a-29d26e769c02 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1679 microversion: 2.1 time: 0.147435 May 12 06:56:21.121698 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 323/644] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:20 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:21.744068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-313dde04-cbd6-4e8f-a8e9-3d1ebe04aeeb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:21.745360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-313dde04-cbd6-4e8f-a8e9-3d1ebe04aeeb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:21.753921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-91c01a95-b673-44ec-bf4e-d954f030b480 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:21.756472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-91c01a95-b673-44ec-bf4e-d954f030b480 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:21.757673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-313dde04-cbd6-4e8f-a8e9-3d1ebe04aeeb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:21.759356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-313dde04-cbd6-4e8f-a8e9-3d1ebe04aeeb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:21.760425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-313dde04-cbd6-4e8f-a8e9-3d1ebe04aeeb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:21.761063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-313dde04-cbd6-4e8f-a8e9-3d1ebe04aeeb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:21.765663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91c01a95-b673-44ec-bf4e-d954f030b480 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:21.766144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91c01a95-b673-44ec-bf4e-d954f030b480 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:21.769415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91c01a95-b673-44ec-bf4e-d954f030b480 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:21.769883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91c01a95-b673-44ec-bf4e-d954f030b480 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:22.049116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-313dde04-cbd6-4e8f-a8e9-3d1ebe04aeeb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:22.059879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-313dde04-cbd6-4e8f-a8e9-3d1ebe04aeeb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.319887 May 12 06:56:22.060574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 322/645] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:21 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:22.064486 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-91c01a95-b673-44ec-bf4e-d954f030b480 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:22.079304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-91c01a95-b673-44ec-bf4e-d954f030b480 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:22.080966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-91c01a95-b673-44ec-bf4e-d954f030b480 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:22.082353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-91c01a95-b673-44ec-bf4e-d954f030b480 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.332380 May 12 06:56:22.083032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 324/646] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 06:56:22.138932 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-71a78cfd-6eb2-4297-a591-69aa5bf3215d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:22.139545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-71a78cfd-6eb2-4297-a591-69aa5bf3215d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:22.145616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-71a78cfd-6eb2-4297-a591-69aa5bf3215d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:22.146067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-71a78cfd-6eb2-4297-a591-69aa5bf3215d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:22.146836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-71a78cfd-6eb2-4297-a591-69aa5bf3215d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:22.147273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-71a78cfd-6eb2-4297-a591-69aa5bf3215d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:22.278298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-71a78cfd-6eb2-4297-a591-69aa5bf3215d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:22.285725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-71a78cfd-6eb2-4297-a591-69aa5bf3215d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1679 microversion: 2.1 time: 0.150483 May 12 06:56:22.286293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 323/647] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:22 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:22.790770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-ef7383aa-cda5-428e-bd41-e99c3385b0f3 req-c706960d-dcef-4bed-84a8-31f64e465d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baa16c3-ab5a-4e93-a65d-1e038d4af279", "name": "network-vif-deleted", "tag": "ef0e8620-aa0e-40bc-834f-7d8adc3412c6"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:56:22.800284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-ef7383aa-cda5-428e-bd41-e99c3385b0f3 req-c706960d-dcef-4bed-84a8-31f64e465d75 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:22.800724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-ef7383aa-cda5-428e-bd41-e99c3385b0f3 req-c706960d-dcef-4bed-84a8-31f64e465d75 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:22.812326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-ef7383aa-cda5-428e-bd41-e99c3385b0f3 req-c706960d-dcef-4bed-84a8-31f64e465d75 service nova] Creating event network-vif-deleted:ef0e8620-aa0e-40bc-834f-7d8adc3412c6 for instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 on hv-cinder-76606 May 12 06:56:22.818603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-ef7383aa-cda5-428e-bd41-e99c3385b0f3 req-c706960d-dcef-4bed-84a8-31f64e465d75 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031363 May 12 06:56:22.819212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 325/648] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:23.077777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0b416b95-1ac9-4d4f-82cf-9152e5714cbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:23.078421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0b416b95-1ac9-4d4f-82cf-9152e5714cbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:23.085474 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b416b95-1ac9-4d4f-82cf-9152e5714cbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:23.086688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b416b95-1ac9-4d4f-82cf-9152e5714cbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:23.088050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b416b95-1ac9-4d4f-82cf-9152e5714cbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:23.088050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b416b95-1ac9-4d4f-82cf-9152e5714cbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:23.101249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-414304ec-1d16-4776-b50f-e8b72704d528 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:23.102191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-414304ec-1d16-4776-b50f-e8b72704d528 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:23.110974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-414304ec-1d16-4776-b50f-e8b72704d528 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:23.110974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-414304ec-1d16-4776-b50f-e8b72704d528 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:23.110974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-414304ec-1d16-4776-b50f-e8b72704d528 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:23.110974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-414304ec-1d16-4776-b50f-e8b72704d528 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:23.287084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0b416b95-1ac9-4d4f-82cf-9152e5714cbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:23.295259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0b416b95-1ac9-4d4f-82cf-9152e5714cbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.221410 May 12 06:56:23.299734 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 324/649] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:23.305532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-414304ec-1d16-4776-b50f-e8b72704d528 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:23.316088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-414304ec-1d16-4776-b50f-e8b72704d528 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:23.316684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-414304ec-1d16-4776-b50f-e8b72704d528 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:23.317814 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-414304ec-1d16-4776-b50f-e8b72704d528 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.220798 May 12 06:56:23.318365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 326/650] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:23 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:23.321187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-91f4db31-387b-4a62-8ba8-f2d591389833 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:23.321976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-91f4db31-387b-4a62-8ba8-f2d591389833 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:23.328148 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91f4db31-387b-4a62-8ba8-f2d591389833 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:23.328784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91f4db31-387b-4a62-8ba8-f2d591389833 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:23.329735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91f4db31-387b-4a62-8ba8-f2d591389833 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:23.330336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91f4db31-387b-4a62-8ba8-f2d591389833 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:23.409667 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-91f4db31-387b-4a62-8ba8-f2d591389833 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:23.421416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-91f4db31-387b-4a62-8ba8-f2d591389833 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1612 microversion: 2.1 time: 0.120606 May 12 06:56:23.422563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 325/651] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:23 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1612 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:24.316012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b6d2ca6d-1239-4bcb-b6d6-770bd3aad785 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:24.317307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b6d2ca6d-1239-4bcb-b6d6-770bd3aad785 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:24.324327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6d2ca6d-1239-4bcb-b6d6-770bd3aad785 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.324779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6d2ca6d-1239-4bcb-b6d6-770bd3aad785 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.325556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6d2ca6d-1239-4bcb-b6d6-770bd3aad785 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.325995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6d2ca6d-1239-4bcb-b6d6-770bd3aad785 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.336675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-613f63cc-a01e-43c1-bc33-20d64774bedb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:24.337591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-613f63cc-a01e-43c1-bc33-20d64774bedb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:24.343864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-613f63cc-a01e-43c1-bc33-20d64774bedb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.344310 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-613f63cc-a01e-43c1-bc33-20d64774bedb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.345077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-613f63cc-a01e-43c1-bc33-20d64774bedb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.345512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-613f63cc-a01e-43c1-bc33-20d64774bedb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.538784 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b6d2ca6d-1239-4bcb-b6d6-770bd3aad785 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:24.542535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-613f63cc-a01e-43c1-bc33-20d64774bedb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:24.548664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b6d2ca6d-1239-4bcb-b6d6-770bd3aad785 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1716 microversion: 2.1 time: 0.236524 May 12 06:56:24.549274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 327/652] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1716 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:24.553725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-86f10ebd-6c80-4196-8b2c-64e259c36c34 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:24.554465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-86f10ebd-6c80-4196-8b2c-64e259c36c34 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:24.559177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-613f63cc-a01e-43c1-bc33-20d64774bedb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:24.561050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-86f10ebd-6c80-4196-8b2c-64e259c36c34 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.561499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-86f10ebd-6c80-4196-8b2c-64e259c36c34 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.561611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-613f63cc-a01e-43c1-bc33-20d64774bedb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:24.562381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-86f10ebd-6c80-4196-8b2c-64e259c36c34 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.562770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-86f10ebd-6c80-4196-8b2c-64e259c36c34 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.562904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-613f63cc-a01e-43c1-bc33-20d64774bedb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1807 microversion: 2.20 time: 0.230016 May 12 06:56:24.564235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 326/653] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:24 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:24.596170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-86f10ebd-6c80-4196-8b2c-64e259c36c34 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.596620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-86f10ebd-6c80-4196-8b2c-64e259c36c34 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.597070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-86f10ebd-6c80-4196-8b2c-64e259c36c34 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lazy-loading 'fault' on Instance uuid 0baa16c3-ab5a-4e93-a65d-1e038d4af279 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:56:24.640596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-86f10ebd-6c80-4196-8b2c-64e259c36c34 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:24.649237 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-86f10ebd-6c80-4196-8b2c-64e259c36c34 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 200 len: 1330 microversion: 2.1 time: 0.098956 May 12 06:56:24.652205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b72dc79e-a6a3-4b9a-81c6-7debd442f2d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:24.652702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b72dc79e-a6a3-4b9a-81c6-7debd442f2d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:24.658618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 328/654] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:24 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:24.658777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b72dc79e-a6a3-4b9a-81c6-7debd442f2d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.659228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b72dc79e-a6a3-4b9a-81c6-7debd442f2d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.660067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b72dc79e-a6a3-4b9a-81c6-7debd442f2d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.660502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b72dc79e-a6a3-4b9a-81c6-7debd442f2d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.739627 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-b72dc79e-a6a3-4b9a-81c6-7debd442f2d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Cannot 'detach_volume' instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 while it is in vm_state rescued May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b72dc79e-a6a3-4b9a-81c6-7debd442f2d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c HTTP/1.1 May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 06:56:24.741282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 06:56:24.742904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 06:56:24.742904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 06:56:24.742904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 06:56:24.742904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 06:56:24.742904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 06:56:24.742904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 06:56:24.742904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 06:56:24.742904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 06:56:24.742904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 06:56:24.742904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 06:56:24.742904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Cannot 'detach_volume' instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 while it is in vm_state rescued May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'server_id': 'd1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106', 'id': 'ce7be931-41dc-455d-b15d-fbd24ac0f57c'} May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:56:24.743679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 while it is in vm_state rescued May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 while it is in vm_state rescued May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:56:24.745105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b72dc79e-a6a3-4b9a-81c6-7debd442f2d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 409 to user: Cannot 'detach_volume' instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 while it is in vm_state rescued {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:56:24.746225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b72dc79e-a6a3-4b9a-81c6-7debd442f2d6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c" status: 409 len: 152 microversion: 2.1 time: 0.094646 May 12 06:56:24.746225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 327/655] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 06:56:24 2022] DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 06:56:24.751788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-73765f01-a7e9-4e22-8a1b-22126294a21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:56:24.752396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-73765f01-a7e9-4e22-8a1b-22126294a21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:24.758328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73765f01-a7e9-4e22-8a1b-22126294a21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.758854 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73765f01-a7e9-4e22-8a1b-22126294a21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.760247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73765f01-a7e9-4e22-8a1b-22126294a21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.760757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73765f01-a7e9-4e22-8a1b-22126294a21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.957131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-73765f01-a7e9-4e22-8a1b-22126294a21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/action" status: 202 len: 0 microversion: 2.1 time: 0.208956 May 12 06:56:24.957962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 329/656] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 06:56:24 2022] POST /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 06:56:24.965982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0af998b0-c4a7-4c03-aa52-9802511a3c44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:24.966572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0af998b0-c4a7-4c03-aa52-9802511a3c44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:24.973543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0af998b0-c4a7-4c03-aa52-9802511a3c44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.974037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0af998b0-c4a7-4c03-aa52-9802511a3c44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:24.974817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0af998b0-c4a7-4c03-aa52-9802511a3c44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:24.975265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0af998b0-c4a7-4c03-aa52-9802511a3c44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:25.104320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0af998b0-c4a7-4c03-aa52-9802511a3c44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:25.112013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0af998b0-c4a7-4c03-aa52-9802511a3c44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1724 microversion: 2.1 time: 0.149967 May 12 06:56:25.112574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 328/657] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:25.581229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7318482a-12d7-4176-b2d2-4ba16fd62440 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:25.581852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7318482a-12d7-4176-b2d2-4ba16fd62440 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:25.588305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7318482a-12d7-4176-b2d2-4ba16fd62440 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:25.588753 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7318482a-12d7-4176-b2d2-4ba16fd62440 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:25.589516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7318482a-12d7-4176-b2d2-4ba16fd62440 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:25.589946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7318482a-12d7-4176-b2d2-4ba16fd62440 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:25.666778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-51d5ab97-a797-4877-aa01-54e2d3836694 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:25.667785 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-51d5ab97-a797-4877-aa01-54e2d3836694 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:25.673754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51d5ab97-a797-4877-aa01-54e2d3836694 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:25.674208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51d5ab97-a797-4877-aa01-54e2d3836694 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:25.674995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51d5ab97-a797-4877-aa01-54e2d3836694 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:25.675432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51d5ab97-a797-4877-aa01-54e2d3836694 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:25.689721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-51d5ab97-a797-4877-aa01-54e2d3836694 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-51d5ab97-a797-4877-aa01-54e2d3836694 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 HTTP/1.1 May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 06:56:25.691509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 06:56:25.693187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '0baa16c3-ab5a-4e93-a65d-1e038d4af279'} May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:56:25.694085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 06:56:25.695828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:56:25.697845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-51d5ab97-a797-4877-aa01-54e2d3836694 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:56:25.697845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-51d5ab97-a797-4877-aa01-54e2d3836694 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 404 len: 111 microversion: 2.1 time: 0.030519 May 12 06:56:25.697845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 329/658] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:25 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 06:56:25.701449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e62c5538-f3af-4732-93c0-8e3be9be1b92 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '.version_select at 0x7f89da1ee160>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:25.724167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7318482a-12d7-4176-b2d2-4ba16fd62440 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:25.732986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7318482a-12d7-4176-b2d2-4ba16fd62440 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:25.734491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7318482a-12d7-4176-b2d2-4ba16fd62440 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:25.735658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7318482a-12d7-4176-b2d2-4ba16fd62440 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1794 microversion: 2.20 time: 0.158811 May 12 06:56:25.736243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 330/659] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 06:56:25 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 06:56:25.781941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e62c5538-f3af-4732-93c0-8e3be9be1b92 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-213658667" status: 202 len: 0 microversion: 2.1 time: 0.084027 May 12 06:56:25.782522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 330/660] 10.222.0.25 () {58 vars in 1217 bytes} [Thu May 12 06:56:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-213658667 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 06:56:26.130033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f0b455f6-84aa-4c92-8624-14dc8e02ccd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:26.130648 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f0b455f6-84aa-4c92-8624-14dc8e02ccd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:26.137127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f0b455f6-84aa-4c92-8624-14dc8e02ccd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:26.137579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f0b455f6-84aa-4c92-8624-14dc8e02ccd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:26.138357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f0b455f6-84aa-4c92-8624-14dc8e02ccd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:26.138965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f0b455f6-84aa-4c92-8624-14dc8e02ccd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:26.342085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f0b455f6-84aa-4c92-8624-14dc8e02ccd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:26.349889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f0b455f6-84aa-4c92-8624-14dc8e02ccd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1724 microversion: 2.1 time: 0.223752 May 12 06:56:26.350466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 331/661] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:26.676297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-27f3608a-a137-4e46-a137-76873fe55d4d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Action: 'create', calling method: .version_select at 0x7f89da1f8430>, body: {"keypair": {"name": "tempest-keypair-186675820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOPg+SQ55NTyqMlCCRtZ9lCQMtI4LoeFl0uj1xRgmOAk7JcfBvw4S/RmjkvUD6BFfAyYWb4lro3PSpbNeZ9vbv220z+I7b8m6//3XIl3fBmi3D/CSYKCH4aFDZLW+WVvA=="}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:56:26.692589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-27f3608a-a137-4e46-a137-76873fe55d4d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:56:26.696275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-27f3608a-a137-4e46-a137-76873fe55d4d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for user d77bf80654c24c8c8336ce395f789ccb and project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:56:26.789153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-27f3608a-a137-4e46-a137-76873fe55d4d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117153 May 12 06:56:26.789737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 331/662] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 12 06:56:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:27.366402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cea0f7d0-8972-4a29-a80c-984ce759feec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:27.367029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cea0f7d0-8972-4a29-a80c-984ce759feec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:27.373346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cea0f7d0-8972-4a29-a80c-984ce759feec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:27.373830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cea0f7d0-8972-4a29-a80c-984ce759feec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:27.374606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cea0f7d0-8972-4a29-a80c-984ce759feec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:27.375047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cea0f7d0-8972-4a29-a80c-984ce759feec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:27.511925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cea0f7d0-8972-4a29-a80c-984ce759feec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:27.520273 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cea0f7d0-8972-4a29-a80c-984ce759feec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1724 microversion: 2.1 time: 0.157817 May 12 06:56:27.520940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 332/663] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:28.538160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2aa42ba8-1200-4dbe-a820-ee7c3e8fd522 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:28.538784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2aa42ba8-1200-4dbe-a820-ee7c3e8fd522 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:28.545440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aa42ba8-1200-4dbe-a820-ee7c3e8fd522 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:28.545919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aa42ba8-1200-4dbe-a820-ee7c3e8fd522 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:28.546692 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aa42ba8-1200-4dbe-a820-ee7c3e8fd522 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:28.547139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aa42ba8-1200-4dbe-a820-ee7c3e8fd522 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:28.673486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2aa42ba8-1200-4dbe-a820-ee7c3e8fd522 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:28.681328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2aa42ba8-1200-4dbe-a820-ee7c3e8fd522 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1730 microversion: 2.1 time: 0.147592 May 12 06:56:28.681903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 332/664] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:28.697749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-904c947a-c72e-42a9-9bd2-fecaaefcf585 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:28.698299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-904c947a-c72e-42a9-9bd2-fecaaefcf585 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:28.704546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-904c947a-c72e-42a9-9bd2-fecaaefcf585 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:28.705002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-904c947a-c72e-42a9-9bd2-fecaaefcf585 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:28.705796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-904c947a-c72e-42a9-9bd2-fecaaefcf585 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:28.706237 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-904c947a-c72e-42a9-9bd2-fecaaefcf585 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:28.782656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-904c947a-c72e-42a9-9bd2-fecaaefcf585 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088696 May 12 06:56:28.783265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 333/665] 10.222.0.25 () {58 vars in 1274 bytes} [Thu May 12 06:56:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:29.170186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1007894654", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "940de373-828a-40b3-8a07-fc0aff461153"}], "security_groups": [{"name": "tempest-securitygroup--1882891258"}], "key_name": "tempest-keypair-186675820", "user_data": "}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:56:29.312744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.network.neutron [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] validate_networks() for [('940de373-828a-40b3-8a07-fc0aff461153', None, None, None, None, None)] {{(pid=124024) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:56:30.095845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Flavor limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:56:30.096419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Image limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:56:30.096820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Flavor pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:56:30.097241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Image pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:56:30.097657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:56:30.106314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:30.106767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:30.107847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:30.108066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:30.124412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:56:30.128444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for user d77bf80654c24c8c8336ce395f789ccb and project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:56:30.140583 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Going to run 1 instances... {{(pid=124024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:56:30.142999 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:56:30.255604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1a2dee0b-3a49-4250-9cb8-cdc95c655e32 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.090380 May 12 06:56:30.256266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 333/666] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:56:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 06:56:30.270405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c56003ae-a381-4f95-868a-fa1193153ffb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:30.271910 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c56003ae-a381-4f95-868a-fa1193153ffb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:30.287471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-2828eb7b-484c-4cdd-9b79-25237d4e4d6c req-1e03f982-da1b-4fbc-a300-b2a260dc34b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106", "tag": "bb3b7568-76ad-422a-b728-00d4b4baa39a"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:56:30.305596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-2828eb7b-484c-4cdd-9b79-25237d4e4d6c req-1e03f982-da1b-4fbc-a300-b2a260dc34b9 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:30.307936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-2828eb7b-484c-4cdd-9b79-25237d4e4d6c req-1e03f982-da1b-4fbc-a300-b2a260dc34b9 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:30.322980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-2828eb7b-484c-4cdd-9b79-25237d4e4d6c req-1e03f982-da1b-4fbc-a300-b2a260dc34b9 service nova] Creating event network-changed:bb3b7568-76ad-422a-b728-00d4b4baa39a for instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 on hv-cinder-76606 May 12 06:56:30.338813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c56003ae-a381-4f95-868a-fa1193153ffb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:30.346897 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c56003ae-a381-4f95-868a-fa1193153ffb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1241 microversion: 2.1 time: 0.082965 May 12 06:56:30.347468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 334/667] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:30 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:30.356741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-2828eb7b-484c-4cdd-9b79-25237d4e4d6c req-1e03f982-da1b-4fbc-a300-b2a260dc34b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071547 May 12 06:56:30.356741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 334/668] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:31.363382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-89a16212-762c-4bb4-9100-48f871b3a951 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:31.364163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-89a16212-762c-4bb4-9100-48f871b3a951 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:31.371250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89a16212-762c-4bb4-9100-48f871b3a951 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:31.371713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89a16212-762c-4bb4-9100-48f871b3a951 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:31.372984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89a16212-762c-4bb4-9100-48f871b3a951 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:31.373429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89a16212-762c-4bb4-9100-48f871b3a951 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:31.434581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-89a16212-762c-4bb4-9100-48f871b3a951 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:31.441770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-89a16212-762c-4bb4-9100-48f871b3a951 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1245 microversion: 2.1 time: 0.082170 May 12 06:56:31.442327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 335/669] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:31 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:32.370057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-2b5e3842-9743-4d96-be38-9bd67ba09c61 req-f2cf02b9-2013-4032-ae0a-c484930e9346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106", "tag": "bb3b7568-76ad-422a-b728-00d4b4baa39a"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:56:32.378339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-2b5e3842-9743-4d96-be38-9bd67ba09c61 req-f2cf02b9-2013-4032-ae0a-c484930e9346 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:32.378782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-2b5e3842-9743-4d96-be38-9bd67ba09c61 req-f2cf02b9-2013-4032-ae0a-c484930e9346 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:32.389664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-2b5e3842-9743-4d96-be38-9bd67ba09c61 req-f2cf02b9-2013-4032-ae0a-c484930e9346 service nova] Creating event network-changed:bb3b7568-76ad-422a-b728-00d4b4baa39a for instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 on hv-cinder-76606 May 12 06:56:32.395343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-2b5e3842-9743-4d96-be38-9bd67ba09c61 req-f2cf02b9-2013-4032-ae0a-c484930e9346 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029838 May 12 06:56:32.396036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 335/670] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:32.458924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c8ad3801-3834-4024-9040-6f4c1477e030 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:32.460405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c8ad3801-3834-4024-9040-6f4c1477e030 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:32.467461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8ad3801-3834-4024-9040-6f4c1477e030 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:32.467950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8ad3801-3834-4024-9040-6f4c1477e030 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:32.468792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8ad3801-3834-4024-9040-6f4c1477e030 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:32.469242 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8ad3801-3834-4024-9040-6f4c1477e030 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:32.530898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c8ad3801-3834-4024-9040-6f4c1477e030 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:32.538269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c8ad3801-3834-4024-9040-6f4c1477e030 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1301 microversion: 2.1 time: 0.083371 May 12 06:56:32.548839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 336/671] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:32 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:33.558359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c3b3655b-490a-4673-8ba9-ac5eb6645956 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:33.559142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c3b3655b-490a-4673-8ba9-ac5eb6645956 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:33.565577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3b3655b-490a-4673-8ba9-ac5eb6645956 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:33.566023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3b3655b-490a-4673-8ba9-ac5eb6645956 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:33.566801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3b3655b-490a-4673-8ba9-ac5eb6645956 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:33.567234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3b3655b-490a-4673-8ba9-ac5eb6645956 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:33.709563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c3b3655b-490a-4673-8ba9-ac5eb6645956 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:33.717249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c3b3655b-490a-4673-8ba9-ac5eb6645956 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1367 microversion: 2.1 time: 0.164350 May 12 06:56:33.718138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 336/672] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:33 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:34.426728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-07fd169a-3deb-4923-94fb-127eb0d0541a req-79c7b987-49c7-4beb-9f96-b611698a7e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21c151d1-8962-4a06-b362-6b195a231bb1", "tag": "9cad092e-69e2-4b4d-9f3c-ae1859cafe86"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:56:34.436517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-07fd169a-3deb-4923-94fb-127eb0d0541a req-79c7b987-49c7-4beb-9f96-b611698a7e5a service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:34.437045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-07fd169a-3deb-4923-94fb-127eb0d0541a req-79c7b987-49c7-4beb-9f96-b611698a7e5a service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:34.448900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-07fd169a-3deb-4923-94fb-127eb0d0541a req-79c7b987-49c7-4beb-9f96-b611698a7e5a service nova] Creating event network-changed:9cad092e-69e2-4b4d-9f3c-ae1859cafe86 for instance 21c151d1-8962-4a06-b362-6b195a231bb1 on hv-cinder-76606 May 12 06:56:34.459231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-07fd169a-3deb-4923-94fb-127eb0d0541a req-79c7b987-49c7-4beb-9f96-b611698a7e5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031490 May 12 06:56:34.459231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 337/673] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:56:34.734568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b4ff6a19-9ec5-47c3-a335-825f71c12109 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:34.735133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b4ff6a19-9ec5-47c3-a335-825f71c12109 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:34.741372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4ff6a19-9ec5-47c3-a335-825f71c12109 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:34.741827 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4ff6a19-9ec5-47c3-a335-825f71c12109 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:34.742603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4ff6a19-9ec5-47c3-a335-825f71c12109 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:34.743043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4ff6a19-9ec5-47c3-a335-825f71c12109 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:34.879161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b4ff6a19-9ec5-47c3-a335-825f71c12109 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:34.887163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b4ff6a19-9ec5-47c3-a335-825f71c12109 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1367 microversion: 2.1 time: 0.156612 May 12 06:56:34.887753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 337/674] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:34 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:35.905162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ec5c994d-3ad5-4218-bf6b-b0cbdd6641ed tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:35.905783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ec5c994d-3ad5-4218-bf6b-b0cbdd6641ed tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:35.911896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec5c994d-3ad5-4218-bf6b-b0cbdd6641ed tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:35.912354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec5c994d-3ad5-4218-bf6b-b0cbdd6641ed tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:35.913134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec5c994d-3ad5-4218-bf6b-b0cbdd6641ed tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:35.913581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec5c994d-3ad5-4218-bf6b-b0cbdd6641ed tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:36.038352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ec5c994d-3ad5-4218-bf6b-b0cbdd6641ed tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:36.045871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ec5c994d-3ad5-4218-bf6b-b0cbdd6641ed tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1367 microversion: 2.1 time: 0.146076 May 12 06:56:36.046441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 338/675] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:35 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:37.062539 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fe87b72f-16f9-4845-b0d0-8a5be86b93d1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:37.063157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fe87b72f-16f9-4845-b0d0-8a5be86b93d1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:37.069502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe87b72f-16f9-4845-b0d0-8a5be86b93d1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:37.069954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe87b72f-16f9-4845-b0d0-8a5be86b93d1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:37.070730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe87b72f-16f9-4845-b0d0-8a5be86b93d1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:37.071163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe87b72f-16f9-4845-b0d0-8a5be86b93d1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:37.197268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fe87b72f-16f9-4845-b0d0-8a5be86b93d1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:37.204522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fe87b72f-16f9-4845-b0d0-8a5be86b93d1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1367 microversion: 2.1 time: 0.145827 May 12 06:56:37.205083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 338/676] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:37 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:38.221986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a76de215-7b98-4b67-84a2-4a0b4e4a232b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:38.222522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a76de215-7b98-4b67-84a2-4a0b4e4a232b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:38.229597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a76de215-7b98-4b67-84a2-4a0b4e4a232b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:38.230042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a76de215-7b98-4b67-84a2-4a0b4e4a232b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:38.230820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a76de215-7b98-4b67-84a2-4a0b4e4a232b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:38.231255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a76de215-7b98-4b67-84a2-4a0b4e4a232b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:38.358038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a76de215-7b98-4b67-84a2-4a0b4e4a232b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:38.365559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a76de215-7b98-4b67-84a2-4a0b4e4a232b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1367 microversion: 2.1 time: 0.147421 May 12 06:56:38.366157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 339/677] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:38 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:39.382415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-28deb06f-6f3d-4634-bd73-643e830a181b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:39.382986 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-28deb06f-6f3d-4634-bd73-643e830a181b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:39.389928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-28deb06f-6f3d-4634-bd73-643e830a181b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:39.390376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-28deb06f-6f3d-4634-bd73-643e830a181b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:39.391141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-28deb06f-6f3d-4634-bd73-643e830a181b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:39.391580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-28deb06f-6f3d-4634-bd73-643e830a181b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:39.571268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-28deb06f-6f3d-4634-bd73-643e830a181b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:39.579163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-28deb06f-6f3d-4634-bd73-643e830a181b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1367 microversion: 2.1 time: 0.200667 May 12 06:56:39.579753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 339/678] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:39 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:40.049393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-5c7d4954-cdc1-4239-abbe-a1a7f37adf5f req-deeb0f45-8a91-4608-be2a-51f2410713ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c151d1-8962-4a06-b362-6b195a231bb1", "name": "network-vif-plugged", "status": "completed", "tag": "9cad092e-69e2-4b4d-9f3c-ae1859cafe86"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:56:40.057771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-5c7d4954-cdc1-4239-abbe-a1a7f37adf5f req-deeb0f45-8a91-4608-be2a-51f2410713ca service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:40.058214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-5c7d4954-cdc1-4239-abbe-a1a7f37adf5f req-deeb0f45-8a91-4608-be2a-51f2410713ca service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:40.068983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-5c7d4954-cdc1-4239-abbe-a1a7f37adf5f req-deeb0f45-8a91-4608-be2a-51f2410713ca service nova] Creating event network-vif-plugged:9cad092e-69e2-4b4d-9f3c-ae1859cafe86 for instance 21c151d1-8962-4a06-b362-6b195a231bb1 on hv-cinder-76606 May 12 06:56:40.073775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-5c7d4954-cdc1-4239-abbe-a1a7f37adf5f req-deeb0f45-8a91-4608-be2a-51f2410713ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028081 May 12 06:56:40.074423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 340/679] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:40.596725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-174d3848-ebba-493f-8327-0d32be4f86c7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:40.597326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-174d3848-ebba-493f-8327-0d32be4f86c7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:40.604094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-174d3848-ebba-493f-8327-0d32be4f86c7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:40.604544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-174d3848-ebba-493f-8327-0d32be4f86c7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:40.605307 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-174d3848-ebba-493f-8327-0d32be4f86c7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:40.605742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-174d3848-ebba-493f-8327-0d32be4f86c7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:40.731350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-174d3848-ebba-493f-8327-0d32be4f86c7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:40.738540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-174d3848-ebba-493f-8327-0d32be4f86c7 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1367 microversion: 2.1 time: 0.145695 May 12 06:56:40.739104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 340/680] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:40 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:40.983202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 06:56:40.983436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 06:56:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 06:56:41.756384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7ec78ec4-d01d-4128-a2f3-e312eba225a5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:41.757089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7ec78ec4-d01d-4128-a2f3-e312eba225a5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:41.763810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ec78ec4-d01d-4128-a2f3-e312eba225a5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:41.764259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ec78ec4-d01d-4128-a2f3-e312eba225a5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:41.765029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ec78ec4-d01d-4128-a2f3-e312eba225a5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:41.765469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7ec78ec4-d01d-4128-a2f3-e312eba225a5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:41.940587 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7ec78ec4-d01d-4128-a2f3-e312eba225a5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:41.948097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7ec78ec4-d01d-4128-a2f3-e312eba225a5 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1367 microversion: 2.1 time: 0.196298 May 12 06:56:41.948661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 341/681] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:41 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:42.965470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-80816a68-039e-4a35-a382-3d62226af40a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:42.966080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-80816a68-039e-4a35-a382-3d62226af40a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:42.972118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80816a68-039e-4a35-a382-3d62226af40a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:42.972564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80816a68-039e-4a35-a382-3d62226af40a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:42.973326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80816a68-039e-4a35-a382-3d62226af40a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:42.973756 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80816a68-039e-4a35-a382-3d62226af40a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:43.104053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-80816a68-039e-4a35-a382-3d62226af40a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:43.111391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-80816a68-039e-4a35-a382-3d62226af40a tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1556 microversion: 2.1 time: 0.150206 May 12 06:56:43.112054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 341/682] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:42 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:43.127408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-64b8847b-3945-4dcd-bb6b-029f1763b54b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:43.127958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-64b8847b-3945-4dcd-bb6b-029f1763b54b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:43.134114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64b8847b-3945-4dcd-bb6b-029f1763b54b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:43.134565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64b8847b-3945-4dcd-bb6b-029f1763b54b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:43.135332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64b8847b-3945-4dcd-bb6b-029f1763b54b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:43.135793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64b8847b-3945-4dcd-bb6b-029f1763b54b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:43.210059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-64b8847b-3945-4dcd-bb6b-029f1763b54b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086375 May 12 06:56:43.210651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 342/683] 10.222.0.25 () {58 vars in 1274 bytes} [Thu May 12 06:56:43 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:44.218108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-47e1562a-5c10-41f8-87d9-696924c248c9 req-e680b6db-bfaf-43b8-a07a-06ee27a21c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21c151d1-8962-4a06-b362-6b195a231bb1", "tag": "9cad092e-69e2-4b4d-9f3c-ae1859cafe86"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:56:44.226355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-47e1562a-5c10-41f8-87d9-696924c248c9 req-e680b6db-bfaf-43b8-a07a-06ee27a21c04 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:44.226734 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-47e1562a-5c10-41f8-87d9-696924c248c9 req-e680b6db-bfaf-43b8-a07a-06ee27a21c04 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:44.237915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-47e1562a-5c10-41f8-87d9-696924c248c9 req-e680b6db-bfaf-43b8-a07a-06ee27a21c04 service nova] Creating event network-changed:9cad092e-69e2-4b4d-9f3c-ae1859cafe86 for instance 21c151d1-8962-4a06-b362-6b195a231bb1 on hv-cinder-76606 May 12 06:56:44.243118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-47e1562a-5c10-41f8-87d9-696924c248c9 req-e680b6db-bfaf-43b8-a07a-06ee27a21c04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028597 May 12 06:56:44.243748 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 342/684] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:56:49.833378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1c5ba898-a0b9-4705-b986-bb8a3e078e89 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:56:49.837789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1c5ba898-a0b9-4705-b986-bb8a3e078e89 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:49.839911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c5ba898-a0b9-4705-b986-bb8a3e078e89 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:49.840354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c5ba898-a0b9-4705-b986-bb8a3e078e89 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:49.841112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c5ba898-a0b9-4705-b986-bb8a3e078e89 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:49.841544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c5ba898-a0b9-4705-b986-bb8a3e078e89 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:49.863063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-1c5ba898-a0b9-4705-b986-bb8a3e078e89 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lazy-loading 'flavor' on Instance uuid 0f0fa87a-f20f-489f-b64c-04073a58a792 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:56:50.157445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1c5ba898-a0b9-4705-b986-bb8a3e078e89 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "POST /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792/action" status: 202 len: 0 microversion: 2.1 time: 0.328136 May 12 06:56:50.158167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 343/685] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 06:56:49 2022] POST /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 06:56:50.167861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e46cabaf-0bc5-4dcf-be07-a355eb64b212 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:50.168579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e46cabaf-0bc5-4dcf-be07-a355eb64b212 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:50.174973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e46cabaf-0bc5-4dcf-be07-a355eb64b212 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:50.175421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e46cabaf-0bc5-4dcf-be07-a355eb64b212 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:50.176268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e46cabaf-0bc5-4dcf-be07-a355eb64b212 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:50.176710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e46cabaf-0bc5-4dcf-be07-a355eb64b212 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:50.309402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e46cabaf-0bc5-4dcf-be07-a355eb64b212 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:50.318518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e46cabaf-0bc5-4dcf-be07-a355eb64b212 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.154285 May 12 06:56:50.318518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 343/686] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:50 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:51.335811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dfa40e1e-a0bd-44ba-bf4c-a5e00bd1e7c9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:51.336437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dfa40e1e-a0bd-44ba-bf4c-a5e00bd1e7c9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:51.342593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dfa40e1e-a0bd-44ba-bf4c-a5e00bd1e7c9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:51.343039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dfa40e1e-a0bd-44ba-bf4c-a5e00bd1e7c9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:51.343834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dfa40e1e-a0bd-44ba-bf4c-a5e00bd1e7c9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:51.344270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dfa40e1e-a0bd-44ba-bf4c-a5e00bd1e7c9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:51.696819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dfa40e1e-a0bd-44ba-bf4c-a5e00bd1e7c9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:51.704029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dfa40e1e-a0bd-44ba-bf4c-a5e00bd1e7c9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.373313 May 12 06:56:51.704589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 344/687] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:51 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:52.720897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-78dd72ab-08ca-428a-8d3f-16b66d3d37a3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:52.721649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-78dd72ab-08ca-428a-8d3f-16b66d3d37a3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:52.728609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78dd72ab-08ca-428a-8d3f-16b66d3d37a3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:52.729060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78dd72ab-08ca-428a-8d3f-16b66d3d37a3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:52.729830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78dd72ab-08ca-428a-8d3f-16b66d3d37a3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:52.730269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78dd72ab-08ca-428a-8d3f-16b66d3d37a3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:52.854538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-78dd72ab-08ca-428a-8d3f-16b66d3d37a3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:52.861828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-78dd72ab-08ca-428a-8d3f-16b66d3d37a3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.144878 May 12 06:56:52.862393 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 344/688] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:52 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:53.878922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cf91f0d7-98f7-4b66-8a87-2906caa923fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:53.879539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cf91f0d7-98f7-4b66-8a87-2906caa923fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:53.886329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf91f0d7-98f7-4b66-8a87-2906caa923fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:53.886773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf91f0d7-98f7-4b66-8a87-2906caa923fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:53.887545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf91f0d7-98f7-4b66-8a87-2906caa923fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:53.888005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf91f0d7-98f7-4b66-8a87-2906caa923fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:54.018149 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cf91f0d7-98f7-4b66-8a87-2906caa923fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:54.025993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cf91f0d7-98f7-4b66-8a87-2906caa923fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150866 May 12 06:56:54.026554 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 345/689] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:53 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:55.041869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e18ef23f-aeba-4311-a08c-e8b48a791284 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:55.042485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e18ef23f-aeba-4311-a08c-e8b48a791284 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:55.049138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e18ef23f-aeba-4311-a08c-e8b48a791284 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:55.058850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e18ef23f-aeba-4311-a08c-e8b48a791284 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:55.058850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e18ef23f-aeba-4311-a08c-e8b48a791284 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:55.058850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e18ef23f-aeba-4311-a08c-e8b48a791284 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:55.178167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e18ef23f-aeba-4311-a08c-e8b48a791284 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:55.185534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e18ef23f-aeba-4311-a08c-e8b48a791284 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147544 May 12 06:56:55.186090 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 345/690] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:55 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:56.202853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-084273ff-d81c-4917-9080-6d0f1ffb5faf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:56.203467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-084273ff-d81c-4917-9080-6d0f1ffb5faf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:56.209800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-084273ff-d81c-4917-9080-6d0f1ffb5faf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:56.210251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-084273ff-d81c-4917-9080-6d0f1ffb5faf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:56.211022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-084273ff-d81c-4917-9080-6d0f1ffb5faf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:56.211464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-084273ff-d81c-4917-9080-6d0f1ffb5faf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:56.339460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-084273ff-d81c-4917-9080-6d0f1ffb5faf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:56.346802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-084273ff-d81c-4917-9080-6d0f1ffb5faf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147812 May 12 06:56:56.347368 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 346/691] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:56 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:57.363778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-82af36d0-cfda-4cc4-b2b0-4a4da35b99bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:57.364315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-82af36d0-cfda-4cc4-b2b0-4a4da35b99bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:57.371574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-82af36d0-cfda-4cc4-b2b0-4a4da35b99bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:57.372046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-82af36d0-cfda-4cc4-b2b0-4a4da35b99bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:57.372810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-82af36d0-cfda-4cc4-b2b0-4a4da35b99bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:57.373242 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-82af36d0-cfda-4cc4-b2b0-4a4da35b99bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:57.499870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-82af36d0-cfda-4cc4-b2b0-4a4da35b99bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:57.507083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-82af36d0-cfda-4cc4-b2b0-4a4da35b99bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147234 May 12 06:56:57.507643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 346/692] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:57 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:58.524400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9a7ea712-8683-497f-afb9-938d7a564c78 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:58.525009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9a7ea712-8683-497f-afb9-938d7a564c78 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:58.531220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a7ea712-8683-497f-afb9-938d7a564c78 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:58.531661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a7ea712-8683-497f-afb9-938d7a564c78 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:58.532450 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a7ea712-8683-497f-afb9-938d7a564c78 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:58.532885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a7ea712-8683-497f-afb9-938d7a564c78 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:58.661274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9a7ea712-8683-497f-afb9-938d7a564c78 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:58.668668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9a7ea712-8683-497f-afb9-938d7a564c78 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148125 May 12 06:56:58.669228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 347/693] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:58 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:56:59.274368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-33f3995a-5685-4726-a6c1-ac2b1ff6a5ea tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:59.274944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-33f3995a-5685-4726-a6c1-ac2b1ff6a5ea tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:59.281091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33f3995a-5685-4726-a6c1-ac2b1ff6a5ea tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:59.281542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33f3995a-5685-4726-a6c1-ac2b1ff6a5ea tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:59.282301 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33f3995a-5685-4726-a6c1-ac2b1ff6a5ea tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:59.282735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33f3995a-5685-4726-a6c1-ac2b1ff6a5ea tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:59.311335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-33f3995a-5685-4726-a6c1-ac2b1ff6a5ea tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments/b0a6390b-f839-4178-bd7c-8adf4be85e75" status: 200 len: 194 microversion: 2.20 time: 0.040984 May 12 06:56:59.311932 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 347/694] 10.222.0.25 () {60 vars in 1453 bytes} [Thu May 12 06:56:59 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments/b0a6390b-f839-4178-bd7c-8adf4be85e75 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:56:59.371116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-24c54f33-fcee-4a96-bfdc-b474ce8f7c36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:59.371609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-24c54f33-fcee-4a96-bfdc-b474ce8f7c36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:59.377506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24c54f33-fcee-4a96-bfdc-b474ce8f7c36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:59.377952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24c54f33-fcee-4a96-bfdc-b474ce8f7c36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:59.378713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24c54f33-fcee-4a96-bfdc-b474ce8f7c36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:59.379147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24c54f33-fcee-4a96-bfdc-b474ce8f7c36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:59.456663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-24c54f33-fcee-4a96-bfdc-b474ce8f7c36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lazy-loading 'services' on Instance uuid d30aa8f3-ada1-42f3-bb93-081f2552b4a3 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:56:59.685755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c00d5600-beb1-4251-9fd0-0254153a5bd8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:59.686401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c00d5600-beb1-4251-9fd0-0254153a5bd8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:59.692181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d5600-beb1-4251-9fd0-0254153a5bd8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:59.692630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d5600-beb1-4251-9fd0-0254153a5bd8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:59.693424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d5600-beb1-4251-9fd0-0254153a5bd8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:59.693857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d5600-beb1-4251-9fd0-0254153a5bd8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:59.710688 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-24c54f33-fcee-4a96-bfdc-b474ce8f7c36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments/b0a6390b-f839-4178-bd7c-8adf4be85e75" status: 202 len: 0 microversion: 2.20 time: 0.343904 May 12 06:56:59.711477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 348/695] 10.222.0.25 () {60 vars in 1456 bytes} [Thu May 12 06:56:59 2022] DELETE /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments/b0a6390b-f839-4178-bd7c-8adf4be85e75 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 06:56:59.720411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-66cf5632-0799-4a02-8783-84d14bdd9fa3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:56:59.721472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-66cf5632-0799-4a02-8783-84d14bdd9fa3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:56:59.727579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66cf5632-0799-4a02-8783-84d14bdd9fa3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:59.730839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66cf5632-0799-4a02-8783-84d14bdd9fa3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:59.730839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66cf5632-0799-4a02-8783-84d14bdd9fa3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:56:59.730839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66cf5632-0799-4a02-8783-84d14bdd9fa3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:56:59.760198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-66cf5632-0799-4a02-8783-84d14bdd9fa3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044000 May 12 06:56:59.761026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 349/696] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:56:59 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:56:59.827551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c00d5600-beb1-4251-9fd0-0254153a5bd8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:56:59.835274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c00d5600-beb1-4251-9fd0-0254153a5bd8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.153356 May 12 06:56:59.835886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 348/697] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:56:59 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:57:00.772573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-756033d7-8ebd-4d1d-a3e8-6b1f80bb86f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:00.773663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-756033d7-8ebd-4d1d-a3e8-6b1f80bb86f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:00.780915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-756033d7-8ebd-4d1d-a3e8-6b1f80bb86f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:00.781381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-756033d7-8ebd-4d1d-a3e8-6b1f80bb86f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:00.782214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-756033d7-8ebd-4d1d-a3e8-6b1f80bb86f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:00.782659 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-756033d7-8ebd-4d1d-a3e8-6b1f80bb86f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:00.811303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-756033d7-8ebd-4d1d-a3e8-6b1f80bb86f5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042938 May 12 06:57:00.811900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 350/698] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:00 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:00.852226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-83175d25-4540-40da-ade9-62f417b7ac04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:00.852837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-83175d25-4540-40da-ade9-62f417b7ac04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:00.859028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83175d25-4540-40da-ade9-62f417b7ac04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:00.859492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83175d25-4540-40da-ade9-62f417b7ac04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:00.860833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83175d25-4540-40da-ade9-62f417b7ac04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:00.861282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83175d25-4540-40da-ade9-62f417b7ac04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:00.997994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-83175d25-4540-40da-ade9-62f417b7ac04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:01.009743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-83175d25-4540-40da-ade9-62f417b7ac04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.161401 May 12 06:57:01.010313 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 349/699] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:00 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:01.823540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a68f3492-2470-48c4-abdf-26a301bbaf13 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:01.824593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a68f3492-2470-48c4-abdf-26a301bbaf13 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:01.831274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a68f3492-2470-48c4-abdf-26a301bbaf13 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:01.831760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a68f3492-2470-48c4-abdf-26a301bbaf13 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:01.832536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a68f3492-2470-48c4-abdf-26a301bbaf13 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:01.832973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a68f3492-2470-48c4-abdf-26a301bbaf13 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:01.865548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a68f3492-2470-48c4-abdf-26a301bbaf13 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046094 May 12 06:57:01.866125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 351/700] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:01 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:02.026713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0e4d01da-6a88-4b0a-96eb-d962e6d01019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:02.027239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0e4d01da-6a88-4b0a-96eb-d962e6d01019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:02.033732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e4d01da-6a88-4b0a-96eb-d962e6d01019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:02.034181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e4d01da-6a88-4b0a-96eb-d962e6d01019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:02.034963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e4d01da-6a88-4b0a-96eb-d962e6d01019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:02.035398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e4d01da-6a88-4b0a-96eb-d962e6d01019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:02.166339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0e4d01da-6a88-4b0a-96eb-d962e6d01019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:02.173823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0e4d01da-6a88-4b0a-96eb-d962e6d01019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.151612 May 12 06:57:02.174391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 350/701] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:02 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:02.877556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bc75fff8-5716-4044-b622-e2701ae86856 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:02.878431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bc75fff8-5716-4044-b622-e2701ae86856 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:02.885219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc75fff8-5716-4044-b622-e2701ae86856 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:02.885672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc75fff8-5716-4044-b622-e2701ae86856 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:02.886442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc75fff8-5716-4044-b622-e2701ae86856 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:02.886880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc75fff8-5716-4044-b622-e2701ae86856 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:02.915398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bc75fff8-5716-4044-b622-e2701ae86856 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041961 May 12 06:57:02.916049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 352/702] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:02 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:03.190297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-15769b45-d787-423d-a2d4-20ca04fd3082 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:03.190834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-15769b45-d787-423d-a2d4-20ca04fd3082 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:03.197163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15769b45-d787-423d-a2d4-20ca04fd3082 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:03.197614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15769b45-d787-423d-a2d4-20ca04fd3082 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:03.198382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15769b45-d787-423d-a2d4-20ca04fd3082 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:03.198819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15769b45-d787-423d-a2d4-20ca04fd3082 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:03.323869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-15769b45-d787-423d-a2d4-20ca04fd3082 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:03.331152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-15769b45-d787-423d-a2d4-20ca04fd3082 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.144733 May 12 06:57:03.331870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 351/703] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:03 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:03.926858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2cd46dc3-ee08-483f-a0c6-2a12dd03d114 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:03.927714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2cd46dc3-ee08-483f-a0c6-2a12dd03d114 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:03.934463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2cd46dc3-ee08-483f-a0c6-2a12dd03d114 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:03.934911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2cd46dc3-ee08-483f-a0c6-2a12dd03d114 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:03.935672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2cd46dc3-ee08-483f-a0c6-2a12dd03d114 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:03.936134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2cd46dc3-ee08-483f-a0c6-2a12dd03d114 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:03.964962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2cd46dc3-ee08-483f-a0c6-2a12dd03d114 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042143 May 12 06:57:03.965518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 353/704] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:04.348499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-661532ff-7e2b-41b8-aa2c-e4e77321e2b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:04.349118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-661532ff-7e2b-41b8-aa2c-e4e77321e2b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:04.356388 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-661532ff-7e2b-41b8-aa2c-e4e77321e2b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:04.356833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-661532ff-7e2b-41b8-aa2c-e4e77321e2b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:04.357599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-661532ff-7e2b-41b8-aa2c-e4e77321e2b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:04.358034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-661532ff-7e2b-41b8-aa2c-e4e77321e2b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:04.486384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-661532ff-7e2b-41b8-aa2c-e4e77321e2b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:04.494936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-661532ff-7e2b-41b8-aa2c-e4e77321e2b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150358 May 12 06:57:04.495503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 352/705] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:04.976651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-738e45f4-914c-4dbb-a192-0056d9353c84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:04.978073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-738e45f4-914c-4dbb-a192-0056d9353c84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:04.984356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-738e45f4-914c-4dbb-a192-0056d9353c84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:04.984807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-738e45f4-914c-4dbb-a192-0056d9353c84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:04.985574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-738e45f4-914c-4dbb-a192-0056d9353c84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:04.986013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-738e45f4-914c-4dbb-a192-0056d9353c84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:05.014830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-738e45f4-914c-4dbb-a192-0056d9353c84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042213 May 12 06:57:05.015380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 354/706] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:04 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:05.511816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-440bd3a9-0f5c-41dd-8ea7-c2df442f8162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:05.512429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-440bd3a9-0f5c-41dd-8ea7-c2df442f8162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:05.518693 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-440bd3a9-0f5c-41dd-8ea7-c2df442f8162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:05.519135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-440bd3a9-0f5c-41dd-8ea7-c2df442f8162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:05.519920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-440bd3a9-0f5c-41dd-8ea7-c2df442f8162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:05.520356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-440bd3a9-0f5c-41dd-8ea7-c2df442f8162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:05.648373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-440bd3a9-0f5c-41dd-8ea7-c2df442f8162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:05.655528 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-440bd3a9-0f5c-41dd-8ea7-c2df442f8162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147674 May 12 06:57:05.656123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 353/707] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:05 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:06.028813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c3672a0c-7e94-4933-897a-2e03c455cbb6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:06.029749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c3672a0c-7e94-4933-897a-2e03c455cbb6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:06.036612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3672a0c-7e94-4933-897a-2e03c455cbb6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:06.037066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3672a0c-7e94-4933-897a-2e03c455cbb6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:06.037851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3672a0c-7e94-4933-897a-2e03c455cbb6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:06.038292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3672a0c-7e94-4933-897a-2e03c455cbb6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:06.069864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c3672a0c-7e94-4933-897a-2e03c455cbb6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047227 May 12 06:57:06.071228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 355/708] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:06 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:06.125893 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-87adf664-07bf-49a7-a639-dda973073ad6 req-487c02ec-a413-470d-8794-7b3d04f6a95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0fa87a-f20f-489f-b64c-04073a58a792", "name": "network-vif-unplugged", "status": "completed", "tag": "bbe011a7-6d2c-4588-95a8-e8d354355950"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:57:06.134727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-87adf664-07bf-49a7-a639-dda973073ad6 req-487c02ec-a413-470d-8794-7b3d04f6a95d service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:06.135174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-87adf664-07bf-49a7-a639-dda973073ad6 req-487c02ec-a413-470d-8794-7b3d04f6a95d service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:06.145787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-87adf664-07bf-49a7-a639-dda973073ad6 req-487c02ec-a413-470d-8794-7b3d04f6a95d service nova] Creating event network-vif-unplugged:bbe011a7-6d2c-4588-95a8-e8d354355950 for instance 0f0fa87a-f20f-489f-b64c-04073a58a792 on hv-cinder-76606 May 12 06:57:06.151404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-87adf664-07bf-49a7-a639-dda973073ad6 req-487c02ec-a413-470d-8794-7b3d04f6a95d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029125 May 12 06:57:06.152012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 354/709] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:57:06.672431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a9894246-c0cc-49c4-aca1-35a191aa8d35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:06.673043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a9894246-c0cc-49c4-aca1-35a191aa8d35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:06.678918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9894246-c0cc-49c4-aca1-35a191aa8d35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:06.679359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9894246-c0cc-49c4-aca1-35a191aa8d35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:06.680739 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9894246-c0cc-49c4-aca1-35a191aa8d35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:06.681173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9894246-c0cc-49c4-aca1-35a191aa8d35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:06.806974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a9894246-c0cc-49c4-aca1-35a191aa8d35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:06.814487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a9894246-c0cc-49c4-aca1-35a191aa8d35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146079 May 12 06:57:06.815062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 356/710] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:06 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:07.083501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-55d5f3d4-a961-43e9-b396-a7aa7989a7ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:07.084526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-55d5f3d4-a961-43e9-b396-a7aa7989a7ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:07.091290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55d5f3d4-a961-43e9-b396-a7aa7989a7ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:07.091766 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55d5f3d4-a961-43e9-b396-a7aa7989a7ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:07.092530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55d5f3d4-a961-43e9-b396-a7aa7989a7ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:07.092967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55d5f3d4-a961-43e9-b396-a7aa7989a7ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:07.121312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-55d5f3d4-a961-43e9-b396-a7aa7989a7ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042611 May 12 06:57:07.121866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 355/711] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:07 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:07.831735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6b71eb35-18e2-4c37-86ff-a43e53b0d9a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:07.832352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6b71eb35-18e2-4c37-86ff-a43e53b0d9a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:07.839128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b71eb35-18e2-4c37-86ff-a43e53b0d9a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:07.839586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b71eb35-18e2-4c37-86ff-a43e53b0d9a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:07.840369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b71eb35-18e2-4c37-86ff-a43e53b0d9a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:07.840802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b71eb35-18e2-4c37-86ff-a43e53b0d9a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:07.970110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6b71eb35-18e2-4c37-86ff-a43e53b0d9a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:07.978146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6b71eb35-18e2-4c37-86ff-a43e53b0d9a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150315 May 12 06:57:07.978706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 357/712] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:07 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:08.133552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3a0548a9-7213-4a69-a792-65c44796baac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:08.134398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3a0548a9-7213-4a69-a792-65c44796baac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:08.141560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a0548a9-7213-4a69-a792-65c44796baac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:08.142034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a0548a9-7213-4a69-a792-65c44796baac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:08.142792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a0548a9-7213-4a69-a792-65c44796baac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:08.143227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a0548a9-7213-4a69-a792-65c44796baac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:08.172228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3a0548a9-7213-4a69-a792-65c44796baac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043237 May 12 06:57:08.172771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 356/713] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:08.994326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e47d9bb7-7354-4907-b119-e3ced2bc8c8f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:08.994976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e47d9bb7-7354-4907-b119-e3ced2bc8c8f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:09.001340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e47d9bb7-7354-4907-b119-e3ced2bc8c8f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:09.001781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e47d9bb7-7354-4907-b119-e3ced2bc8c8f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:09.002555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e47d9bb7-7354-4907-b119-e3ced2bc8c8f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:09.002994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e47d9bb7-7354-4907-b119-e3ced2bc8c8f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:09.129452 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e47d9bb7-7354-4907-b119-e3ced2bc8c8f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:09.137443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e47d9bb7-7354-4907-b119-e3ced2bc8c8f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147010 May 12 06:57:09.138011 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 358/714] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:08 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:09.184909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8d7f334c-d1fe-48ab-b0ae-73134cef41a3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:09.185817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8d7f334c-d1fe-48ab-b0ae-73134cef41a3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:09.192468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7f334c-d1fe-48ab-b0ae-73134cef41a3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:09.192915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7f334c-d1fe-48ab-b0ae-73134cef41a3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:09.193671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7f334c-d1fe-48ab-b0ae-73134cef41a3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:09.194101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7f334c-d1fe-48ab-b0ae-73134cef41a3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:09.222534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8d7f334c-d1fe-48ab-b0ae-73134cef41a3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041515 May 12 06:57:09.223085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 357/715] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:10.154843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d33d48eb-9821-4010-935e-c28f3cba3d75 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:10.155482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d33d48eb-9821-4010-935e-c28f3cba3d75 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:10.161726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d33d48eb-9821-4010-935e-c28f3cba3d75 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:10.162175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d33d48eb-9821-4010-935e-c28f3cba3d75 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:10.162943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d33d48eb-9821-4010-935e-c28f3cba3d75 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:10.163382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d33d48eb-9821-4010-935e-c28f3cba3d75 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:10.234377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-af20d71a-5602-4875-9395-cbebf5b15178 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:10.235369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-af20d71a-5602-4875-9395-cbebf5b15178 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:10.241766 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af20d71a-5602-4875-9395-cbebf5b15178 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:10.242226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af20d71a-5602-4875-9395-cbebf5b15178 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:10.243487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af20d71a-5602-4875-9395-cbebf5b15178 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:10.243587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af20d71a-5602-4875-9395-cbebf5b15178 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:10.272821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-af20d71a-5602-4875-9395-cbebf5b15178 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042508 May 12 06:57:10.273389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 358/716] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:10 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:57:10.300848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d33d48eb-9821-4010-935e-c28f3cba3d75 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:10.303784 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d33d48eb-9821-4010-935e-c28f3cba3d75 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.152834 May 12 06:57:10.304353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 359/717] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:10 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:11.285370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f37d3531-56a1-4d86-b46c-6a47ae86c913 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:11.286347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f37d3531-56a1-4d86-b46c-6a47ae86c913 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:11.292621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f37d3531-56a1-4d86-b46c-6a47ae86c913 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:11.293075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f37d3531-56a1-4d86-b46c-6a47ae86c913 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:11.293839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f37d3531-56a1-4d86-b46c-6a47ae86c913 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:11.294275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f37d3531-56a1-4d86-b46c-6a47ae86c913 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:11.321302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b716c932-0f89-4fcf-9681-fa4b74a18aae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:11.321925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b716c932-0f89-4fcf-9681-fa4b74a18aae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:11.322622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f37d3531-56a1-4d86-b46c-6a47ae86c913 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041245 May 12 06:57:11.323186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 359/718] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:11.328666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b716c932-0f89-4fcf-9681-fa4b74a18aae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:11.329125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b716c932-0f89-4fcf-9681-fa4b74a18aae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:11.329912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b716c932-0f89-4fcf-9681-fa4b74a18aae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:11.330352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b716c932-0f89-4fcf-9681-fa4b74a18aae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:11.456655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b716c932-0f89-4fcf-9681-fa4b74a18aae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:11.463943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b716c932-0f89-4fcf-9681-fa4b74a18aae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146849 May 12 06:57:11.464519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 360/719] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:11 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:57:12.334354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-647b45c5-4c3c-49e6-9e5d-ad2bad76dd5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:12.335188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-647b45c5-4c3c-49e6-9e5d-ad2bad76dd5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:12.341513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-647b45c5-4c3c-49e6-9e5d-ad2bad76dd5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:12.341963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-647b45c5-4c3c-49e6-9e5d-ad2bad76dd5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:12.342725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-647b45c5-4c3c-49e6-9e5d-ad2bad76dd5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:12.343171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-647b45c5-4c3c-49e6-9e5d-ad2bad76dd5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:12.371280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-647b45c5-4c3c-49e6-9e5d-ad2bad76dd5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041037 May 12 06:57:12.371854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 360/720] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:12 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:12.479960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ca53eb93-8c6e-41ad-b77a-aaca7f1f2f3c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:12.480568 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ca53eb93-8c6e-41ad-b77a-aaca7f1f2f3c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:12.486774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ca53eb93-8c6e-41ad-b77a-aaca7f1f2f3c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:12.487225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ca53eb93-8c6e-41ad-b77a-aaca7f1f2f3c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:12.488026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ca53eb93-8c6e-41ad-b77a-aaca7f1f2f3c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:12.488459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ca53eb93-8c6e-41ad-b77a-aaca7f1f2f3c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:12.616990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ca53eb93-8c6e-41ad-b77a-aaca7f1f2f3c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:12.624944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ca53eb93-8c6e-41ad-b77a-aaca7f1f2f3c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148875 May 12 06:57:12.625509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 361/721] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:12 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:13.382557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-62476095-a476-4240-b5bb-6f9310106a83 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:13.383916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-62476095-a476-4240-b5bb-6f9310106a83 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:13.390217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62476095-a476-4240-b5bb-6f9310106a83 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:13.390660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62476095-a476-4240-b5bb-6f9310106a83 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:13.391412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62476095-a476-4240-b5bb-6f9310106a83 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:13.391892 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62476095-a476-4240-b5bb-6f9310106a83 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:13.420400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-62476095-a476-4240-b5bb-6f9310106a83 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041570 May 12 06:57:13.420967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 361/722] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:13.641402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9b780750-f4fd-49ee-bd35-7e29baa80e2c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:13.641948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9b780750-f4fd-49ee-bd35-7e29baa80e2c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:13.648355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b780750-f4fd-49ee-bd35-7e29baa80e2c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:13.649433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b780750-f4fd-49ee-bd35-7e29baa80e2c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:13.650201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b780750-f4fd-49ee-bd35-7e29baa80e2c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:13.650637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b780750-f4fd-49ee-bd35-7e29baa80e2c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:13.777624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9b780750-f4fd-49ee-bd35-7e29baa80e2c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:13.784996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9b780750-f4fd-49ee-bd35-7e29baa80e2c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147495 May 12 06:57:13.785566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 362/723] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:13 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:14.432646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-493524fb-8811-4280-a483-977e912a3abc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:14.433530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-493524fb-8811-4280-a483-977e912a3abc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:14.439799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-493524fb-8811-4280-a483-977e912a3abc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:14.440250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-493524fb-8811-4280-a483-977e912a3abc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:14.441026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-493524fb-8811-4280-a483-977e912a3abc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:14.441466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-493524fb-8811-4280-a483-977e912a3abc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:14.470414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-493524fb-8811-4280-a483-977e912a3abc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042350 May 12 06:57:14.470971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 362/724] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:14 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:14.801779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-14cfeec9-ffd8-4344-a2fa-39e5a6a6db0c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:14.802387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-14cfeec9-ffd8-4344-a2fa-39e5a6a6db0c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:14.809263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14cfeec9-ffd8-4344-a2fa-39e5a6a6db0c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:14.809705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14cfeec9-ffd8-4344-a2fa-39e5a6a6db0c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:14.810466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14cfeec9-ffd8-4344-a2fa-39e5a6a6db0c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:14.810900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14cfeec9-ffd8-4344-a2fa-39e5a6a6db0c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:14.938507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-14cfeec9-ffd8-4344-a2fa-39e5a6a6db0c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:14.945925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-14cfeec9-ffd8-4344-a2fa-39e5a6a6db0c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148037 May 12 06:57:14.946492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 363/725] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:14 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:15.482794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0e4654be-6901-404c-b542-0f8cbdeaba11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:15.483735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0e4654be-6901-404c-b542-0f8cbdeaba11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:15.490104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e4654be-6901-404c-b542-0f8cbdeaba11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:15.490553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e4654be-6901-404c-b542-0f8cbdeaba11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:15.491318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e4654be-6901-404c-b542-0f8cbdeaba11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:15.491776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e4654be-6901-404c-b542-0f8cbdeaba11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:15.519708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0e4654be-6901-404c-b542-0f8cbdeaba11 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040878 May 12 06:57:15.520274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 363/726] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:15.962329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cfa0b9f8-5114-44b0-9de2-7f2aa9482280 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:15.963005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cfa0b9f8-5114-44b0-9de2-7f2aa9482280 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:15.969297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfa0b9f8-5114-44b0-9de2-7f2aa9482280 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:15.969743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfa0b9f8-5114-44b0-9de2-7f2aa9482280 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:15.970512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfa0b9f8-5114-44b0-9de2-7f2aa9482280 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:15.970980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cfa0b9f8-5114-44b0-9de2-7f2aa9482280 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:16.101164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cfa0b9f8-5114-44b0-9de2-7f2aa9482280 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:16.108571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cfa0b9f8-5114-44b0-9de2-7f2aa9482280 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150121 May 12 06:57:16.109133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 364/727] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:15 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:16.532174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a4015a32-3ccf-4f81-be97-49cb7a3760ad tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:16.533079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a4015a32-3ccf-4f81-be97-49cb7a3760ad tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:16.539870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4015a32-3ccf-4f81-be97-49cb7a3760ad tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:16.540316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4015a32-3ccf-4f81-be97-49cb7a3760ad tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:16.541182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4015a32-3ccf-4f81-be97-49cb7a3760ad tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:16.541742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4015a32-3ccf-4f81-be97-49cb7a3760ad tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:16.570060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a4015a32-3ccf-4f81-be97-49cb7a3760ad tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041808 May 12 06:57:16.570659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 364/728] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:17.131675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-33a01601-8501-4d34-acfc-ddf285500fcc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:17.132308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-33a01601-8501-4d34-acfc-ddf285500fcc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:17.138663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-33a01601-8501-4d34-acfc-ddf285500fcc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:17.139148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-33a01601-8501-4d34-acfc-ddf285500fcc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:17.139988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-33a01601-8501-4d34-acfc-ddf285500fcc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:17.140424 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-33a01601-8501-4d34-acfc-ddf285500fcc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:17.268738 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-33a01601-8501-4d34-acfc-ddf285500fcc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:17.275945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-33a01601-8501-4d34-acfc-ddf285500fcc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148148 May 12 06:57:17.276515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 365/729] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:17 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:17.581985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-65c3739d-ca74-4b04-8f22-79cfb27dc7b5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:17.582824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-65c3739d-ca74-4b04-8f22-79cfb27dc7b5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:17.589660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65c3739d-ca74-4b04-8f22-79cfb27dc7b5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:17.590112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65c3739d-ca74-4b04-8f22-79cfb27dc7b5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:17.590883 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65c3739d-ca74-4b04-8f22-79cfb27dc7b5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:17.591319 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65c3739d-ca74-4b04-8f22-79cfb27dc7b5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:17.620456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-65c3739d-ca74-4b04-8f22-79cfb27dc7b5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042602 May 12 06:57:17.625312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 365/730] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:17 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:18.293051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-433a96a9-420a-480f-93f9-592cbfd8f752 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:18.293565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-433a96a9-420a-480f-93f9-592cbfd8f752 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:18.300210 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-433a96a9-420a-480f-93f9-592cbfd8f752 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:18.300656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-433a96a9-420a-480f-93f9-592cbfd8f752 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:18.301425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-433a96a9-420a-480f-93f9-592cbfd8f752 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:18.301862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-433a96a9-420a-480f-93f9-592cbfd8f752 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:18.431574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-433a96a9-420a-480f-93f9-592cbfd8f752 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:18.438920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-433a96a9-420a-480f-93f9-592cbfd8f752 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149960 May 12 06:57:18.439481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 366/731] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:18 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:18.631423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b2e71d99-0c8f-445a-bf10-d5eeae193531 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:18.632370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b2e71d99-0c8f-445a-bf10-d5eeae193531 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:18.638603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2e71d99-0c8f-445a-bf10-d5eeae193531 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:18.639050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2e71d99-0c8f-445a-bf10-d5eeae193531 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:18.639868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2e71d99-0c8f-445a-bf10-d5eeae193531 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:18.640297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2e71d99-0c8f-445a-bf10-d5eeae193531 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:18.668442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b2e71d99-0c8f-445a-bf10-d5eeae193531 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040983 May 12 06:57:18.668983 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 366/732] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:19.456583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-38d2140f-8c3b-41c3-af42-4376679b0455 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:19.457127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-38d2140f-8c3b-41c3-af42-4376679b0455 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:19.463379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38d2140f-8c3b-41c3-af42-4376679b0455 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:19.463867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38d2140f-8c3b-41c3-af42-4376679b0455 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:19.464633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38d2140f-8c3b-41c3-af42-4376679b0455 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:19.465069 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38d2140f-8c3b-41c3-af42-4376679b0455 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:19.590506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-38d2140f-8c3b-41c3-af42-4376679b0455 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:19.597884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-38d2140f-8c3b-41c3-af42-4376679b0455 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145260 May 12 06:57:19.598457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 367/733] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:19 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:19.680731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-710001c5-2321-4b72-a074-ed8016631c22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:19.681694 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-710001c5-2321-4b72-a074-ed8016631c22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:19.687945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-710001c5-2321-4b72-a074-ed8016631c22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:19.688392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-710001c5-2321-4b72-a074-ed8016631c22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:19.689158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-710001c5-2321-4b72-a074-ed8016631c22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:19.689595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-710001c5-2321-4b72-a074-ed8016631c22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:19.717928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-710001c5-2321-4b72-a074-ed8016631c22 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041638 May 12 06:57:19.718409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 367/734] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:19 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:20.280438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-179c3c32-1cd1-4a2e-bbf9-3d785449803d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:20.280929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-179c3c32-1cd1-4a2e-bbf9-3d785449803d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:20.286672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-179c3c32-1cd1-4a2e-bbf9-3d785449803d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:20.287110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-179c3c32-1cd1-4a2e-bbf9-3d785449803d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:20.287954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-179c3c32-1cd1-4a2e-bbf9-3d785449803d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:20.288392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-179c3c32-1cd1-4a2e-bbf9-3d785449803d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:20.311593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-179c3c32-1cd1-4a2e-bbf9-3d785449803d tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1/ips" status: 200 len: 149 microversion: 2.1 time: 0.088583 May 12 06:57:20.312159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 368/735] 10.222.0.25 () {58 vars in 1247 bytes} [Thu May 12 06:57:20 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1/ips => generated 149 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:57:20.615170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-65c5c6f9-ced4-4f7b-af75-b99e6d41dfbd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:20.616115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-65c5c6f9-ced4-4f7b-af75-b99e6d41dfbd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:20.621587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65c5c6f9-ced4-4f7b-af75-b99e6d41dfbd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:20.622033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65c5c6f9-ced4-4f7b-af75-b99e6d41dfbd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:20.622824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65c5c6f9-ced4-4f7b-af75-b99e6d41dfbd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:20.623262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65c5c6f9-ced4-4f7b-af75-b99e6d41dfbd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:20.729903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8e13ca81-771b-4a8c-bf27-fe36e2f63d67 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:20.730863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8e13ca81-771b-4a8c-bf27-fe36e2f63d67 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:20.737439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e13ca81-771b-4a8c-bf27-fe36e2f63d67 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:20.737887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e13ca81-771b-4a8c-bf27-fe36e2f63d67 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:20.738657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e13ca81-771b-4a8c-bf27-fe36e2f63d67 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:20.739085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e13ca81-771b-4a8c-bf27-fe36e2f63d67 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:20.750517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-65c5c6f9-ced4-4f7b-af75-b99e6d41dfbd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:20.758353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-65c5c6f9-ced4-4f7b-af75-b99e6d41dfbd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146583 May 12 06:57:20.758904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 368/736] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:20 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:20.771223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8e13ca81-771b-4a8c-bf27-fe36e2f63d67 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045758 May 12 06:57:20.771793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 369/737] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:57:21.775871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ac79df60-a33e-489e-9e5c-df6ed3b4a92c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:21.776488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ac79df60-a33e-489e-9e5c-df6ed3b4a92c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:21.782482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8d165a28-d98c-450f-8fa8-6b074c1e6ddb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:21.782953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ac79df60-a33e-489e-9e5c-df6ed3b4a92c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:21.783324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ac79df60-a33e-489e-9e5c-df6ed3b4a92c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:21.783438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8d165a28-d98c-450f-8fa8-6b074c1e6ddb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:21.784125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ac79df60-a33e-489e-9e5c-df6ed3b4a92c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:21.784563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ac79df60-a33e-489e-9e5c-df6ed3b4a92c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:21.789134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d165a28-d98c-450f-8fa8-6b074c1e6ddb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:21.789585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d165a28-d98c-450f-8fa8-6b074c1e6ddb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:21.790357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d165a28-d98c-450f-8fa8-6b074c1e6ddb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:21.790792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d165a28-d98c-450f-8fa8-6b074c1e6ddb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:21.819288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8d165a28-d98c-450f-8fa8-6b074c1e6ddb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040891 May 12 06:57:21.819895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 370/738] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:57:21.914314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ac79df60-a33e-489e-9e5c-df6ed3b4a92c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:21.921829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ac79df60-a33e-489e-9e5c-df6ed3b4a92c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150459 May 12 06:57:21.922391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 369/739] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:21 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:22.831529 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-da373f4e-bdc5-44c2-95fe-99da782dce1e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:22.832471 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-da373f4e-bdc5-44c2-95fe-99da782dce1e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:22.839203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da373f4e-bdc5-44c2-95fe-99da782dce1e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:22.839653 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da373f4e-bdc5-44c2-95fe-99da782dce1e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:22.840446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da373f4e-bdc5-44c2-95fe-99da782dce1e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:22.840882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da373f4e-bdc5-44c2-95fe-99da782dce1e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:22.869203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-da373f4e-bdc5-44c2-95fe-99da782dce1e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041593 May 12 06:57:22.869690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 371/740] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:22 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:22.938412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-42dd083f-09c1-4d23-a203-e606d6641217 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:22.939023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-42dd083f-09c1-4d23-a203-e606d6641217 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:22.945399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42dd083f-09c1-4d23-a203-e606d6641217 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:22.945849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42dd083f-09c1-4d23-a203-e606d6641217 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:22.946609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42dd083f-09c1-4d23-a203-e606d6641217 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:22.947043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42dd083f-09c1-4d23-a203-e606d6641217 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:23.075123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-42dd083f-09c1-4d23-a203-e606d6641217 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:23.082650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-42dd083f-09c1-4d23-a203-e606d6641217 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147853 May 12 06:57:23.083167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 370/741] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:22 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:57:23.880875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-42f307f3-4c54-4fcb-a573-1d687e2cfe15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:23.881782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-42f307f3-4c54-4fcb-a573-1d687e2cfe15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:23.888042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42f307f3-4c54-4fcb-a573-1d687e2cfe15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:23.888498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42f307f3-4c54-4fcb-a573-1d687e2cfe15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:23.889265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42f307f3-4c54-4fcb-a573-1d687e2cfe15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:23.889703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42f307f3-4c54-4fcb-a573-1d687e2cfe15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:23.917891 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-42f307f3-4c54-4fcb-a573-1d687e2cfe15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041015 May 12 06:57:23.918468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 372/742] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:23 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:24.099589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-42026c84-8a0f-49bc-a63d-eaaf36fbfb25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:24.100263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-42026c84-8a0f-49bc-a63d-eaaf36fbfb25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:24.107077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42026c84-8a0f-49bc-a63d-eaaf36fbfb25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:24.107520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42026c84-8a0f-49bc-a63d-eaaf36fbfb25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:24.108314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42026c84-8a0f-49bc-a63d-eaaf36fbfb25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:24.108743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42026c84-8a0f-49bc-a63d-eaaf36fbfb25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:24.238168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-42026c84-8a0f-49bc-a63d-eaaf36fbfb25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:24.245419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-42026c84-8a0f-49bc-a63d-eaaf36fbfb25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149603 May 12 06:57:24.245982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 371/743] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:24 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:24.930448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f1264d14-ec07-4f13-980a-0bb680b31ee1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:24.931317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f1264d14-ec07-4f13-980a-0bb680b31ee1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:24.937826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f1264d14-ec07-4f13-980a-0bb680b31ee1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:24.938261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f1264d14-ec07-4f13-980a-0bb680b31ee1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:24.939027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f1264d14-ec07-4f13-980a-0bb680b31ee1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:24.939468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f1264d14-ec07-4f13-980a-0bb680b31ee1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:24.968720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f1264d14-ec07-4f13-980a-0bb680b31ee1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042835 May 12 06:57:24.969282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 373/744] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:24 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:25.262669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d143d623-cb1d-43b5-bbbb-a2752bd4cde5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:25.263289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d143d623-cb1d-43b5-bbbb-a2752bd4cde5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:25.269624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d143d623-cb1d-43b5-bbbb-a2752bd4cde5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:25.270078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d143d623-cb1d-43b5-bbbb-a2752bd4cde5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:25.270839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d143d623-cb1d-43b5-bbbb-a2752bd4cde5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:25.271276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d143d623-cb1d-43b5-bbbb-a2752bd4cde5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:25.395922 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d143d623-cb1d-43b5-bbbb-a2752bd4cde5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:25.403361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d143d623-cb1d-43b5-bbbb-a2752bd4cde5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.144538 May 12 06:57:25.403977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 372/745] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:25 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:25.981014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ef7f8e04-e4da-4398-812a-fdc5d73e05f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:25.981932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ef7f8e04-e4da-4398-812a-fdc5d73e05f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:25.988581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef7f8e04-e4da-4398-812a-fdc5d73e05f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:25.989030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef7f8e04-e4da-4398-812a-fdc5d73e05f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:25.989807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef7f8e04-e4da-4398-812a-fdc5d73e05f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:25.990243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef7f8e04-e4da-4398-812a-fdc5d73e05f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:26.018945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ef7f8e04-e4da-4398-812a-fdc5d73e05f9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042661 May 12 06:57:26.019500 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 374/746] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:25 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:26.420167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c135ff34-d345-4459-b20f-b09db017f46a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:26.421039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c135ff34-d345-4459-b20f-b09db017f46a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:26.427265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c135ff34-d345-4459-b20f-b09db017f46a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:26.427732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c135ff34-d345-4459-b20f-b09db017f46a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:26.428496 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c135ff34-d345-4459-b20f-b09db017f46a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:26.428928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c135ff34-d345-4459-b20f-b09db017f46a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:26.562491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c135ff34-d345-4459-b20f-b09db017f46a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:26.569821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c135ff34-d345-4459-b20f-b09db017f46a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.153521 May 12 06:57:26.571038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 373/747] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:26 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:27.030571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e8a7cd0a-5434-4ea5-8a95-d7eaa4a4e41e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:27.031520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e8a7cd0a-5434-4ea5-8a95-d7eaa4a4e41e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:27.037839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8a7cd0a-5434-4ea5-8a95-d7eaa4a4e41e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:27.038292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8a7cd0a-5434-4ea5-8a95-d7eaa4a4e41e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:27.039591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8a7cd0a-5434-4ea5-8a95-d7eaa4a4e41e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:27.040046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8a7cd0a-5434-4ea5-8a95-d7eaa4a4e41e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:27.069169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e8a7cd0a-5434-4ea5-8a95-d7eaa4a4e41e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042581 May 12 06:57:27.069747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 375/748] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:27 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:27.586582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a61bdd92-392a-4523-88d2-87f7ce6819b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:27.587192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a61bdd92-392a-4523-88d2-87f7ce6819b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:27.593518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a61bdd92-392a-4523-88d2-87f7ce6819b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:27.593973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a61bdd92-392a-4523-88d2-87f7ce6819b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:27.594711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a61bdd92-392a-4523-88d2-87f7ce6819b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:27.595142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a61bdd92-392a-4523-88d2-87f7ce6819b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:27.724289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a61bdd92-392a-4523-88d2-87f7ce6819b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:27.732070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a61bdd92-392a-4523-88d2-87f7ce6819b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149318 May 12 06:57:27.732640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 374/749] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:27 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:28.080298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9b88538b-7ef7-484f-9ddc-986ee85e0c54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:28.081221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9b88538b-7ef7-484f-9ddc-986ee85e0c54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:28.088113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b88538b-7ef7-484f-9ddc-986ee85e0c54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:28.088565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b88538b-7ef7-484f-9ddc-986ee85e0c54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:28.089993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b88538b-7ef7-484f-9ddc-986ee85e0c54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:28.090825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b88538b-7ef7-484f-9ddc-986ee85e0c54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:28.123881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9b88538b-7ef7-484f-9ddc-986ee85e0c54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047519 May 12 06:57:28.127908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 376/750] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:28 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:28.749233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0042a1ac-dd32-4c97-820a-bc40d265a3df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:28.749863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0042a1ac-dd32-4c97-820a-bc40d265a3df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:28.756126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0042a1ac-dd32-4c97-820a-bc40d265a3df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:28.756571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0042a1ac-dd32-4c97-820a-bc40d265a3df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:28.757326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0042a1ac-dd32-4c97-820a-bc40d265a3df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:28.757804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0042a1ac-dd32-4c97-820a-bc40d265a3df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:28.883409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0042a1ac-dd32-4c97-820a-bc40d265a3df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:28.890682 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0042a1ac-dd32-4c97-820a-bc40d265a3df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145267 May 12 06:57:28.891244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 375/751] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:28 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:29.136333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aa041e12-7524-49e9-9302-4720bc7d3fc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:29.137237 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-aa041e12-7524-49e9-9302-4720bc7d3fc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:29.143461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa041e12-7524-49e9-9302-4720bc7d3fc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:29.143959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa041e12-7524-49e9-9302-4720bc7d3fc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:29.144722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa041e12-7524-49e9-9302-4720bc7d3fc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:29.145156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa041e12-7524-49e9-9302-4720bc7d3fc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:29.173376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aa041e12-7524-49e9-9302-4720bc7d3fc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041661 May 12 06:57:29.173920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 377/752] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:29 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:29.907633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a82aae97-9ee4-4db1-a765-aa27b34d5da6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:29.908268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a82aae97-9ee4-4db1-a765-aa27b34d5da6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:29.914546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a82aae97-9ee4-4db1-a765-aa27b34d5da6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:29.914993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a82aae97-9ee4-4db1-a765-aa27b34d5da6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:29.915903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a82aae97-9ee4-4db1-a765-aa27b34d5da6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:29.916342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a82aae97-9ee4-4db1-a765-aa27b34d5da6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:30.046269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a82aae97-9ee4-4db1-a765-aa27b34d5da6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:30.053691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a82aae97-9ee4-4db1-a765-aa27b34d5da6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149906 May 12 06:57:30.060332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 376/753] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:29 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:30.185580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-042f2031-e793-4b67-b9e7-a47f7e6c5fee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:30.186437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-042f2031-e793-4b67-b9e7-a47f7e6c5fee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:30.192632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-042f2031-e793-4b67-b9e7-a47f7e6c5fee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:30.193072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-042f2031-e793-4b67-b9e7-a47f7e6c5fee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:30.193879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-042f2031-e793-4b67-b9e7-a47f7e6c5fee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:30.194306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-042f2031-e793-4b67-b9e7-a47f7e6c5fee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:30.223229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-042f2031-e793-4b67-b9e7-a47f7e6c5fee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041760 May 12 06:57:30.223790 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 378/754] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:30 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:31.075436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8c57fb06-59a7-4aba-b836-5fb153369d25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:31.076078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8c57fb06-59a7-4aba-b836-5fb153369d25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:31.082397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c57fb06-59a7-4aba-b836-5fb153369d25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:31.082861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c57fb06-59a7-4aba-b836-5fb153369d25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:31.083623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c57fb06-59a7-4aba-b836-5fb153369d25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:31.084078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c57fb06-59a7-4aba-b836-5fb153369d25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:31.209980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8c57fb06-59a7-4aba-b836-5fb153369d25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:31.217769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8c57fb06-59a7-4aba-b836-5fb153369d25 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146227 May 12 06:57:31.218346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 377/755] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:31 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:31.234340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9adf94a7-cc6c-4702-b63a-9d8c431cf87c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:31.235257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9adf94a7-cc6c-4702-b63a-9d8c431cf87c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:31.241517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9adf94a7-cc6c-4702-b63a-9d8c431cf87c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:31.241973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9adf94a7-cc6c-4702-b63a-9d8c431cf87c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:31.242806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9adf94a7-cc6c-4702-b63a-9d8c431cf87c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:31.243186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9adf94a7-cc6c-4702-b63a-9d8c431cf87c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:31.271378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9adf94a7-cc6c-4702-b63a-9d8c431cf87c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040972 May 12 06:57:31.271954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 379/756] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:31 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:32.234296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-af3ad83c-c2b7-4daf-8e4d-8b209b25d0e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:32.234904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-af3ad83c-c2b7-4daf-8e4d-8b209b25d0e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:32.241223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af3ad83c-c2b7-4daf-8e4d-8b209b25d0e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:32.241697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af3ad83c-c2b7-4daf-8e4d-8b209b25d0e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:32.243114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af3ad83c-c2b7-4daf-8e4d-8b209b25d0e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:32.243494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af3ad83c-c2b7-4daf-8e4d-8b209b25d0e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:32.283411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2106c4e9-a167-4880-99f9-804e54f4dbf1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:32.284352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2106c4e9-a167-4880-99f9-804e54f4dbf1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:32.291045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2106c4e9-a167-4880-99f9-804e54f4dbf1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:32.291482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2106c4e9-a167-4880-99f9-804e54f4dbf1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:32.292287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2106c4e9-a167-4880-99f9-804e54f4dbf1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:32.292733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2106c4e9-a167-4880-99f9-804e54f4dbf1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:32.321930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2106c4e9-a167-4880-99f9-804e54f4dbf1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042319 May 12 06:57:32.322492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 380/757] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:32 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:57:32.374011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-af3ad83c-c2b7-4daf-8e4d-8b209b25d0e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:32.381297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-af3ad83c-c2b7-4daf-8e4d-8b209b25d0e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150869 May 12 06:57:32.381861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 378/758] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:32 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:33.333947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1de64e0d-c28d-49fa-8027-b79d789e52d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:33.334805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1de64e0d-c28d-49fa-8027-b79d789e52d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:33.341072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1de64e0d-c28d-49fa-8027-b79d789e52d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:33.341515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1de64e0d-c28d-49fa-8027-b79d789e52d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:33.342415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1de64e0d-c28d-49fa-8027-b79d789e52d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:33.342849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1de64e0d-c28d-49fa-8027-b79d789e52d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:33.371339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1de64e0d-c28d-49fa-8027-b79d789e52d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041451 May 12 06:57:33.371938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 381/759] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:33 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:33.397331 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2d552c87-bd31-4e8e-8ff5-291659891135 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:33.397945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2d552c87-bd31-4e8e-8ff5-291659891135 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:33.404216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d552c87-bd31-4e8e-8ff5-291659891135 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:33.404668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d552c87-bd31-4e8e-8ff5-291659891135 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:33.405434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d552c87-bd31-4e8e-8ff5-291659891135 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:33.405868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d552c87-bd31-4e8e-8ff5-291659891135 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:33.531213 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2d552c87-bd31-4e8e-8ff5-291659891135 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:33.538458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2d552c87-bd31-4e8e-8ff5-291659891135 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.144904 May 12 06:57:33.539025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 379/760] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:33 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:34.383110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5bf2c14c-8c10-4082-b7d9-1e07cf611d23 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:34.383968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5bf2c14c-8c10-4082-b7d9-1e07cf611d23 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:34.390226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bf2c14c-8c10-4082-b7d9-1e07cf611d23 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:34.390679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bf2c14c-8c10-4082-b7d9-1e07cf611d23 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:34.391444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bf2c14c-8c10-4082-b7d9-1e07cf611d23 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:34.391907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bf2c14c-8c10-4082-b7d9-1e07cf611d23 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:34.420121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5bf2c14c-8c10-4082-b7d9-1e07cf611d23 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041038 May 12 06:57:34.420946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 382/761] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:34 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:57:34.556787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c716ddec-8267-45ad-ad0f-d39397f995dd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:34.557398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c716ddec-8267-45ad-ad0f-d39397f995dd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:34.563819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c716ddec-8267-45ad-ad0f-d39397f995dd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:34.564266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c716ddec-8267-45ad-ad0f-d39397f995dd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:34.565021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c716ddec-8267-45ad-ad0f-d39397f995dd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:34.565451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c716ddec-8267-45ad-ad0f-d39397f995dd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:34.692338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c716ddec-8267-45ad-ad0f-d39397f995dd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:34.699651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c716ddec-8267-45ad-ad0f-d39397f995dd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147429 May 12 06:57:34.700238 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 380/762] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:34 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:35.432626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c9dea85d-b0db-43e1-a5f3-cb7025775131 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:35.433456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c9dea85d-b0db-43e1-a5f3-cb7025775131 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:35.439638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9dea85d-b0db-43e1-a5f3-cb7025775131 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:35.440115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9dea85d-b0db-43e1-a5f3-cb7025775131 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:35.440874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9dea85d-b0db-43e1-a5f3-cb7025775131 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:35.441309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9dea85d-b0db-43e1-a5f3-cb7025775131 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:35.469503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c9dea85d-b0db-43e1-a5f3-cb7025775131 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041533 May 12 06:57:35.470040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 383/763] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:35 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:57:35.716624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-afdd99cf-6116-4987-991a-b3b31c503618 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:35.717161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-afdd99cf-6116-4987-991a-b3b31c503618 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:35.723406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-afdd99cf-6116-4987-991a-b3b31c503618 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:35.723888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-afdd99cf-6116-4987-991a-b3b31c503618 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:35.724655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-afdd99cf-6116-4987-991a-b3b31c503618 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:35.725093 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-afdd99cf-6116-4987-991a-b3b31c503618 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:35.856470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-afdd99cf-6116-4987-991a-b3b31c503618 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:35.863797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-afdd99cf-6116-4987-991a-b3b31c503618 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.151057 May 12 06:57:35.864367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 381/764] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:35 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:36.481777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-da275497-9a83-467f-b0de-59c84ff21ad2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:36.482594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-da275497-9a83-467f-b0de-59c84ff21ad2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:36.488826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da275497-9a83-467f-b0de-59c84ff21ad2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:36.489268 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da275497-9a83-467f-b0de-59c84ff21ad2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:36.490030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da275497-9a83-467f-b0de-59c84ff21ad2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:36.490463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da275497-9a83-467f-b0de-59c84ff21ad2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:36.518286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-da275497-9a83-467f-b0de-59c84ff21ad2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041240 May 12 06:57:36.518820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 384/765] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:36 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:36.880976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-46f30623-9d34-4d57-9922-462eb9022584 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:36.881622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-46f30623-9d34-4d57-9922-462eb9022584 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:36.888459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46f30623-9d34-4d57-9922-462eb9022584 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:36.889522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46f30623-9d34-4d57-9922-462eb9022584 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:36.889668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46f30623-9d34-4d57-9922-462eb9022584 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:36.890103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46f30623-9d34-4d57-9922-462eb9022584 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:37.017317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-46f30623-9d34-4d57-9922-462eb9022584 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:37.024695 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-46f30623-9d34-4d57-9922-462eb9022584 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147529 May 12 06:57:37.025269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 382/766] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:36 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:37.530468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-edda3b57-e1d0-4ac4-870c-5c7e4defefeb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:37.531386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-edda3b57-e1d0-4ac4-870c-5c7e4defefeb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:37.537635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edda3b57-e1d0-4ac4-870c-5c7e4defefeb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:37.538087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edda3b57-e1d0-4ac4-870c-5c7e4defefeb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:37.538853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edda3b57-e1d0-4ac4-870c-5c7e4defefeb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:37.539296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edda3b57-e1d0-4ac4-870c-5c7e4defefeb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:37.567699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-edda3b57-e1d0-4ac4-870c-5c7e4defefeb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041172 May 12 06:57:37.568279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 385/767] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:37 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:38.043877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4f15ce53-b337-43c1-9376-f4573f694a65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:38.044487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4f15ce53-b337-43c1-9376-f4573f694a65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:38.051235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f15ce53-b337-43c1-9376-f4573f694a65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:38.055496 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f15ce53-b337-43c1-9376-f4573f694a65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:38.055496 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f15ce53-b337-43c1-9376-f4573f694a65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:38.055496 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f15ce53-b337-43c1-9376-f4573f694a65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:38.185710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4f15ce53-b337-43c1-9376-f4573f694a65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:38.193947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4f15ce53-b337-43c1-9376-f4573f694a65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.154501 May 12 06:57:38.194547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 383/768] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:38 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:38.580055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9db8c043-4778-488e-bb34-9be2fc016278 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:38.580910 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9db8c043-4778-488e-bb34-9be2fc016278 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:38.587766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9db8c043-4778-488e-bb34-9be2fc016278 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:38.588223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9db8c043-4778-488e-bb34-9be2fc016278 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:38.588999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9db8c043-4778-488e-bb34-9be2fc016278 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:38.589442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9db8c043-4778-488e-bb34-9be2fc016278 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:38.618036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9db8c043-4778-488e-bb34-9be2fc016278 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042055 May 12 06:57:38.618584 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 386/769] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:38 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:39.210464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fb4ac27b-798f-4497-b634-daddcb91a5c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:39.211078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fb4ac27b-798f-4497-b634-daddcb91a5c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:39.217397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fb4ac27b-798f-4497-b634-daddcb91a5c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:39.217849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fb4ac27b-798f-4497-b634-daddcb91a5c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:39.218615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fb4ac27b-798f-4497-b634-daddcb91a5c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:39.219051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fb4ac27b-798f-4497-b634-daddcb91a5c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:39.342812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fb4ac27b-798f-4497-b634-daddcb91a5c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:39.350002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fb4ac27b-798f-4497-b634-daddcb91a5c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.143385 May 12 06:57:39.350571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 384/770] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:39 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:39.629023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-582f24ad-ade4-49d3-9e8f-9550f930801e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:39.629870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-582f24ad-ade4-49d3-9e8f-9550f930801e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:39.636157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-582f24ad-ade4-49d3-9e8f-9550f930801e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:39.636607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-582f24ad-ade4-49d3-9e8f-9550f930801e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:39.637378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-582f24ad-ade4-49d3-9e8f-9550f930801e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:39.637815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-582f24ad-ade4-49d3-9e8f-9550f930801e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:39.666109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-582f24ad-ade4-49d3-9e8f-9550f930801e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041129 May 12 06:57:39.666657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 387/771] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:39 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:40.366401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5ea59f8e-60d9-46af-b9b3-48189ea1e5b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:40.367016 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5ea59f8e-60d9-46af-b9b3-48189ea1e5b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:40.373315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ea59f8e-60d9-46af-b9b3-48189ea1e5b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:40.373763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ea59f8e-60d9-46af-b9b3-48189ea1e5b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:40.374560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ea59f8e-60d9-46af-b9b3-48189ea1e5b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:40.374996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ea59f8e-60d9-46af-b9b3-48189ea1e5b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:40.503662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5ea59f8e-60d9-46af-b9b3-48189ea1e5b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:40.511439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5ea59f8e-60d9-46af-b9b3-48189ea1e5b4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148956 May 12 06:57:40.512034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 385/772] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:40 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:40.677423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-28d58492-779c-48a3-a02c-9e0097ce5987 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:40.678366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-28d58492-779c-48a3-a02c-9e0097ce5987 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:40.685078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28d58492-779c-48a3-a02c-9e0097ce5987 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:40.685573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28d58492-779c-48a3-a02c-9e0097ce5987 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:40.686341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28d58492-779c-48a3-a02c-9e0097ce5987 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:40.686805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28d58492-779c-48a3-a02c-9e0097ce5987 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:40.715169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-28d58492-779c-48a3-a02c-9e0097ce5987 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041779 May 12 06:57:40.715740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 388/773] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:40 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:41.528593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d54d05de-37a5-4ac1-af77-dfd194b68072 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:41.529202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d54d05de-37a5-4ac1-af77-dfd194b68072 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:41.535451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d54d05de-37a5-4ac1-af77-dfd194b68072 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:41.535928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d54d05de-37a5-4ac1-af77-dfd194b68072 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:41.536689 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d54d05de-37a5-4ac1-af77-dfd194b68072 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:41.537125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d54d05de-37a5-4ac1-af77-dfd194b68072 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:41.664738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d54d05de-37a5-4ac1-af77-dfd194b68072 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:41.672264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d54d05de-37a5-4ac1-af77-dfd194b68072 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147462 May 12 06:57:41.672834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 386/774] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:41 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:41.727454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2eae61f8-6bd3-42d4-a60c-f0cb00de3509 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:41.728458 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2eae61f8-6bd3-42d4-a60c-f0cb00de3509 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:41.734965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2eae61f8-6bd3-42d4-a60c-f0cb00de3509 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:41.735417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2eae61f8-6bd3-42d4-a60c-f0cb00de3509 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:41.736255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2eae61f8-6bd3-42d4-a60c-f0cb00de3509 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:41.736679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2eae61f8-6bd3-42d4-a60c-f0cb00de3509 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:41.766121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2eae61f8-6bd3-42d4-a60c-f0cb00de3509 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043231 May 12 06:57:41.770627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 389/775] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:41 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:42.688915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f985ecdf-0ed7-4d49-aa8e-b152dc68f494 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:42.689522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f985ecdf-0ed7-4d49-aa8e-b152dc68f494 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:42.696383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f985ecdf-0ed7-4d49-aa8e-b152dc68f494 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:42.696835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f985ecdf-0ed7-4d49-aa8e-b152dc68f494 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:42.697592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f985ecdf-0ed7-4d49-aa8e-b152dc68f494 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:42.698025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f985ecdf-0ed7-4d49-aa8e-b152dc68f494 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:42.780219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-22a4b490-72b0-4ccd-b0d4-e39a3a064e80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:42.781141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-22a4b490-72b0-4ccd-b0d4-e39a3a064e80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:42.787611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22a4b490-72b0-4ccd-b0d4-e39a3a064e80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:42.788104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22a4b490-72b0-4ccd-b0d4-e39a3a064e80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:42.789005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22a4b490-72b0-4ccd-b0d4-e39a3a064e80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:42.789446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22a4b490-72b0-4ccd-b0d4-e39a3a064e80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:42.818582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-22a4b490-72b0-4ccd-b0d4-e39a3a064e80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042228 May 12 06:57:42.819155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 390/776] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:42 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:57:42.827211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f985ecdf-0ed7-4d49-aa8e-b152dc68f494 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:42.834639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f985ecdf-0ed7-4d49-aa8e-b152dc68f494 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149514 May 12 06:57:42.835201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 387/777] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:42 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:43.830634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c61126dc-d629-43d0-8e87-d8e602faf40d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:43.831548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c61126dc-d629-43d0-8e87-d8e602faf40d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:43.838308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c61126dc-d629-43d0-8e87-d8e602faf40d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:43.838753 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c61126dc-d629-43d0-8e87-d8e602faf40d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:43.839518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c61126dc-d629-43d0-8e87-d8e602faf40d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:43.839979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c61126dc-d629-43d0-8e87-d8e602faf40d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:43.852392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ad51312c-5fd0-4ae6-a6b8-1408461b086b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:43.853067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ad51312c-5fd0-4ae6-a6b8-1408461b086b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:43.859216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad51312c-5fd0-4ae6-a6b8-1408461b086b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:43.859665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad51312c-5fd0-4ae6-a6b8-1408461b086b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:43.860464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad51312c-5fd0-4ae6-a6b8-1408461b086b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:43.860901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad51312c-5fd0-4ae6-a6b8-1408461b086b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:43.868857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c61126dc-d629-43d0-8e87-d8e602faf40d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042138 May 12 06:57:43.869413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 391/778] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:43 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:43.991185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ad51312c-5fd0-4ae6-a6b8-1408461b086b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:43.998595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ad51312c-5fd0-4ae6-a6b8-1408461b086b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150665 May 12 06:57:43.999158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 388/779] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:43 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:57:44.880211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1bc347fc-630b-4e5c-8a7e-4902bb531e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:44.881046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1bc347fc-630b-4e5c-8a7e-4902bb531e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:44.887223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1bc347fc-630b-4e5c-8a7e-4902bb531e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:44.887670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1bc347fc-630b-4e5c-8a7e-4902bb531e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:44.888468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1bc347fc-630b-4e5c-8a7e-4902bb531e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:44.888897 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1bc347fc-630b-4e5c-8a7e-4902bb531e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:44.916967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1bc347fc-630b-4e5c-8a7e-4902bb531e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040842 May 12 06:57:44.917506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 392/780] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:44 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:45.015653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-334443e9-8765-49ab-8433-71b69459ca3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:45.016293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-334443e9-8765-49ab-8433-71b69459ca3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:45.022700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-334443e9-8765-49ab-8433-71b69459ca3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:45.023143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-334443e9-8765-49ab-8433-71b69459ca3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:45.023928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-334443e9-8765-49ab-8433-71b69459ca3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:45.024363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-334443e9-8765-49ab-8433-71b69459ca3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:45.149962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-334443e9-8765-49ab-8433-71b69459ca3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:45.157356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-334443e9-8765-49ab-8433-71b69459ca3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145561 May 12 06:57:45.157918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 389/781] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:45 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:45.928018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-55fc26d0-af28-4a88-88b1-c4972b38a83b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:45.928973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-55fc26d0-af28-4a88-88b1-c4972b38a83b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:45.935797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55fc26d0-af28-4a88-88b1-c4972b38a83b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:45.936255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55fc26d0-af28-4a88-88b1-c4972b38a83b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:45.937031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55fc26d0-af28-4a88-88b1-c4972b38a83b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:45.937475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55fc26d0-af28-4a88-88b1-c4972b38a83b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:45.967946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-55fc26d0-af28-4a88-88b1-c4972b38a83b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043874 May 12 06:57:45.968528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 393/782] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:45 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:46.175054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3a781bcb-b87b-4a42-ab4b-cc7b3a86a304 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:46.175662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3a781bcb-b87b-4a42-ab4b-cc7b3a86a304 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:46.182493 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a781bcb-b87b-4a42-ab4b-cc7b3a86a304 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:46.182883 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a781bcb-b87b-4a42-ab4b-cc7b3a86a304 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:46.183657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a781bcb-b87b-4a42-ab4b-cc7b3a86a304 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:46.184130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a781bcb-b87b-4a42-ab4b-cc7b3a86a304 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:46.314979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3a781bcb-b87b-4a42-ab4b-cc7b3a86a304 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:46.322291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3a781bcb-b87b-4a42-ab4b-cc7b3a86a304 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.151061 May 12 06:57:46.322853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 390/783] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:46 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:46.980663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b0b670d2-70e0-40db-b139-4c72790a6a60 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:46.984541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b0b670d2-70e0-40db-b139-4c72790a6a60 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:46.988709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b0b670d2-70e0-40db-b139-4c72790a6a60 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:46.989156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b0b670d2-70e0-40db-b139-4c72790a6a60 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:46.990558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b0b670d2-70e0-40db-b139-4c72790a6a60 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:46.991043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b0b670d2-70e0-40db-b139-4c72790a6a60 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:47.021238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b0b670d2-70e0-40db-b139-4c72790a6a60 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045160 May 12 06:57:47.021714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 394/784] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:46 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:47.338621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0d594847-e4c9-477c-910f-91ef0f18e2d6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:47.339268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0d594847-e4c9-477c-910f-91ef0f18e2d6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:47.345667 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d594847-e4c9-477c-910f-91ef0f18e2d6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:47.346117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d594847-e4c9-477c-910f-91ef0f18e2d6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:47.346890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d594847-e4c9-477c-910f-91ef0f18e2d6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:47.347329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d594847-e4c9-477c-910f-91ef0f18e2d6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:47.476043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0d594847-e4c9-477c-910f-91ef0f18e2d6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:47.483454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0d594847-e4c9-477c-910f-91ef0f18e2d6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149182 May 12 06:57:47.484053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 391/785] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:47 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:48.033474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-99bacbdd-db98-411f-8d5e-b26e0f939b6d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:48.034392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-99bacbdd-db98-411f-8d5e-b26e0f939b6d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:48.041070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99bacbdd-db98-411f-8d5e-b26e0f939b6d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:48.041512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99bacbdd-db98-411f-8d5e-b26e0f939b6d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:48.042277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99bacbdd-db98-411f-8d5e-b26e0f939b6d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:48.043400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99bacbdd-db98-411f-8d5e-b26e0f939b6d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:48.074105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-99bacbdd-db98-411f-8d5e-b26e0f939b6d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044535 May 12 06:57:48.074667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 395/786] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:48 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:48.500361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9cc67336-db19-4d70-9153-0f2f5fdd8d68 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:48.500972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9cc67336-db19-4d70-9153-0f2f5fdd8d68 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:48.507203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cc67336-db19-4d70-9153-0f2f5fdd8d68 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:48.508182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cc67336-db19-4d70-9153-0f2f5fdd8d68 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:48.508944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cc67336-db19-4d70-9153-0f2f5fdd8d68 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:48.509384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cc67336-db19-4d70-9153-0f2f5fdd8d68 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:48.634874 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9cc67336-db19-4d70-9153-0f2f5fdd8d68 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:48.642287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9cc67336-db19-4d70-9153-0f2f5fdd8d68 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145752 May 12 06:57:48.642855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 392/787] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:48 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:49.086226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-16638a5c-ec87-4a22-82ad-72846a900652 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:49.087154 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-16638a5c-ec87-4a22-82ad-72846a900652 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:49.093585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16638a5c-ec87-4a22-82ad-72846a900652 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:49.094048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16638a5c-ec87-4a22-82ad-72846a900652 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:49.094824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16638a5c-ec87-4a22-82ad-72846a900652 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:49.095264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16638a5c-ec87-4a22-82ad-72846a900652 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:49.123757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-16638a5c-ec87-4a22-82ad-72846a900652 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041601 May 12 06:57:49.124313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 396/788] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:49 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:49.659654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ccb2f75a-1a1c-4e61-838c-49adb0682baf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:49.660285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ccb2f75a-1a1c-4e61-838c-49adb0682baf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:49.667038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ccb2f75a-1a1c-4e61-838c-49adb0682baf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:49.667479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ccb2f75a-1a1c-4e61-838c-49adb0682baf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:49.668265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ccb2f75a-1a1c-4e61-838c-49adb0682baf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:49.668700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ccb2f75a-1a1c-4e61-838c-49adb0682baf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:49.798951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ccb2f75a-1a1c-4e61-838c-49adb0682baf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:49.806814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ccb2f75a-1a1c-4e61-838c-49adb0682baf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.151032 May 12 06:57:49.807374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 393/789] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:49 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:50.136121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4c127ec4-b35a-4eb5-8ff5-bc7e7e1c6c44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:50.137031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4c127ec4-b35a-4eb5-8ff5-bc7e7e1c6c44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:50.143330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c127ec4-b35a-4eb5-8ff5-bc7e7e1c6c44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:50.143806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c127ec4-b35a-4eb5-8ff5-bc7e7e1c6c44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:50.144578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c127ec4-b35a-4eb5-8ff5-bc7e7e1c6c44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:50.145042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c127ec4-b35a-4eb5-8ff5-bc7e7e1c6c44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:50.174624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4c127ec4-b35a-4eb5-8ff5-bc7e7e1c6c44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042404 May 12 06:57:50.175182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 397/790] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:50 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:50.824264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d8d8dcce-0b19-46d4-912d-8e8af72e7717 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:50.824882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d8d8dcce-0b19-46d4-912d-8e8af72e7717 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:50.831243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d8d8dcce-0b19-46d4-912d-8e8af72e7717 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:50.831712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d8d8dcce-0b19-46d4-912d-8e8af72e7717 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:50.832492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d8d8dcce-0b19-46d4-912d-8e8af72e7717 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:50.832928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d8d8dcce-0b19-46d4-912d-8e8af72e7717 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:50.964761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d8d8dcce-0b19-46d4-912d-8e8af72e7717 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:50.972158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d8d8dcce-0b19-46d4-912d-8e8af72e7717 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.152394 May 12 06:57:50.972729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 394/791] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:50 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:51.187276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7bd68ab1-dcd7-4168-88f9-f176f76a0fd2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:51.188133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7bd68ab1-dcd7-4168-88f9-f176f76a0fd2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:51.194405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bd68ab1-dcd7-4168-88f9-f176f76a0fd2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:51.194853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bd68ab1-dcd7-4168-88f9-f176f76a0fd2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:51.195633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bd68ab1-dcd7-4168-88f9-f176f76a0fd2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:51.196089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bd68ab1-dcd7-4168-88f9-f176f76a0fd2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:51.224255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7bd68ab1-dcd7-4168-88f9-f176f76a0fd2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041159 May 12 06:57:51.224832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 398/792] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:51 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:51.988743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c64901bd-cf2b-426e-b53b-7ba17dad7949 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:51.989359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c64901bd-cf2b-426e-b53b-7ba17dad7949 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:51.995583 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c64901bd-cf2b-426e-b53b-7ba17dad7949 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:51.996054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c64901bd-cf2b-426e-b53b-7ba17dad7949 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:51.996847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c64901bd-cf2b-426e-b53b-7ba17dad7949 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:51.997279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c64901bd-cf2b-426e-b53b-7ba17dad7949 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:52.126780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c64901bd-cf2b-426e-b53b-7ba17dad7949 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:52.134532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c64901bd-cf2b-426e-b53b-7ba17dad7949 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149616 May 12 06:57:52.135110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 395/793] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:51 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:52.236462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-11bc5fdc-31b9-42d7-a634-ed242001277a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:52.237370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-11bc5fdc-31b9-42d7-a634-ed242001277a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:52.243446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11bc5fdc-31b9-42d7-a634-ed242001277a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:52.243928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11bc5fdc-31b9-42d7-a634-ed242001277a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:52.244696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11bc5fdc-31b9-42d7-a634-ed242001277a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:52.245139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11bc5fdc-31b9-42d7-a634-ed242001277a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:52.273150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-11bc5fdc-31b9-42d7-a634-ed242001277a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040623 May 12 06:57:52.274388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 399/794] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:52 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:53.152029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ebc093cc-d1f2-4153-b22d-aeb83e70b73c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:53.152646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ebc093cc-d1f2-4153-b22d-aeb83e70b73c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:53.158961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebc093cc-d1f2-4153-b22d-aeb83e70b73c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:53.159405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebc093cc-d1f2-4153-b22d-aeb83e70b73c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:53.160214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebc093cc-d1f2-4153-b22d-aeb83e70b73c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:53.160652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebc093cc-d1f2-4153-b22d-aeb83e70b73c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:53.285043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ebc093cc-d1f2-4153-b22d-aeb83e70b73c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:53.285207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c7f95baf-2783-417e-aa88-1988e4fc4bc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:53.286130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c7f95baf-2783-417e-aa88-1988e4fc4bc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:53.293016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7f95baf-2783-417e-aa88-1988e4fc4bc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:53.293292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ebc093cc-d1f2-4153-b22d-aeb83e70b73c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145620 May 12 06:57:53.293471 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7f95baf-2783-417e-aa88-1988e4fc4bc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:53.293871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 396/795] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:53 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:53.294259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7f95baf-2783-417e-aa88-1988e4fc4bc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:53.294702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7f95baf-2783-417e-aa88-1988e4fc4bc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:53.323119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c7f95baf-2783-417e-aa88-1988e4fc4bc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042010 May 12 06:57:53.323670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 400/796] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:53 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:57:54.310541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-434974c6-3d1d-43a5-8177-03f255b0e919 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:54.311080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-434974c6-3d1d-43a5-8177-03f255b0e919 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:54.317360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434974c6-3d1d-43a5-8177-03f255b0e919 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:54.317809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434974c6-3d1d-43a5-8177-03f255b0e919 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:54.318576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434974c6-3d1d-43a5-8177-03f255b0e919 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:54.319012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434974c6-3d1d-43a5-8177-03f255b0e919 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:54.334393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a53fd944-d596-4227-b324-583556dca24b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:54.335308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a53fd944-d596-4227-b324-583556dca24b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:54.342159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a53fd944-d596-4227-b324-583556dca24b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:54.342611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a53fd944-d596-4227-b324-583556dca24b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:54.343387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a53fd944-d596-4227-b324-583556dca24b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:54.343861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a53fd944-d596-4227-b324-583556dca24b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:54.372274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a53fd944-d596-4227-b324-583556dca24b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041741 May 12 06:57:54.372846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 401/797] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:54 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:57:54.449566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-434974c6-3d1d-43a5-8177-03f255b0e919 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:54.456840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-434974c6-3d1d-43a5-8177-03f255b0e919 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150215 May 12 06:57:54.457432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 397/798] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:54 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:55.384102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-608e1379-207b-4990-bdc8-37f2efe111c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:55.384941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-608e1379-207b-4990-bdc8-37f2efe111c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:55.391161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-608e1379-207b-4990-bdc8-37f2efe111c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:55.391608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-608e1379-207b-4990-bdc8-37f2efe111c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:55.392407 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-608e1379-207b-4990-bdc8-37f2efe111c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:55.392845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-608e1379-207b-4990-bdc8-37f2efe111c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:55.421914 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-608e1379-207b-4990-bdc8-37f2efe111c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041940 May 12 06:57:55.422460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 402/799] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:55 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:55.474456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-257537fc-6451-4766-b570-c18d304be8ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:55.475071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-257537fc-6451-4766-b570-c18d304be8ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:55.481961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-257537fc-6451-4766-b570-c18d304be8ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:55.482411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-257537fc-6451-4766-b570-c18d304be8ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:55.483175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-257537fc-6451-4766-b570-c18d304be8ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:55.483611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-257537fc-6451-4766-b570-c18d304be8ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:55.608744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-257537fc-6451-4766-b570-c18d304be8ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:55.615953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-257537fc-6451-4766-b570-c18d304be8ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145358 May 12 06:57:55.616519 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 398/800] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:55 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:56.433752 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fb17bf97-0e7c-4739-9968-83cb87f8283c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:56.434592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fb17bf97-0e7c-4739-9968-83cb87f8283c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:56.440870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb17bf97-0e7c-4739-9968-83cb87f8283c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:56.441321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb17bf97-0e7c-4739-9968-83cb87f8283c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:56.442091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb17bf97-0e7c-4739-9968-83cb87f8283c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:56.442530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb17bf97-0e7c-4739-9968-83cb87f8283c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:56.471313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fb17bf97-0e7c-4739-9968-83cb87f8283c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041741 May 12 06:57:56.471890 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 403/801] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:56 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:56.632397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fd4ab021-47a7-4b2a-b0f2-778b7e8075ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:56.633612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fd4ab021-47a7-4b2a-b0f2-778b7e8075ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:56.640002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fd4ab021-47a7-4b2a-b0f2-778b7e8075ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:56.640459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fd4ab021-47a7-4b2a-b0f2-778b7e8075ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:56.641231 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fd4ab021-47a7-4b2a-b0f2-778b7e8075ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:56.641671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fd4ab021-47a7-4b2a-b0f2-778b7e8075ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:56.771457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fd4ab021-47a7-4b2a-b0f2-778b7e8075ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:56.779360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fd4ab021-47a7-4b2a-b0f2-778b7e8075ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150800 May 12 06:57:56.779949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 399/802] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:56 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:57.483184 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-88e8bb7a-e4c8-4af2-8c4c-629dee9006d9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:57.484073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-88e8bb7a-e4c8-4af2-8c4c-629dee9006d9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:57.490320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88e8bb7a-e4c8-4af2-8c4c-629dee9006d9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:57.490772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88e8bb7a-e4c8-4af2-8c4c-629dee9006d9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:57.491544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88e8bb7a-e4c8-4af2-8c4c-629dee9006d9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:57.492010 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88e8bb7a-e4c8-4af2-8c4c-629dee9006d9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:57.520244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-88e8bb7a-e4c8-4af2-8c4c-629dee9006d9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041196 May 12 06:57:57.520790 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 404/803] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:57 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:57.796494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b06081d2-57ff-46ec-9ea9-50d2ee065fd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:57.797112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b06081d2-57ff-46ec-9ea9-50d2ee065fd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:57.803408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b06081d2-57ff-46ec-9ea9-50d2ee065fd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:57.803865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b06081d2-57ff-46ec-9ea9-50d2ee065fd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:57.805127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b06081d2-57ff-46ec-9ea9-50d2ee065fd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:57.805563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b06081d2-57ff-46ec-9ea9-50d2ee065fd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:57.933203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b06081d2-57ff-46ec-9ea9-50d2ee065fd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:57.940603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b06081d2-57ff-46ec-9ea9-50d2ee065fd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148184 May 12 06:57:57.941178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 400/804] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:57 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:58.532242 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-96f62b4e-9047-4fd8-865f-5b33eb1772b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:58.533156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-96f62b4e-9047-4fd8-865f-5b33eb1772b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:58.539375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-96f62b4e-9047-4fd8-865f-5b33eb1772b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:58.540405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-96f62b4e-9047-4fd8-865f-5b33eb1772b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:58.541173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-96f62b4e-9047-4fd8-865f-5b33eb1772b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:58.541607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-96f62b4e-9047-4fd8-865f-5b33eb1772b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:58.569933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-96f62b4e-9047-4fd8-865f-5b33eb1772b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041638 May 12 06:57:58.570470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 405/805] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:58 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:57:58.957691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4a1099e4-5b57-4153-bd92-6988eda6121d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:58.958220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4a1099e4-5b57-4153-bd92-6988eda6121d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:58.965113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a1099e4-5b57-4153-bd92-6988eda6121d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:58.965580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a1099e4-5b57-4153-bd92-6988eda6121d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:58.966337 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a1099e4-5b57-4153-bd92-6988eda6121d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:58.966775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a1099e4-5b57-4153-bd92-6988eda6121d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:59.093234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4a1099e4-5b57-4153-bd92-6988eda6121d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:57:59.100812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4a1099e4-5b57-4153-bd92-6988eda6121d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147093 May 12 06:57:59.101397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 401/806] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:57:58 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:57:59.581562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-144a2cd6-3a53-4b5a-984f-2b5d41f996b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:57:59.582485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-144a2cd6-3a53-4b5a-984f-2b5d41f996b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:57:59.589591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-144a2cd6-3a53-4b5a-984f-2b5d41f996b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:59.590040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-144a2cd6-3a53-4b5a-984f-2b5d41f996b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:59.590806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-144a2cd6-3a53-4b5a-984f-2b5d41f996b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:57:59.591241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-144a2cd6-3a53-4b5a-984f-2b5d41f996b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:57:59.618717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-144a2cd6-3a53-4b5a-984f-2b5d41f996b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041190 May 12 06:57:59.619278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 406/807] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:57:59 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:00.117683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5725f14c-d319-4285-8913-534dbe1cccc0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:00.118299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5725f14c-d319-4285-8913-534dbe1cccc0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:00.125260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5725f14c-d319-4285-8913-534dbe1cccc0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:00.125718 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5725f14c-d319-4285-8913-534dbe1cccc0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:00.126481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5725f14c-d319-4285-8913-534dbe1cccc0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:00.126912 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5725f14c-d319-4285-8913-534dbe1cccc0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:00.257518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5725f14c-d319-4285-8913-534dbe1cccc0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:00.264853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5725f14c-d319-4285-8913-534dbe1cccc0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.151017 May 12 06:58:00.265417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 402/808] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:00 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:00.630297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dcb5cbf0-a4a8-4a99-a68b-afd977df676c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:00.631141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dcb5cbf0-a4a8-4a99-a68b-afd977df676c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:00.637446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dcb5cbf0-a4a8-4a99-a68b-afd977df676c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:00.637893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dcb5cbf0-a4a8-4a99-a68b-afd977df676c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:00.638662 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dcb5cbf0-a4a8-4a99-a68b-afd977df676c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:00.639103 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dcb5cbf0-a4a8-4a99-a68b-afd977df676c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:00.667922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dcb5cbf0-a4a8-4a99-a68b-afd977df676c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040955 May 12 06:58:00.668466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 407/809] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:00 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:01.281776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-92d41752-431d-4f40-991b-5fed332c70dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:01.282414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-92d41752-431d-4f40-991b-5fed332c70dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:01.288338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92d41752-431d-4f40-991b-5fed332c70dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:01.288784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92d41752-431d-4f40-991b-5fed332c70dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:01.289560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92d41752-431d-4f40-991b-5fed332c70dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:01.289995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92d41752-431d-4f40-991b-5fed332c70dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:01.414945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-92d41752-431d-4f40-991b-5fed332c70dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:01.422532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-92d41752-431d-4f40-991b-5fed332c70dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.144822 May 12 06:58:01.423098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 403/810] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:01 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:01.679829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e7da7226-75a5-4204-8957-7684846d510e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:01.680686 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e7da7226-75a5-4204-8957-7684846d510e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:01.687577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e7da7226-75a5-4204-8957-7684846d510e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:01.688060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e7da7226-75a5-4204-8957-7684846d510e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:01.688830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e7da7226-75a5-4204-8957-7684846d510e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:01.689273 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e7da7226-75a5-4204-8957-7684846d510e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:01.716929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e7da7226-75a5-4204-8957-7684846d510e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041158 May 12 06:58:01.717475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 408/811] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:01 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:02.439889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d1036839-d03b-4400-be0a-aa32336a3e7a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:02.440409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d1036839-d03b-4400-be0a-aa32336a3e7a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:02.446674 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1036839-d03b-4400-be0a-aa32336a3e7a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:02.447121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1036839-d03b-4400-be0a-aa32336a3e7a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:02.447910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1036839-d03b-4400-be0a-aa32336a3e7a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:02.448343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1036839-d03b-4400-be0a-aa32336a3e7a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:02.571564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d1036839-d03b-4400-be0a-aa32336a3e7a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:02.579424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d1036839-d03b-4400-be0a-aa32336a3e7a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.143815 May 12 06:58:02.580022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 404/812] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:02 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:02.728529 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a67be600-6f76-4820-8220-4e55fd32351c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:02.729421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a67be600-6f76-4820-8220-4e55fd32351c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:02.735808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a67be600-6f76-4820-8220-4e55fd32351c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:02.736266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a67be600-6f76-4820-8220-4e55fd32351c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:02.737034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a67be600-6f76-4820-8220-4e55fd32351c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:02.737479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a67be600-6f76-4820-8220-4e55fd32351c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:02.765802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a67be600-6f76-4820-8220-4e55fd32351c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041289 May 12 06:58:02.766357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 409/813] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:02 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:03.596644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bc461f0f-18e5-4df5-b3d1-aab674ebe8da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:03.597265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bc461f0f-18e5-4df5-b3d1-aab674ebe8da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:03.603512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc461f0f-18e5-4df5-b3d1-aab674ebe8da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:03.604050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc461f0f-18e5-4df5-b3d1-aab674ebe8da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:03.611880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc461f0f-18e5-4df5-b3d1-aab674ebe8da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:03.611880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc461f0f-18e5-4df5-b3d1-aab674ebe8da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:03.735985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bc461f0f-18e5-4df5-b3d1-aab674ebe8da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:03.743314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bc461f0f-18e5-4df5-b3d1-aab674ebe8da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150523 May 12 06:58:03.766350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 405/814] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:03 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:03.873445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fa31a747-b5c5-41ab-872d-8d9209247f71 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:03.874382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fa31a747-b5c5-41ab-872d-8d9209247f71 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:03.880139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa31a747-b5c5-41ab-872d-8d9209247f71 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:03.880588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa31a747-b5c5-41ab-872d-8d9209247f71 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:03.881361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa31a747-b5c5-41ab-872d-8d9209247f71 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:03.881797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa31a747-b5c5-41ab-872d-8d9209247f71 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:03.909393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fa31a747-b5c5-41ab-872d-8d9209247f71 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.136033 May 12 06:58:03.909950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 410/815] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:04.760885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-86957c62-70f6-4498-ab2c-bdb0f42419ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:04.761492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-86957c62-70f6-4498-ab2c-bdb0f42419ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:04.768402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86957c62-70f6-4498-ab2c-bdb0f42419ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:04.768845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86957c62-70f6-4498-ab2c-bdb0f42419ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:04.769611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86957c62-70f6-4498-ab2c-bdb0f42419ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:04.770068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86957c62-70f6-4498-ab2c-bdb0f42419ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:04.897664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-86957c62-70f6-4498-ab2c-bdb0f42419ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:04.904865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-86957c62-70f6-4498-ab2c-bdb0f42419ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147853 May 12 06:58:04.905430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 406/816] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:04.921414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9f2e7e6c-e544-417a-9576-b283410e7a06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:04.922331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9f2e7e6c-e544-417a-9576-b283410e7a06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:04.928635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f2e7e6c-e544-417a-9576-b283410e7a06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:04.929083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f2e7e6c-e544-417a-9576-b283410e7a06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:04.929856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f2e7e6c-e544-417a-9576-b283410e7a06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:04.930295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f2e7e6c-e544-417a-9576-b283410e7a06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:04.959549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9f2e7e6c-e544-417a-9576-b283410e7a06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042402 May 12 06:58:04.960140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 411/817] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:04 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:05.921831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6f6aebe7-6e6c-4970-95c0-b891ddfc03a7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:05.922361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6f6aebe7-6e6c-4970-95c0-b891ddfc03a7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:05.928521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f6aebe7-6e6c-4970-95c0-b891ddfc03a7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:05.928962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f6aebe7-6e6c-4970-95c0-b891ddfc03a7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:05.929717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f6aebe7-6e6c-4970-95c0-b891ddfc03a7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:05.930147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f6aebe7-6e6c-4970-95c0-b891ddfc03a7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:05.970939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c32bf828-7fa0-4ea2-ae41-7616cf2de41c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:05.971995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c32bf828-7fa0-4ea2-ae41-7616cf2de41c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:05.978416 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c32bf828-7fa0-4ea2-ae41-7616cf2de41c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:05.979005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c32bf828-7fa0-4ea2-ae41-7616cf2de41c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:05.979835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c32bf828-7fa0-4ea2-ae41-7616cf2de41c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:05.980287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c32bf828-7fa0-4ea2-ae41-7616cf2de41c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:06.010240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c32bf828-7fa0-4ea2-ae41-7616cf2de41c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043664 May 12 06:58:06.011008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 412/818] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:05 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:58:06.062908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6f6aebe7-6e6c-4970-95c0-b891ddfc03a7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:06.070674 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6f6aebe7-6e6c-4970-95c0-b891ddfc03a7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.153620 May 12 06:58:06.071401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 407/819] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:05 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:07.022063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f6f277e5-0653-4dbe-ba41-0a68de8a4898 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:07.023010 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f6f277e5-0653-4dbe-ba41-0a68de8a4898 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:07.029333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6f277e5-0653-4dbe-ba41-0a68de8a4898 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:07.033801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6f277e5-0653-4dbe-ba41-0a68de8a4898 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:07.033801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6f277e5-0653-4dbe-ba41-0a68de8a4898 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:07.033801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6f277e5-0653-4dbe-ba41-0a68de8a4898 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:07.060002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f6f277e5-0653-4dbe-ba41-0a68de8a4898 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041906 May 12 06:58:07.061224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 413/820] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:07 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:58:07.088276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b1528054-8341-4215-9b9e-7cb17ab99707 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:07.088886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b1528054-8341-4215-9b9e-7cb17ab99707 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:07.095136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b1528054-8341-4215-9b9e-7cb17ab99707 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:07.095583 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b1528054-8341-4215-9b9e-7cb17ab99707 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:07.096381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b1528054-8341-4215-9b9e-7cb17ab99707 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:07.096810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b1528054-8341-4215-9b9e-7cb17ab99707 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:07.223287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b1528054-8341-4215-9b9e-7cb17ab99707 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:07.230537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b1528054-8341-4215-9b9e-7cb17ab99707 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146107 May 12 06:58:07.231100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 408/821] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:07 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:08.071523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9989119f-a40e-471b-81aa-b20b38bf5e0a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:08.072495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9989119f-a40e-471b-81aa-b20b38bf5e0a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:08.079380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9989119f-a40e-471b-81aa-b20b38bf5e0a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:08.079870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9989119f-a40e-471b-81aa-b20b38bf5e0a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:08.080650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9989119f-a40e-471b-81aa-b20b38bf5e0a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:08.081088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9989119f-a40e-471b-81aa-b20b38bf5e0a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:08.109003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9989119f-a40e-471b-81aa-b20b38bf5e0a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041555 May 12 06:58:08.109553 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 414/822] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:08.247884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bd006d81-3482-4add-a65f-e7d9efad0cfe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:08.248980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bd006d81-3482-4add-a65f-e7d9efad0cfe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:08.255374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd006d81-3482-4add-a65f-e7d9efad0cfe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:08.255850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd006d81-3482-4add-a65f-e7d9efad0cfe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:08.256614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd006d81-3482-4add-a65f-e7d9efad0cfe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:08.257050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd006d81-3482-4add-a65f-e7d9efad0cfe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:08.387225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bd006d81-3482-4add-a65f-e7d9efad0cfe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:08.394482 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bd006d81-3482-4add-a65f-e7d9efad0cfe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150538 May 12 06:58:08.395051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 409/823] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:08 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:09.120917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b89bff3c-6787-4d66-aed7-f8e6e3d588db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:09.121842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b89bff3c-6787-4d66-aed7-f8e6e3d588db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:09.128136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b89bff3c-6787-4d66-aed7-f8e6e3d588db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:09.128589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b89bff3c-6787-4d66-aed7-f8e6e3d588db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:09.129364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b89bff3c-6787-4d66-aed7-f8e6e3d588db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:09.129828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b89bff3c-6787-4d66-aed7-f8e6e3d588db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:09.158605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b89bff3c-6787-4d66-aed7-f8e6e3d588db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041800 May 12 06:58:09.159156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 415/824] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:09.411424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-339a9db5-9899-42b1-a0c1-edad999b3ec0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:09.412002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-339a9db5-9899-42b1-a0c1-edad999b3ec0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:09.418320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-339a9db5-9899-42b1-a0c1-edad999b3ec0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:09.418780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-339a9db5-9899-42b1-a0c1-edad999b3ec0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:09.419556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-339a9db5-9899-42b1-a0c1-edad999b3ec0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:09.420037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-339a9db5-9899-42b1-a0c1-edad999b3ec0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:09.546889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-339a9db5-9899-42b1-a0c1-edad999b3ec0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:09.554245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-339a9db5-9899-42b1-a0c1-edad999b3ec0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146750 May 12 06:58:09.554814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 410/825] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:09 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:10.170432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-be4f10fe-a1fc-430e-8c57-2b5f8994627b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:10.171642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-be4f10fe-a1fc-430e-8c57-2b5f8994627b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:10.177908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be4f10fe-a1fc-430e-8c57-2b5f8994627b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:10.178361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be4f10fe-a1fc-430e-8c57-2b5f8994627b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:10.179133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be4f10fe-a1fc-430e-8c57-2b5f8994627b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:10.179572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be4f10fe-a1fc-430e-8c57-2b5f8994627b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:10.207867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-be4f10fe-a1fc-430e-8c57-2b5f8994627b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041880 May 12 06:58:10.208378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 416/826] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:10 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:10.571397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-34400aa6-2363-403c-b25f-7588a1ffea18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:10.572033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-34400aa6-2363-403c-b25f-7588a1ffea18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:10.578929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34400aa6-2363-403c-b25f-7588a1ffea18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:10.579373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34400aa6-2363-403c-b25f-7588a1ffea18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:10.580152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34400aa6-2363-403c-b25f-7588a1ffea18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:10.580586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34400aa6-2363-403c-b25f-7588a1ffea18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:10.707172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-34400aa6-2363-403c-b25f-7588a1ffea18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:10.714546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-34400aa6-2363-403c-b25f-7588a1ffea18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146948 May 12 06:58:10.715124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 411/827] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:10 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:11.219190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9b5dc0d9-fe17-44fe-a24f-b502ff424388 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:11.220182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9b5dc0d9-fe17-44fe-a24f-b502ff424388 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:11.226515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b5dc0d9-fe17-44fe-a24f-b502ff424388 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:11.226970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b5dc0d9-fe17-44fe-a24f-b502ff424388 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:11.227757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b5dc0d9-fe17-44fe-a24f-b502ff424388 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:11.228200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b5dc0d9-fe17-44fe-a24f-b502ff424388 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:11.258232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9b5dc0d9-fe17-44fe-a24f-b502ff424388 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042947 May 12 06:58:11.258729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 417/828] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:11.732708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bbceffb9-f801-4c5c-a976-37f49921d52f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:11.733322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bbceffb9-f801-4c5c-a976-37f49921d52f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:11.739726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bbceffb9-f801-4c5c-a976-37f49921d52f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:11.740183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bbceffb9-f801-4c5c-a976-37f49921d52f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:11.740951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bbceffb9-f801-4c5c-a976-37f49921d52f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:11.741397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bbceffb9-f801-4c5c-a976-37f49921d52f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:11.869122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bbceffb9-f801-4c5c-a976-37f49921d52f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:11.876429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bbceffb9-f801-4c5c-a976-37f49921d52f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148139 May 12 06:58:11.877004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 412/829] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:11 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:12.271266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-89f4bdc4-75d1-4665-bd19-3dc4f8763ce5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:12.272152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-89f4bdc4-75d1-4665-bd19-3dc4f8763ce5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:12.278501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89f4bdc4-75d1-4665-bd19-3dc4f8763ce5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:12.278949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89f4bdc4-75d1-4665-bd19-3dc4f8763ce5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:12.280313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89f4bdc4-75d1-4665-bd19-3dc4f8763ce5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:12.280781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89f4bdc4-75d1-4665-bd19-3dc4f8763ce5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:12.309658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-89f4bdc4-75d1-4665-bd19-3dc4f8763ce5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042479 May 12 06:58:12.310229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 418/830] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:12 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:12.893401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b768e372-6f84-4870-86f3-0a85d8e692ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:12.893971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b768e372-6f84-4870-86f3-0a85d8e692ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:12.900412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b768e372-6f84-4870-86f3-0a85d8e692ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:12.900861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b768e372-6f84-4870-86f3-0a85d8e692ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:12.901629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b768e372-6f84-4870-86f3-0a85d8e692ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:12.902063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b768e372-6f84-4870-86f3-0a85d8e692ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:13.029279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b768e372-6f84-4870-86f3-0a85d8e692ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:13.036574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b768e372-6f84-4870-86f3-0a85d8e692ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147118 May 12 06:58:13.037139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 413/831] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:12 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:13.321862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d11e7333-0949-45f6-9802-7ecfa56fb67d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:13.322803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d11e7333-0949-45f6-9802-7ecfa56fb67d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:13.329130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d11e7333-0949-45f6-9802-7ecfa56fb67d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:13.329577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d11e7333-0949-45f6-9802-7ecfa56fb67d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:13.330370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d11e7333-0949-45f6-9802-7ecfa56fb67d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:13.330807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d11e7333-0949-45f6-9802-7ecfa56fb67d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:13.361776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d11e7333-0949-45f6-9802-7ecfa56fb67d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044118 May 12 06:58:13.362335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 419/832] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:14.054260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4b0773c2-7787-43ee-a0bf-bc4471b15d33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:14.054877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4b0773c2-7787-43ee-a0bf-bc4471b15d33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:14.061758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b0773c2-7787-43ee-a0bf-bc4471b15d33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:14.064123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b0773c2-7787-43ee-a0bf-bc4471b15d33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:14.064123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b0773c2-7787-43ee-a0bf-bc4471b15d33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:14.064123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b0773c2-7787-43ee-a0bf-bc4471b15d33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:14.192360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4b0773c2-7787-43ee-a0bf-bc4471b15d33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:14.199571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4b0773c2-7787-43ee-a0bf-bc4471b15d33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149301 May 12 06:58:14.200159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 414/833] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:14 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:14.373630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8ffc8219-f086-48d8-a285-0620f3092ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:14.374491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8ffc8219-f086-48d8-a285-0620f3092ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:14.381420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8ffc8219-f086-48d8-a285-0620f3092ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:14.381867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8ffc8219-f086-48d8-a285-0620f3092ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:14.382632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8ffc8219-f086-48d8-a285-0620f3092ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:14.383064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8ffc8219-f086-48d8-a285-0620f3092ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:14.411824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8ffc8219-f086-48d8-a285-0620f3092ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042246 May 12 06:58:14.418761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 420/834] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:14 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:15.217150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-696a9be5-a33e-4e1e-8bd4-6bd4b01dcfff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:15.217752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-696a9be5-a33e-4e1e-8bd4-6bd4b01dcfff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:15.224097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-696a9be5-a33e-4e1e-8bd4-6bd4b01dcfff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:15.224564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-696a9be5-a33e-4e1e-8bd4-6bd4b01dcfff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:15.225305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-696a9be5-a33e-4e1e-8bd4-6bd4b01dcfff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:15.225738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-696a9be5-a33e-4e1e-8bd4-6bd4b01dcfff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:15.350336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-696a9be5-a33e-4e1e-8bd4-6bd4b01dcfff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:15.358214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-696a9be5-a33e-4e1e-8bd4-6bd4b01dcfff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.144944 May 12 06:58:15.358787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 415/835] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:15 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:15.427847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-786398f5-5258-4da0-baa3-d454bfa08784 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:15.428781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-786398f5-5258-4da0-baa3-d454bfa08784 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:15.435244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-786398f5-5258-4da0-baa3-d454bfa08784 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:15.435719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-786398f5-5258-4da0-baa3-d454bfa08784 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:15.436501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-786398f5-5258-4da0-baa3-d454bfa08784 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:15.436947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-786398f5-5258-4da0-baa3-d454bfa08784 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:15.464967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-786398f5-5258-4da0-baa3-d454bfa08784 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041048 May 12 06:58:15.465522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 421/836] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:16.375918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5e7c4eea-78ae-4ea6-aaf0-098eab256ba6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:16.376473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5e7c4eea-78ae-4ea6-aaf0-098eab256ba6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:16.382700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e7c4eea-78ae-4ea6-aaf0-098eab256ba6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:16.383144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e7c4eea-78ae-4ea6-aaf0-098eab256ba6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:16.383928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e7c4eea-78ae-4ea6-aaf0-098eab256ba6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:16.384362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e7c4eea-78ae-4ea6-aaf0-098eab256ba6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:16.476946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-92621be5-83ed-4004-97f6-823dbadb7884 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:16.478059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-92621be5-83ed-4004-97f6-823dbadb7884 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:16.484879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92621be5-83ed-4004-97f6-823dbadb7884 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:16.485413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92621be5-83ed-4004-97f6-823dbadb7884 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:16.486248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92621be5-83ed-4004-97f6-823dbadb7884 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:16.486773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92621be5-83ed-4004-97f6-823dbadb7884 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:16.510785 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5e7c4eea-78ae-4ea6-aaf0-098eab256ba6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:16.515487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-92621be5-83ed-4004-97f6-823dbadb7884 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042384 May 12 06:58:16.516164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 422/837] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:58:16.518157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5e7c4eea-78ae-4ea6-aaf0-098eab256ba6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146694 May 12 06:58:16.518714 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 416/838] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:16 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:17.527138 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8cde0444-c98d-4d13-9bde-dd8310a2dde9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:17.528100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8cde0444-c98d-4d13-9bde-dd8310a2dde9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:17.535011 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8cde0444-c98d-4d13-9bde-dd8310a2dde9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:17.535455 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e6abfebe-cb3e-4d40-85ec-dceff206077a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:17.535885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8cde0444-c98d-4d13-9bde-dd8310a2dde9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:17.536101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e6abfebe-cb3e-4d40-85ec-dceff206077a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:17.536274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8cde0444-c98d-4d13-9bde-dd8310a2dde9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:17.536710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8cde0444-c98d-4d13-9bde-dd8310a2dde9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:17.542438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6abfebe-cb3e-4d40-85ec-dceff206077a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:17.542884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6abfebe-cb3e-4d40-85ec-dceff206077a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:17.543807 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6abfebe-cb3e-4d40-85ec-dceff206077a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:17.544272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6abfebe-cb3e-4d40-85ec-dceff206077a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:17.566256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8cde0444-c98d-4d13-9bde-dd8310a2dde9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043009 May 12 06:58:17.566812 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 423/839] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:17 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:17.673655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e6abfebe-cb3e-4d40-85ec-dceff206077a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:17.680923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e6abfebe-cb3e-4d40-85ec-dceff206077a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149219 May 12 06:58:17.681512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 417/840] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:17 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:18.578742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b7ee5c57-8c30-422a-988b-16fa28480aba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:18.579718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b7ee5c57-8c30-422a-988b-16fa28480aba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:18.585982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7ee5c57-8c30-422a-988b-16fa28480aba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:18.586427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7ee5c57-8c30-422a-988b-16fa28480aba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:18.587190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7ee5c57-8c30-422a-988b-16fa28480aba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:18.587622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7ee5c57-8c30-422a-988b-16fa28480aba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:18.614885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b7ee5c57-8c30-422a-988b-16fa28480aba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040725 May 12 06:58:18.615421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 424/841] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:18.698204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c6d99ce8-1938-40d4-b0fb-28c1e25eb82e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:18.698825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c6d99ce8-1938-40d4-b0fb-28c1e25eb82e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:18.705777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6d99ce8-1938-40d4-b0fb-28c1e25eb82e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:18.706256 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6d99ce8-1938-40d4-b0fb-28c1e25eb82e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:18.707023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6d99ce8-1938-40d4-b0fb-28c1e25eb82e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:18.707459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6d99ce8-1938-40d4-b0fb-28c1e25eb82e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:18.832451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c6d99ce8-1938-40d4-b0fb-28c1e25eb82e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:18.839668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c6d99ce8-1938-40d4-b0fb-28c1e25eb82e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145317 May 12 06:58:18.840262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 418/842] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:18 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:19.627138 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-367efffb-7b85-4900-bf81-2e2eb1af5902 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:19.628071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-367efffb-7b85-4900-bf81-2e2eb1af5902 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:19.634310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-367efffb-7b85-4900-bf81-2e2eb1af5902 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:19.634759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-367efffb-7b85-4900-bf81-2e2eb1af5902 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:19.635531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-367efffb-7b85-4900-bf81-2e2eb1af5902 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:19.635988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-367efffb-7b85-4900-bf81-2e2eb1af5902 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:19.663319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-367efffb-7b85-4900-bf81-2e2eb1af5902 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040830 May 12 06:58:19.663883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 425/843] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:19 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:19.857039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1a33995a-81ff-4aa4-a32e-c1830979947a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:19.857660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1a33995a-81ff-4aa4-a32e-c1830979947a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:19.864598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a33995a-81ff-4aa4-a32e-c1830979947a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:19.865048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a33995a-81ff-4aa4-a32e-c1830979947a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:19.865827 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a33995a-81ff-4aa4-a32e-c1830979947a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:19.866256 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a33995a-81ff-4aa4-a32e-c1830979947a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:19.995880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1a33995a-81ff-4aa4-a32e-c1830979947a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:20.003151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1a33995a-81ff-4aa4-a32e-c1830979947a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149964 May 12 06:58:20.003738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 419/844] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:19 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:20.399224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1dbb984f-1943-45ee-96f5-1abeb43027dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:20.399748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1dbb984f-1943-45ee-96f5-1abeb43027dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:20.406248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dbb984f-1943-45ee-96f5-1abeb43027dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:20.406700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dbb984f-1943-45ee-96f5-1abeb43027dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:20.407471 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dbb984f-1943-45ee-96f5-1abeb43027dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:20.407944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dbb984f-1943-45ee-96f5-1abeb43027dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:20.432076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1dbb984f-1943-45ee-96f5-1abeb43027dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 06:58:20.674787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8826fb93-70ab-424e-8bdd-b7becd8fe3da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:20.675735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8826fb93-70ab-424e-8bdd-b7becd8fe3da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:20.681556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8826fb93-70ab-424e-8bdd-b7becd8fe3da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:20.682003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8826fb93-70ab-424e-8bdd-b7becd8fe3da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:20.682764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8826fb93-70ab-424e-8bdd-b7becd8fe3da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:20.683196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8826fb93-70ab-424e-8bdd-b7becd8fe3da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:20.711474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1dbb984f-1943-45ee-96f5-1abeb43027dd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 204 len: 0 microversion: 2.1 time: 0.315498 May 12 06:58:20.712277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 426/845] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 06:58:20 2022] DELETE /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 06:58:20.718954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8826fb93-70ab-424e-8bdd-b7becd8fe3da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043027 May 12 06:58:20.718954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 420/846] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:58:20.724527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f5875c98-8195-4d50-ae59-ab40fb81e5f4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:20.725277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f5875c98-8195-4d50-ae59-ab40fb81e5f4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:20.731111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5875c98-8195-4d50-ae59-ab40fb81e5f4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:20.731566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5875c98-8195-4d50-ae59-ab40fb81e5f4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:20.732376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5875c98-8195-4d50-ae59-ab40fb81e5f4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:20.732809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5875c98-8195-4d50-ae59-ab40fb81e5f4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:20.862920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f5875c98-8195-4d50-ae59-ab40fb81e5f4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:20.870415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f5875c98-8195-4d50-ae59-ab40fb81e5f4 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1681 microversion: 2.1 time: 0.151702 May 12 06:58:20.871218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 427/847] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:20 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:21.019491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7bf88fd6-dde1-44ad-ba00-3ba47907695c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:21.020129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7bf88fd6-dde1-44ad-ba00-3ba47907695c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:21.026419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bf88fd6-dde1-44ad-ba00-3ba47907695c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:21.026865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bf88fd6-dde1-44ad-ba00-3ba47907695c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:21.027620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bf88fd6-dde1-44ad-ba00-3ba47907695c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:21.028094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bf88fd6-dde1-44ad-ba00-3ba47907695c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:21.159158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7bf88fd6-dde1-44ad-ba00-3ba47907695c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:21.166985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7bf88fd6-dde1-44ad-ba00-3ba47907695c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.151312 May 12 06:58:21.167566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 421/848] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:21 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:21.585955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8361654c-c077-4692-8baf-56e7c3e3a27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:21.595861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8361654c-c077-4692-8baf-56e7c3e3a27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:21.595861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8361654c-c077-4692-8baf-56e7c3e3a27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:21.595861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8361654c-c077-4692-8baf-56e7c3e3a27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:21.595861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8361654c-c077-4692-8baf-56e7c3e3a27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:21.596442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8361654c-c077-4692-8baf-56e7c3e3a27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:21.725288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1e40c35a-5ec3-4a01-bb41-4f89482f0d58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:21.726163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1e40c35a-5ec3-4a01-bb41-4f89482f0d58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:21.732662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e40c35a-5ec3-4a01-bb41-4f89482f0d58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:21.733117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e40c35a-5ec3-4a01-bb41-4f89482f0d58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:21.733886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e40c35a-5ec3-4a01-bb41-4f89482f0d58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:21.734325 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e40c35a-5ec3-4a01-bb41-4f89482f0d58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:21.761864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1e40c35a-5ec3-4a01-bb41-4f89482f0d58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040657 May 12 06:58:21.762414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 422/849] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:58:21.888538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-81a04e12-ad43-4e46-a098-93bd192844ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:21.889175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-81a04e12-ad43-4e46-a098-93bd192844ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:21.895469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81a04e12-ad43-4e46-a098-93bd192844ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:21.895940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81a04e12-ad43-4e46-a098-93bd192844ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:21.896792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81a04e12-ad43-4e46-a098-93bd192844ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:21.897228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81a04e12-ad43-4e46-a098-93bd192844ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:22.021172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-81a04e12-ad43-4e46-a098-93bd192844ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:22.028849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-81a04e12-ad43-4e46-a098-93bd192844ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1681 microversion: 2.1 time: 0.144355 May 12 06:58:22.029405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 423/850] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:21 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1681 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:22.184746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4d20ef42-cf54-4ea3-9b22-8744797a6748 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:22.185367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4d20ef42-cf54-4ea3-9b22-8744797a6748 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:22.191762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4d20ef42-cf54-4ea3-9b22-8744797a6748 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:22.192243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4d20ef42-cf54-4ea3-9b22-8744797a6748 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:22.193017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4d20ef42-cf54-4ea3-9b22-8744797a6748 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:22.193453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4d20ef42-cf54-4ea3-9b22-8744797a6748 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:22.320578 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4d20ef42-cf54-4ea3-9b22-8744797a6748 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:22.328690 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4d20ef42-cf54-4ea3-9b22-8744797a6748 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147949 May 12 06:58:22.329270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 424/851] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:22 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:22.774316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7aee1caa-1aa3-4840-8cdd-88a9da2319b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:22.775235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7aee1caa-1aa3-4840-8cdd-88a9da2319b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:22.781837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aee1caa-1aa3-4840-8cdd-88a9da2319b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:22.782287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aee1caa-1aa3-4840-8cdd-88a9da2319b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:22.783061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aee1caa-1aa3-4840-8cdd-88a9da2319b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:22.783498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aee1caa-1aa3-4840-8cdd-88a9da2319b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:22.812481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7aee1caa-1aa3-4840-8cdd-88a9da2319b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042296 May 12 06:58:22.813260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 425/852] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:22 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:58:23.043128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-b5223735-5dd5-4555-8dcc-8a61d7cee6ba req-01514e5a-fb5c-4e92-aee4-af9973502a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c151d1-8962-4a06-b362-6b195a231bb1", "name": "network-vif-deleted", "tag": "9cad092e-69e2-4b4d-9f3c-ae1859cafe86"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:58:23.052368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-b5223735-5dd5-4555-8dcc-8a61d7cee6ba req-01514e5a-fb5c-4e92-aee4-af9973502a4e service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:23.053053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-b5223735-5dd5-4555-8dcc-8a61d7cee6ba req-01514e5a-fb5c-4e92-aee4-af9973502a4e service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:23.065408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-b5223735-5dd5-4555-8dcc-8a61d7cee6ba req-01514e5a-fb5c-4e92-aee4-af9973502a4e service nova] Creating event network-vif-deleted:9cad092e-69e2-4b4d-9f3c-ae1859cafe86 for instance 21c151d1-8962-4a06-b362-6b195a231bb1 on hv-cinder-76606 May 12 06:58:23.070720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-b5223735-5dd5-4555-8dcc-8a61d7cee6ba req-01514e5a-fb5c-4e92-aee4-af9973502a4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098037 May 12 06:58:23.071317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 426/853] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 06:58:23.083652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4660d4e9-e5b2-4d1f-9b0c-a95c732f4e99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:23.083652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4660d4e9-e5b2-4d1f-9b0c-a95c732f4e99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:23.086731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4660d4e9-e5b2-4d1f-9b0c-a95c732f4e99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:23.087187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4660d4e9-e5b2-4d1f-9b0c-a95c732f4e99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:23.088114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4660d4e9-e5b2-4d1f-9b0c-a95c732f4e99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:23.088549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4660d4e9-e5b2-4d1f-9b0c-a95c732f4e99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:23.162454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4660d4e9-e5b2-4d1f-9b0c-a95c732f4e99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:23.170129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4660d4e9-e5b2-4d1f-9b0c-a95c732f4e99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 200 len: 1613 microversion: 2.1 time: 0.097171 May 12 06:58:23.170670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 427/854] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:23 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 1613 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:23.345465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-889e7af8-0ad9-406d-81cf-fce61e83c63a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:23.346077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-889e7af8-0ad9-406d-81cf-fce61e83c63a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:23.351890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-889e7af8-0ad9-406d-81cf-fce61e83c63a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:23.352338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-889e7af8-0ad9-406d-81cf-fce61e83c63a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:23.353106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-889e7af8-0ad9-406d-81cf-fce61e83c63a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:23.353588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-889e7af8-0ad9-406d-81cf-fce61e83c63a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:23.485263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-889e7af8-0ad9-406d-81cf-fce61e83c63a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:23.492907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-889e7af8-0ad9-406d-81cf-fce61e83c63a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.151339 May 12 06:58:23.493475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 428/855] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:23 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:23.823647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-67eb8016-e125-454d-9dcd-247a4e5d90ce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:23.824677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-67eb8016-e125-454d-9dcd-247a4e5d90ce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:23.831169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-67eb8016-e125-454d-9dcd-247a4e5d90ce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:23.831617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-67eb8016-e125-454d-9dcd-247a4e5d90ce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:23.832446 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-67eb8016-e125-454d-9dcd-247a4e5d90ce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:23.832909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-67eb8016-e125-454d-9dcd-247a4e5d90ce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:23.864042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-67eb8016-e125-454d-9dcd-247a4e5d90ce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044341 May 12 06:58:23.864604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 429/856] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:23 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:58:24.187842 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-393680bc-8c38-41c2-9bf7-c5690e4493fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:24.188486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-393680bc-8c38-41c2-9bf7-c5690e4493fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:24.194655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-393680bc-8c38-41c2-9bf7-c5690e4493fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:24.195104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-393680bc-8c38-41c2-9bf7-c5690e4493fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:24.195921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-393680bc-8c38-41c2-9bf7-c5690e4493fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:24.196358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-393680bc-8c38-41c2-9bf7-c5690e4493fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:24.209953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-393680bc-8c38-41c2-9bf7-c5690e4493fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-393680bc-8c38-41c2-9bf7-c5690e4493fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 HTTP/1.1 May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 06:58:24.211602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 06:58:24.213237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '21c151d1-8962-4a06-b362-6b195a231bb1'} May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 06:58:24.214286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 06:58:24.215818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 06:58:24.217240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-393680bc-8c38-41c2-9bf7-c5690e4493fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 06:58:24.217240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-393680bc-8c38-41c2-9bf7-c5690e4493fb tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 404 len: 111 microversion: 2.1 time: 0.029045 May 12 06:58:24.217240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 430/857] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:24 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 06:58:24.221724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ba680ec8-2e83-41fa-ac51-f705c2b9d8dc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '.version_select at 0x7f89da1bf9d0>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:24.319524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ba680ec8-2e83-41fa-ac51-f705c2b9d8dc tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-186675820" status: 202 len: 0 microversion: 2.1 time: 0.101696 May 12 06:58:24.320151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 431/858] 10.222.0.25 () {58 vars in 1217 bytes} [Thu May 12 06:58:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-186675820 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 06:58:24.510564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f9d82154-b4c8-4f28-a47c-d1ca661306ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:24.511201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f9d82154-b4c8-4f28-a47c-d1ca661306ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:24.518338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9d82154-b4c8-4f28-a47c-d1ca661306ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:24.518788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9d82154-b4c8-4f28-a47c-d1ca661306ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:24.519566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9d82154-b4c8-4f28-a47c-d1ca661306ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:24.520033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9d82154-b4c8-4f28-a47c-d1ca661306ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:24.657343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f9d82154-b4c8-4f28-a47c-d1ca661306ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:24.665616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f9d82154-b4c8-4f28-a47c-d1ca661306ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.159079 May 12 06:58:24.666321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 432/859] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:24 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:24.875933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0247c937-b316-420c-bf58-14723ff76f61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:24.877026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0247c937-b316-420c-bf58-14723ff76f61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:24.883422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0247c937-b316-420c-bf58-14723ff76f61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:24.884124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0247c937-b316-420c-bf58-14723ff76f61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:24.884681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0247c937-b316-420c-bf58-14723ff76f61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:24.885119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0247c937-b316-420c-bf58-14723ff76f61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:24.914643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0247c937-b316-420c-bf58-14723ff76f61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042930 May 12 06:58:24.915195 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 433/860] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:24 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:25.074494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-180da707-7c17-41be-a0c3-35c6f70e5611 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Action: 'create', calling method: .version_select at 0x7f89da1773a0>, body: {"keypair": {"name": "tempest-keypair-1590584630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERVZSv8wB77xBhgLIn9fy6NXe8kUmQWErCslf27tBzzdsK9Jdi+EWqX9CDnby/wystCbWlObwKxPP/I/B1yr6qiGgikCHi7DbgLyeafasrQMqbDkCz9jFSo/BzyOnjasA=="}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:58:25.088431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-180da707-7c17-41be-a0c3-35c6f70e5611 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:58:25.092215 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-180da707-7c17-41be-a0c3-35c6f70e5611 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for user d77bf80654c24c8c8336ce395f789ccb and project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:58:25.205698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-180da707-7c17-41be-a0c3-35c6f70e5611 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134962 May 12 06:58:25.206294 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 434/861] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 12 06:58:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:58:25.683540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b1a8a399-a808-4c9b-af10-383fb17e5bbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:25.684192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b1a8a399-a808-4c9b-af10-383fb17e5bbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:25.690078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b1a8a399-a808-4c9b-af10-383fb17e5bbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:25.690528 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b1a8a399-a808-4c9b-af10-383fb17e5bbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:25.691321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b1a8a399-a808-4c9b-af10-383fb17e5bbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:25.691792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b1a8a399-a808-4c9b-af10-383fb17e5bbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:25.819795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b1a8a399-a808-4c9b-af10-383fb17e5bbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:25.827660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b1a8a399-a808-4c9b-af10-383fb17e5bbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148073 May 12 06:58:25.828343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 435/862] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:25 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:25.926872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-43b09141-9a7c-40b8-bee1-39ae48a179b8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:25.927873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-43b09141-9a7c-40b8-bee1-39ae48a179b8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:25.933629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43b09141-9a7c-40b8-bee1-39ae48a179b8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:25.934076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43b09141-9a7c-40b8-bee1-39ae48a179b8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:25.934838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43b09141-9a7c-40b8-bee1-39ae48a179b8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:25.935271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43b09141-9a7c-40b8-bee1-39ae48a179b8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:25.964502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-43b09141-9a7c-40b8-bee1-39ae48a179b8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041576 May 12 06:58:25.965059 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 436/863] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:25 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:58:26.849206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a5a553ae-a525-4c62-a658-e8ccb160ed4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:26.849861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a5a553ae-a525-4c62-a658-e8ccb160ed4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:26.856052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5a553ae-a525-4c62-a658-e8ccb160ed4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:26.856500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5a553ae-a525-4c62-a658-e8ccb160ed4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:26.857258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5a553ae-a525-4c62-a658-e8ccb160ed4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:26.857692 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5a553ae-a525-4c62-a658-e8ccb160ed4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:26.993732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a5a553ae-a525-4c62-a658-e8ccb160ed4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:27.000840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a5a553ae-a525-4c62-a658-e8ccb160ed4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.155528 May 12 06:58:27.001426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 437/864] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:26 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:27.006136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-22bfe5f7-c34d-4e56-b5e3-ee4ddb300fe2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:27.007093 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-22bfe5f7-c34d-4e56-b5e3-ee4ddb300fe2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:27.013116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-22bfe5f7-c34d-4e56-b5e3-ee4ddb300fe2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:27.013567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-22bfe5f7-c34d-4e56-b5e3-ee4ddb300fe2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:27.015050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-22bfe5f7-c34d-4e56-b5e3-ee4ddb300fe2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:27.015494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-22bfe5f7-c34d-4e56-b5e3-ee4ddb300fe2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:27.045252 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-22bfe5f7-c34d-4e56-b5e3-ee4ddb300fe2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042782 May 12 06:58:27.045847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 438/865] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:27 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:27.584865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-239063395", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "940de373-828a-40b3-8a07-fc0aff461153"}], "security_groups": [{"name": "tempest-securitygroup--1105401747"}], "key_name": "tempest-keypair-1590584630", "user_data": "}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:58:27.683510 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.network.neutron [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] validate_networks() for [('940de373-828a-40b3-8a07-fc0aff461153', None, None, None, None, None)] {{(pid=124024) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 06:58:28.087117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Flavor limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 06:58:28.087719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Image limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 06:58:28.088036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Flavor pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 06:58:28.088445 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Image pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 06:58:28.088858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 06:58:28.097917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:28.101436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:28.101436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:28.101436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:28.115452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 06:58:28.119328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Getting quotas for user d77bf80654c24c8c8336ce395f789ccb and project 6ef9efe106ae4485a4d137377f1890e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 06:58:28.130490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Going to run 1 instances... {{(pid=124024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 06:58:28.132792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 06:58:28.272305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4d4a52ad-09cc-493b-9f46-07cb06ca645b tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.691642 May 12 06:58:28.272951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 439/866] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 06:58:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 06:58:28.277934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-202eec85-2757-4ef1-aeec-5941562b0631 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:28.278234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-202eec85-2757-4ef1-aeec-5941562b0631 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:28.284186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-202eec85-2757-4ef1-aeec-5941562b0631 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:28.284637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-202eec85-2757-4ef1-aeec-5941562b0631 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:28.285451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-202eec85-2757-4ef1-aeec-5941562b0631 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:28.285900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-202eec85-2757-4ef1-aeec-5941562b0631 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:28.429311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-202eec85-2757-4ef1-aeec-5941562b0631 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:28.437666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-202eec85-2757-4ef1-aeec-5941562b0631 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.163683 May 12 06:58:28.438232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 440/867] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:28 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:28.451185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dbdd9811-0654-476b-996d-e7bff7a43ad9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:28.452801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dbdd9811-0654-476b-996d-e7bff7a43ad9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:28.459071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dbdd9811-0654-476b-996d-e7bff7a43ad9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:28.459522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dbdd9811-0654-476b-996d-e7bff7a43ad9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:28.460347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dbdd9811-0654-476b-996d-e7bff7a43ad9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:28.460793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dbdd9811-0654-476b-996d-e7bff7a43ad9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:28.491589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dbdd9811-0654-476b-996d-e7bff7a43ad9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044263 May 12 06:58:28.492216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 441/868] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:28 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:28.496739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ab86ec3a-424a-4cf3-acc7-7924bbf796b1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:28.497400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ab86ec3a-424a-4cf3-acc7-7924bbf796b1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:28.558110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ab86ec3a-424a-4cf3-acc7-7924bbf796b1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:28.565199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ab86ec3a-424a-4cf3-acc7-7924bbf796b1 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 200 len: 1241 microversion: 2.1 time: 0.071853 May 12 06:58:28.566071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 442/869] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:28 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:29.454343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-36065fea-dde2-4304-b9cc-71967851243a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:29.455033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-36065fea-dde2-4304-b9cc-71967851243a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:29.462147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-36065fea-dde2-4304-b9cc-71967851243a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:29.462601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-36065fea-dde2-4304-b9cc-71967851243a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:29.463438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-36065fea-dde2-4304-b9cc-71967851243a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:29.463886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-36065fea-dde2-4304-b9cc-71967851243a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:29.591655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-36065fea-dde2-4304-b9cc-71967851243a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:29.599934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-36065fea-dde2-4304-b9cc-71967851243a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149404 May 12 06:58:29.600512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 443/870] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:29 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:29.605125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-db81d40e-0a3c-42b5-909e-77ea8bca1a27 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:29.606027 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-db81d40e-0a3c-42b5-909e-77ea8bca1a27 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:29.612401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db81d40e-0a3c-42b5-909e-77ea8bca1a27 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:29.612846 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db81d40e-0a3c-42b5-909e-77ea8bca1a27 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:29.613609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db81d40e-0a3c-42b5-909e-77ea8bca1a27 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:29.614080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db81d40e-0a3c-42b5-909e-77ea8bca1a27 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:29.642408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-db81d40e-0a3c-42b5-909e-77ea8bca1a27 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040915 May 12 06:58:29.642956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 444/871] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:29 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:29.647258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1005f48b-4da9-4b6c-b872-13491e268816 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:29.647877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1005f48b-4da9-4b6c-b872-13491e268816 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:29.653212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1005f48b-4da9-4b6c-b872-13491e268816 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:29.653657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1005f48b-4da9-4b6c-b872-13491e268816 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:29.654428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1005f48b-4da9-4b6c-b872-13491e268816 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:29.655494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1005f48b-4da9-4b6c-b872-13491e268816 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:29.718648 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1005f48b-4da9-4b6c-b872-13491e268816 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:29.726649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1005f48b-4da9-4b6c-b872-13491e268816 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 200 len: 1245 microversion: 2.1 time: 0.082726 May 12 06:58:29.727503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 445/872] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:29 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:30.616882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-63b83a3d-4df4-4123-ae9f-b0692047b911 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:30.617581 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-63b83a3d-4df4-4123-ae9f-b0692047b911 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:30.623921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63b83a3d-4df4-4123-ae9f-b0692047b911 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:30.624376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63b83a3d-4df4-4123-ae9f-b0692047b911 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:30.625154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63b83a3d-4df4-4123-ae9f-b0692047b911 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:30.625596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63b83a3d-4df4-4123-ae9f-b0692047b911 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:30.758435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-63b83a3d-4df4-4123-ae9f-b0692047b911 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:30.766565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-63b83a3d-4df4-4123-ae9f-b0692047b911 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.153627 May 12 06:58:30.767258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 446/873] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:30 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:30.771928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f67eeef0-c96b-4dad-865b-527cb0c512c3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:30.772831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f67eeef0-c96b-4dad-865b-527cb0c512c3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:30.778419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f67eeef0-c96b-4dad-865b-527cb0c512c3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:30.778968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f67eeef0-c96b-4dad-865b-527cb0c512c3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:30.780374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f67eeef0-c96b-4dad-865b-527cb0c512c3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:30.780952 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f67eeef0-c96b-4dad-865b-527cb0c512c3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:30.810394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f67eeef0-c96b-4dad-865b-527cb0c512c3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042040 May 12 06:58:30.814544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 447/874] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:30 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:30.815421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f299855b-260e-4231-84f5-829ed2f500c3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:30.816044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f299855b-260e-4231-84f5-829ed2f500c3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:30.822691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f299855b-260e-4231-84f5-829ed2f500c3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:30.823260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f299855b-260e-4231-84f5-829ed2f500c3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:30.824054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f299855b-260e-4231-84f5-829ed2f500c3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:30.824529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f299855b-260e-4231-84f5-829ed2f500c3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:30.891389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f299855b-260e-4231-84f5-829ed2f500c3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:30.898731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f299855b-260e-4231-84f5-829ed2f500c3 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 200 len: 1299 microversion: 2.1 time: 0.086829 May 12 06:58:30.899292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 448/875] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:30 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:31.782851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b2c1d48d-756f-4536-a202-68804760a9ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:31.783462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b2c1d48d-756f-4536-a202-68804760a9ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:31.789373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2c1d48d-756f-4536-a202-68804760a9ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:31.789821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2c1d48d-756f-4536-a202-68804760a9ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:31.790581 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2c1d48d-756f-4536-a202-68804760a9ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:31.791014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2c1d48d-756f-4536-a202-68804760a9ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:31.923780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b2c1d48d-756f-4536-a202-68804760a9ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:31.931880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b2c1d48d-756f-4536-a202-68804760a9ca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.152913 May 12 06:58:31.932721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 449/876] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:31 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:31.938777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-53078b82-c2ab-46d7-9eb3-616bb3922613 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:31.940423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-53078b82-c2ab-46d7-9eb3-616bb3922613 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:31.946896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-53078b82-c2ab-46d7-9eb3-616bb3922613 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:31.947593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-53078b82-c2ab-46d7-9eb3-616bb3922613 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:31.948553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-53078b82-c2ab-46d7-9eb3-616bb3922613 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:31.948990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-53078b82-c2ab-46d7-9eb3-616bb3922613 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:31.984244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-53078b82-c2ab-46d7-9eb3-616bb3922613 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050211 May 12 06:58:31.988374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 450/877] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:31 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:31.990781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e9dafcc5-e05d-49f2-b8f0-11075246bb49 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:31.991406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e9dafcc5-e05d-49f2-b8f0-11075246bb49 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:32.002993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e9dafcc5-e05d-49f2-b8f0-11075246bb49 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:32.003449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e9dafcc5-e05d-49f2-b8f0-11075246bb49 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:32.004276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e9dafcc5-e05d-49f2-b8f0-11075246bb49 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:32.004885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e9dafcc5-e05d-49f2-b8f0-11075246bb49 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:32.143290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e9dafcc5-e05d-49f2-b8f0-11075246bb49 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:32.150603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e9dafcc5-e05d-49f2-b8f0-11075246bb49 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 200 len: 1367 microversion: 2.1 time: 0.164850 May 12 06:58:32.151166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 451/878] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:31 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:32.206803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-8ea177ef-ac15-4782-b668-4c6ea43d02d3 req-ba0ee46e-957d-4bcb-a1da-d9b4476afac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d32c82-7a33-4e43-b678-1944501fa5df", "tag": "56ed9e0d-5810-4eec-9ff8-9544a2f94571"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:58:32.214823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-8ea177ef-ac15-4782-b668-4c6ea43d02d3 req-ba0ee46e-957d-4bcb-a1da-d9b4476afac2 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:32.215336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-8ea177ef-ac15-4782-b668-4c6ea43d02d3 req-ba0ee46e-957d-4bcb-a1da-d9b4476afac2 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:32.226904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-8ea177ef-ac15-4782-b668-4c6ea43d02d3 req-ba0ee46e-957d-4bcb-a1da-d9b4476afac2 service nova] Creating event network-changed:56ed9e0d-5810-4eec-9ff8-9544a2f94571 for instance 19d32c82-7a33-4e43-b678-1944501fa5df on hv-cinder-76606 May 12 06:58:32.231922 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-8ea177ef-ac15-4782-b668-4c6ea43d02d3 req-ba0ee46e-957d-4bcb-a1da-d9b4476afac2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030675 May 12 06:58:32.233506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 452/879] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:58:32.612488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 06:58:32.612966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 06:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c (ip 10.222.0.25) !!! May 12 06:58:33.047016 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-76df3b2b-cb6a-43ec-89c4-25df68520e7e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:33.047742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-76df3b2b-cb6a-43ec-89c4-25df68520e7e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:33.053824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76df3b2b-cb6a-43ec-89c4-25df68520e7e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:33.054277 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76df3b2b-cb6a-43ec-89c4-25df68520e7e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:33.055047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76df3b2b-cb6a-43ec-89c4-25df68520e7e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:33.055492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76df3b2b-cb6a-43ec-89c4-25df68520e7e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:33.187610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-76df3b2b-cb6a-43ec-89c4-25df68520e7e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:33.195648 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-76df3b2b-cb6a-43ec-89c4-25df68520e7e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.249751 May 12 06:58:33.196239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 453/880] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:32 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:33.200697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9d348de7-0c60-428b-8aca-7bd7c22bcbb0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:33.202172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9d348de7-0c60-428b-8aca-7bd7c22bcbb0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:33.207620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d348de7-0c60-428b-8aca-7bd7c22bcbb0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:33.208097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d348de7-0c60-428b-8aca-7bd7c22bcbb0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:33.208854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d348de7-0c60-428b-8aca-7bd7c22bcbb0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:33.209289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d348de7-0c60-428b-8aca-7bd7c22bcbb0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:33.237248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9d348de7-0c60-428b-8aca-7bd7c22bcbb0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040056 May 12 06:58:33.237779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 454/881] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:33 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:33.241924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3fcc7456-c01b-455c-92eb-cebfa5f77422 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:33.242515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3fcc7456-c01b-455c-92eb-cebfa5f77422 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:33.247723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3fcc7456-c01b-455c-92eb-cebfa5f77422 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:33.248170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3fcc7456-c01b-455c-92eb-cebfa5f77422 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:33.248943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3fcc7456-c01b-455c-92eb-cebfa5f77422 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:33.249375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3fcc7456-c01b-455c-92eb-cebfa5f77422 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:33.374400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3fcc7456-c01b-455c-92eb-cebfa5f77422 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:33.381673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3fcc7456-c01b-455c-92eb-cebfa5f77422 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 200 len: 1367 microversion: 2.1 time: 0.142989 May 12 06:58:33.382244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 455/882] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:33 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 1367 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:34.213315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e142b4d0-f74e-40c5-9e66-cd57c92134ff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:34.213976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e142b4d0-f74e-40c5-9e66-cd57c92134ff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:34.220967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e142b4d0-f74e-40c5-9e66-cd57c92134ff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:34.221423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e142b4d0-f74e-40c5-9e66-cd57c92134ff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:34.222196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e142b4d0-f74e-40c5-9e66-cd57c92134ff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:34.222636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e142b4d0-f74e-40c5-9e66-cd57c92134ff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:34.348142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e142b4d0-f74e-40c5-9e66-cd57c92134ff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:34.355520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e142b4d0-f74e-40c5-9e66-cd57c92134ff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146162 May 12 06:58:34.356118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 456/883] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:34 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:34.361265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-78d102cb-ec98-43b6-b34b-ccd52827b122 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:34.362217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-78d102cb-ec98-43b6-b34b-ccd52827b122 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:34.367591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d102cb-ec98-43b6-b34b-ccd52827b122 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:34.368070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d102cb-ec98-43b6-b34b-ccd52827b122 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:34.368833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d102cb-ec98-43b6-b34b-ccd52827b122 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:34.369273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d102cb-ec98-43b6-b34b-ccd52827b122 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:34.396705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-78d102cb-ec98-43b6-b34b-ccd52827b122 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039611 May 12 06:58:34.397249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 457/884] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:34 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:34.401433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b9222586-9da5-4a09-801d-9bb46ceccfef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:34.402040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b9222586-9da5-4a09-801d-9bb46ceccfef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:34.407880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b9222586-9da5-4a09-801d-9bb46ceccfef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:34.408331 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b9222586-9da5-4a09-801d-9bb46ceccfef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:34.409094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b9222586-9da5-4a09-801d-9bb46ceccfef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:34.409533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b9222586-9da5-4a09-801d-9bb46ceccfef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:34.535205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b9222586-9da5-4a09-801d-9bb46ceccfef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:34.542504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b9222586-9da5-4a09-801d-9bb46ceccfef tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 200 len: 1367 microversion: 2.1 time: 0.144341 May 12 06:58:34.543072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 458/885] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:34 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:35.372934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1626a829-bc57-4769-a1ef-2f58f05a4b18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:35.374132 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1626a829-bc57-4769-a1ef-2f58f05a4b18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:35.380527 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1626a829-bc57-4769-a1ef-2f58f05a4b18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:35.380981 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1626a829-bc57-4769-a1ef-2f58f05a4b18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:35.381752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1626a829-bc57-4769-a1ef-2f58f05a4b18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:35.382189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1626a829-bc57-4769-a1ef-2f58f05a4b18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:35.511865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1626a829-bc57-4769-a1ef-2f58f05a4b18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:35.519124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1626a829-bc57-4769-a1ef-2f58f05a4b18 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150089 May 12 06:58:35.519692 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 459/886] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:35 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:35.524238 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-869f7b56-61a2-4f68-9a79-4fefb239b558 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:35.525127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-869f7b56-61a2-4f68-9a79-4fefb239b558 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:35.530667 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-869f7b56-61a2-4f68-9a79-4fefb239b558 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:35.531107 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-869f7b56-61a2-4f68-9a79-4fefb239b558 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:35.531905 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-869f7b56-61a2-4f68-9a79-4fefb239b558 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:35.532338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-869f7b56-61a2-4f68-9a79-4fefb239b558 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:35.722943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-869f7b56-61a2-4f68-9a79-4fefb239b558 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.202098 May 12 06:58:35.723402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 460/887] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:35 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:35.727834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-178fbaef-0823-4956-b85c-df3361c3d526 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:35.728429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-178fbaef-0823-4956-b85c-df3361c3d526 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:35.734266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-178fbaef-0823-4956-b85c-df3361c3d526 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:35.734708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-178fbaef-0823-4956-b85c-df3361c3d526 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:35.735465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-178fbaef-0823-4956-b85c-df3361c3d526 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:35.735924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-178fbaef-0823-4956-b85c-df3361c3d526 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:35.860109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-178fbaef-0823-4956-b85c-df3361c3d526 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:35.867269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-178fbaef-0823-4956-b85c-df3361c3d526 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 200 len: 1367 microversion: 2.1 time: 0.142931 May 12 06:58:35.867860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 461/888] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:35 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 1367 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 06:58:36.537130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4c9e153c-0725-42a3-ac1f-aba381752b2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:36.537748 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4c9e153c-0725-42a3-ac1f-aba381752b2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:36.544232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c9e153c-0725-42a3-ac1f-aba381752b2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:36.544906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c9e153c-0725-42a3-ac1f-aba381752b2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:36.545701 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c9e153c-0725-42a3-ac1f-aba381752b2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:36.546145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c9e153c-0725-42a3-ac1f-aba381752b2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:36.677306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4c9e153c-0725-42a3-ac1f-aba381752b2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:36.684752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4c9e153c-0725-42a3-ac1f-aba381752b2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.151548 May 12 06:58:36.685349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 462/889] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:36 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:36.734978 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ecba618e-4668-4ee1-a6ad-cdb9fc5b05b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:36.735933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ecba618e-4668-4ee1-a6ad-cdb9fc5b05b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:36.741903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecba618e-4668-4ee1-a6ad-cdb9fc5b05b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:36.742352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecba618e-4668-4ee1-a6ad-cdb9fc5b05b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:36.743117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecba618e-4668-4ee1-a6ad-cdb9fc5b05b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:36.743549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecba618e-4668-4ee1-a6ad-cdb9fc5b05b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:36.772197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ecba618e-4668-4ee1-a6ad-cdb9fc5b05b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041640 May 12 06:58:36.772994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 463/890] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:36 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 06:58:36.844494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-9cadfdaa-f005-449c-ac99-66c03f9c978b req-9cf96a1f-6b39-4291-9d6c-0e645849e6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d32c82-7a33-4e43-b678-1944501fa5df", "name": "network-vif-plugged", "status": "completed", "tag": "56ed9e0d-5810-4eec-9ff8-9544a2f94571"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:58:36.852381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-9cadfdaa-f005-449c-ac99-66c03f9c978b req-9cf96a1f-6b39-4291-9d6c-0e645849e6f4 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:36.852821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-9cadfdaa-f005-449c-ac99-66c03f9c978b req-9cf96a1f-6b39-4291-9d6c-0e645849e6f4 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:36.864031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-9cadfdaa-f005-449c-ac99-66c03f9c978b req-9cf96a1f-6b39-4291-9d6c-0e645849e6f4 service nova] Creating event network-vif-plugged:56ed9e0d-5810-4eec-9ff8-9544a2f94571 for instance 19d32c82-7a33-4e43-b678-1944501fa5df on hv-cinder-76606 May 12 06:58:36.869014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-9cadfdaa-f005-449c-ac99-66c03f9c978b req-9cf96a1f-6b39-4291-9d6c-0e645849e6f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082300 May 12 06:58:36.869581 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 464/891] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:58:36.884486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-23ebb474-8da3-400c-9cee-d05b8dd8ae38 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:36.885266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-23ebb474-8da3-400c-9cee-d05b8dd8ae38 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:36.891867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23ebb474-8da3-400c-9cee-d05b8dd8ae38 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:36.892362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23ebb474-8da3-400c-9cee-d05b8dd8ae38 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:36.893171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23ebb474-8da3-400c-9cee-d05b8dd8ae38 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:36.893614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23ebb474-8da3-400c-9cee-d05b8dd8ae38 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:37.023359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-23ebb474-8da3-400c-9cee-d05b8dd8ae38 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:37.030839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-23ebb474-8da3-400c-9cee-d05b8dd8ae38 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 200 len: 1367 microversion: 2.1 time: 0.150591 May 12 06:58:37.031401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 465/892] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:36 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:37.702739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-de90794c-2b28-4a37-9329-41f6696cb43b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:37.703362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-de90794c-2b28-4a37-9329-41f6696cb43b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:37.709726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de90794c-2b28-4a37-9329-41f6696cb43b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:37.710207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de90794c-2b28-4a37-9329-41f6696cb43b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:37.710979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de90794c-2b28-4a37-9329-41f6696cb43b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:37.711420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de90794c-2b28-4a37-9329-41f6696cb43b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:37.838519 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-de90794c-2b28-4a37-9329-41f6696cb43b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:37.846449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-de90794c-2b28-4a37-9329-41f6696cb43b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148167 May 12 06:58:37.847017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 466/893] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:37 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:37.851567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9f374745-e2a0-45f4-99d4-e2b7069bcfa8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:37.852549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9f374745-e2a0-45f4-99d4-e2b7069bcfa8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:37.858157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f374745-e2a0-45f4-99d4-e2b7069bcfa8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:37.858607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f374745-e2a0-45f4-99d4-e2b7069bcfa8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:37.859384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f374745-e2a0-45f4-99d4-e2b7069bcfa8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:37.859850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f374745-e2a0-45f4-99d4-e2b7069bcfa8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:37.890515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9f374745-e2a0-45f4-99d4-e2b7069bcfa8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042520 May 12 06:58:37.891060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 467/894] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:37 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:38.048043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-62f80f0c-cde4-47dc-b89f-c7a5ccdc69ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:38.048696 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-62f80f0c-cde4-47dc-b89f-c7a5ccdc69ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:38.054691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62f80f0c-cde4-47dc-b89f-c7a5ccdc69ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:38.055145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62f80f0c-cde4-47dc-b89f-c7a5ccdc69ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:38.055944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62f80f0c-cde4-47dc-b89f-c7a5ccdc69ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:38.056385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62f80f0c-cde4-47dc-b89f-c7a5ccdc69ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:38.184976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-62f80f0c-cde4-47dc-b89f-c7a5ccdc69ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:38.192846 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-62f80f0c-cde4-47dc-b89f-c7a5ccdc69ec tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 200 len: 1367 microversion: 2.1 time: 0.149017 May 12 06:58:38.193405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 468/895] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:38 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:38.864351 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-86cb1655-ae57-4642-963e-c4069681517c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:38.865005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-86cb1655-ae57-4642-963e-c4069681517c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:38.871206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86cb1655-ae57-4642-963e-c4069681517c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:38.871652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86cb1655-ae57-4642-963e-c4069681517c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:38.872446 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86cb1655-ae57-4642-963e-c4069681517c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:38.872882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86cb1655-ae57-4642-963e-c4069681517c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:39.000531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-86cb1655-ae57-4642-963e-c4069681517c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:39.008131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-86cb1655-ae57-4642-963e-c4069681517c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147600 May 12 06:58:39.008685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 469/896] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:38 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:39.013338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-57151e6d-fcf1-42fd-9135-0aa05fccee45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:39.014753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-57151e6d-fcf1-42fd-9135-0aa05fccee45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:39.020338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-57151e6d-fcf1-42fd-9135-0aa05fccee45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:39.020791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-57151e6d-fcf1-42fd-9135-0aa05fccee45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:39.021555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-57151e6d-fcf1-42fd-9135-0aa05fccee45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:39.021994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-57151e6d-fcf1-42fd-9135-0aa05fccee45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:39.050437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-57151e6d-fcf1-42fd-9135-0aa05fccee45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040775 May 12 06:58:39.051062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 470/897] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:39 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:39.209833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-53fe6b57-f8c1-4827-a711-fe7a93bb88bd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:39.210379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-53fe6b57-f8c1-4827-a711-fe7a93bb88bd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:39.216284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-53fe6b57-f8c1-4827-a711-fe7a93bb88bd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:39.216742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-53fe6b57-f8c1-4827-a711-fe7a93bb88bd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:39.218150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-53fe6b57-f8c1-4827-a711-fe7a93bb88bd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:39.218614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-53fe6b57-f8c1-4827-a711-fe7a93bb88bd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:39.344242 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-53fe6b57-f8c1-4827-a711-fe7a93bb88bd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77bf80654c24c8c8336ce395f789ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef9efe106ae4485a4d137377f1890e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:39.351711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-53fe6b57-f8c1-4827-a711-fe7a93bb88bd tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 200 len: 1556 microversion: 2.1 time: 0.145650 May 12 06:58:39.352300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 471/898] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:39 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:39.367919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1b75cb5f-5b65-4ff1-98c6-25e23ae2ab75 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:39.368416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1b75cb5f-5b65-4ff1-98c6-25e23ae2ab75 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:39.374602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b75cb5f-5b65-4ff1-98c6-25e23ae2ab75 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:39.375057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b75cb5f-5b65-4ff1-98c6-25e23ae2ab75 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:39.375857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b75cb5f-5b65-4ff1-98c6-25e23ae2ab75 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:39.376298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b75cb5f-5b65-4ff1-98c6-25e23ae2ab75 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:39.450282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1b75cb5f-5b65-4ff1-98c6-25e23ae2ab75 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086002 May 12 06:58:39.450873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 472/899] 10.222.0.25 () {58 vars in 1274 bytes} [Thu May 12 06:58:39 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:58:40.025544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ecddbd13-f959-4c1b-85d3-afd183f81227 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:40.026182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ecddbd13-f959-4c1b-85d3-afd183f81227 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:40.032636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecddbd13-f959-4c1b-85d3-afd183f81227 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:40.033114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecddbd13-f959-4c1b-85d3-afd183f81227 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:40.033891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecddbd13-f959-4c1b-85d3-afd183f81227 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:40.034329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecddbd13-f959-4c1b-85d3-afd183f81227 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:40.241418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ecddbd13-f959-4c1b-85d3-afd183f81227 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:40.249379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ecddbd13-f959-4c1b-85d3-afd183f81227 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.228171 May 12 06:58:40.252733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 473/900] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:40 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:40.254483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cfb6fa68-b699-4a80-b501-87d053d262b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:40.255386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cfb6fa68-b699-4a80-b501-87d053d262b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:40.261158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfb6fa68-b699-4a80-b501-87d053d262b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:40.261639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfb6fa68-b699-4a80-b501-87d053d262b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:40.262439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfb6fa68-b699-4a80-b501-87d053d262b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:40.262879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfb6fa68-b699-4a80-b501-87d053d262b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:40.291041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cfb6fa68-b699-4a80-b501-87d053d262b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040131 May 12 06:58:40.292944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 474/901] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:40 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:40.834360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-8a21d449-333b-40b1-88f7-eb015fc1cf1a req-58d25231-1c65-4953-99f7-e11d65e2c5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d32c82-7a33-4e43-b678-1944501fa5df", "tag": "56ed9e0d-5810-4eec-9ff8-9544a2f94571"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 06:58:40.842781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-8a21d449-333b-40b1-88f7-eb015fc1cf1a req-58d25231-1c65-4953-99f7-e11d65e2c5f6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:40.843223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-8a21d449-333b-40b1-88f7-eb015fc1cf1a req-58d25231-1c65-4953-99f7-e11d65e2c5f6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:40.854006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-8a21d449-333b-40b1-88f7-eb015fc1cf1a req-58d25231-1c65-4953-99f7-e11d65e2c5f6 service nova] Creating event network-changed:56ed9e0d-5810-4eec-9ff8-9544a2f94571 for instance 19d32c82-7a33-4e43-b678-1944501fa5df on hv-cinder-76606 May 12 06:58:40.859614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-8a21d449-333b-40b1-88f7-eb015fc1cf1a req-58d25231-1c65-4953-99f7-e11d65e2c5f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081399 May 12 06:58:40.860310 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 475/902] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 06:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:58:41.268473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9d6f7841-b2bd-4230-920b-0ddf19b26cad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:41.269209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9d6f7841-b2bd-4230-920b-0ddf19b26cad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:41.275616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d6f7841-b2bd-4230-920b-0ddf19b26cad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:41.276174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d6f7841-b2bd-4230-920b-0ddf19b26cad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:41.276907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d6f7841-b2bd-4230-920b-0ddf19b26cad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:41.277376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d6f7841-b2bd-4230-920b-0ddf19b26cad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:41.419310 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9d6f7841-b2bd-4230-920b-0ddf19b26cad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:41.427395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9d6f7841-b2bd-4230-920b-0ddf19b26cad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.164253 May 12 06:58:41.427990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 476/903] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:41 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:41.432889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3cd5bbea-7641-4dd2-920e-ec303436b546 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:41.433763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3cd5bbea-7641-4dd2-920e-ec303436b546 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:41.439946 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cd5bbea-7641-4dd2-920e-ec303436b546 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:41.440392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cd5bbea-7641-4dd2-920e-ec303436b546 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:41.441151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cd5bbea-7641-4dd2-920e-ec303436b546 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:41.441584 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cd5bbea-7641-4dd2-920e-ec303436b546 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:41.471292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3cd5bbea-7641-4dd2-920e-ec303436b546 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042239 May 12 06:58:41.472104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 477/904] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:41 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:42.445215 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a2768cce-d3eb-4117-ada9-d4f6875fa22d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:42.445835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a2768cce-d3eb-4117-ada9-d4f6875fa22d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:42.452066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2768cce-d3eb-4117-ada9-d4f6875fa22d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:42.452520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2768cce-d3eb-4117-ada9-d4f6875fa22d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:42.453276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2768cce-d3eb-4117-ada9-d4f6875fa22d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:42.453711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2768cce-d3eb-4117-ada9-d4f6875fa22d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:42.582146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a2768cce-d3eb-4117-ada9-d4f6875fa22d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:42.589490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a2768cce-d3eb-4117-ada9-d4f6875fa22d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148131 May 12 06:58:42.590062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 478/905] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:42 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:42.595213 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7dbface5-bb3d-4599-9507-a9253e130635 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:42.596140 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7dbface5-bb3d-4599-9507-a9253e130635 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:42.601721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dbface5-bb3d-4599-9507-a9253e130635 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:42.602171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dbface5-bb3d-4599-9507-a9253e130635 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:42.602944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dbface5-bb3d-4599-9507-a9253e130635 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:42.603383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dbface5-bb3d-4599-9507-a9253e130635 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:42.631377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7dbface5-bb3d-4599-9507-a9253e130635 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040349 May 12 06:58:42.631955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 479/906] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:42 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:43.606826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b6194c49-8c04-4c11-8631-abe57bd544b5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:43.607558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b6194c49-8c04-4c11-8631-abe57bd544b5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:43.613811 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6194c49-8c04-4c11-8631-abe57bd544b5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:43.614252 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6194c49-8c04-4c11-8631-abe57bd544b5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:43.615010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6194c49-8c04-4c11-8631-abe57bd544b5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:43.615441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6194c49-8c04-4c11-8631-abe57bd544b5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:43.740929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b6194c49-8c04-4c11-8631-abe57bd544b5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:43.748380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b6194c49-8c04-4c11-8631-abe57bd544b5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145275 May 12 06:58:43.748943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 480/907] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:43 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:43.753414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d7040e06-efb8-434c-9a29-4b952f6eb937 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:43.754308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d7040e06-efb8-434c-9a29-4b952f6eb937 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:43.759837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7040e06-efb8-434c-9a29-4b952f6eb937 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:43.760292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7040e06-efb8-434c-9a29-4b952f6eb937 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:43.761063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7040e06-efb8-434c-9a29-4b952f6eb937 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:43.761504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7040e06-efb8-434c-9a29-4b952f6eb937 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:43.791974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d7040e06-efb8-434c-9a29-4b952f6eb937 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041989 May 12 06:58:43.792529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 481/908] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:43 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:44.764786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6bfd2529-25e6-49e3-9eb9-fffc979264f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:44.765427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6bfd2529-25e6-49e3-9eb9-fffc979264f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:44.771835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bfd2529-25e6-49e3-9eb9-fffc979264f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:44.772284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bfd2529-25e6-49e3-9eb9-fffc979264f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:44.773051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bfd2529-25e6-49e3-9eb9-fffc979264f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:44.773486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bfd2529-25e6-49e3-9eb9-fffc979264f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:44.898767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6bfd2529-25e6-49e3-9eb9-fffc979264f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:44.906677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6bfd2529-25e6-49e3-9eb9-fffc979264f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145284 May 12 06:58:44.907292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 482/909] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:44 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:44.911880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ee6afe2f-5c87-4104-96c5-69eb6286aede tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:44.912786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ee6afe2f-5c87-4104-96c5-69eb6286aede tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:44.918186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee6afe2f-5c87-4104-96c5-69eb6286aede tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:44.918637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee6afe2f-5c87-4104-96c5-69eb6286aede tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:44.919495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee6afe2f-5c87-4104-96c5-69eb6286aede tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:44.919962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee6afe2f-5c87-4104-96c5-69eb6286aede tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:44.948300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ee6afe2f-5c87-4104-96c5-69eb6286aede tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040005 May 12 06:58:44.948846 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 483/910] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:44 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:45.923092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0e180bd7-d039-40ad-8f3a-a515ba9b6515 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:45.923802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0e180bd7-d039-40ad-8f3a-a515ba9b6515 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:45.930004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e180bd7-d039-40ad-8f3a-a515ba9b6515 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:45.930454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e180bd7-d039-40ad-8f3a-a515ba9b6515 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:45.931225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e180bd7-d039-40ad-8f3a-a515ba9b6515 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:45.931663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e180bd7-d039-40ad-8f3a-a515ba9b6515 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:46.065518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0e180bd7-d039-40ad-8f3a-a515ba9b6515 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:46.072907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0e180bd7-d039-40ad-8f3a-a515ba9b6515 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.154057 May 12 06:58:46.073614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 484/911] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:45 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:46.078741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-52799af5-8766-450b-9ffa-3e60a4e4debd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:46.079638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-52799af5-8766-450b-9ffa-3e60a4e4debd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:46.085195 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52799af5-8766-450b-9ffa-3e60a4e4debd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:46.085644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52799af5-8766-450b-9ffa-3e60a4e4debd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:46.086410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52799af5-8766-450b-9ffa-3e60a4e4debd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:46.086848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-52799af5-8766-450b-9ffa-3e60a4e4debd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:46.115102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-52799af5-8766-450b-9ffa-3e60a4e4debd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040417 May 12 06:58:46.115733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 485/912] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:46 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:47.090578 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c5816c18-184f-4071-b431-d1c00a6f595f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:47.091199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c5816c18-184f-4071-b431-d1c00a6f595f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:47.098090 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5816c18-184f-4071-b431-d1c00a6f595f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:47.098549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5816c18-184f-4071-b431-d1c00a6f595f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:47.099365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5816c18-184f-4071-b431-d1c00a6f595f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:47.099833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5816c18-184f-4071-b431-d1c00a6f595f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:47.227382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c5816c18-184f-4071-b431-d1c00a6f595f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:47.234770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c5816c18-184f-4071-b431-d1c00a6f595f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148072 May 12 06:58:47.235335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 486/913] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:47 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:47.239847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0cd5b8d5-ae4a-4aab-b97c-c263a2893c76 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:47.240749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0cd5b8d5-ae4a-4aab-b97c-c263a2893c76 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:47.246608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cd5b8d5-ae4a-4aab-b97c-c263a2893c76 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:47.246996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cd5b8d5-ae4a-4aab-b97c-c263a2893c76 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:47.247793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cd5b8d5-ae4a-4aab-b97c-c263a2893c76 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:47.248318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cd5b8d5-ae4a-4aab-b97c-c263a2893c76 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:47.276534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0cd5b8d5-ae4a-4aab-b97c-c263a2893c76 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040172 May 12 06:58:47.277077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 487/914] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:47 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:48.251823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5ce782bb-aa7b-4a70-9db7-40074d07b13b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:48.252464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5ce782bb-aa7b-4a70-9db7-40074d07b13b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:48.258840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ce782bb-aa7b-4a70-9db7-40074d07b13b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:48.259291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ce782bb-aa7b-4a70-9db7-40074d07b13b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:48.260095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ce782bb-aa7b-4a70-9db7-40074d07b13b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:48.260906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ce782bb-aa7b-4a70-9db7-40074d07b13b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:48.390822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5ce782bb-aa7b-4a70-9db7-40074d07b13b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:48.398313 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5ce782bb-aa7b-4a70-9db7-40074d07b13b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150977 May 12 06:58:48.398874 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 488/915] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:48 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:48.403365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-db5d4d2a-972f-4b8a-a5ad-389fe9b32ca5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:48.404294 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-db5d4d2a-972f-4b8a-a5ad-389fe9b32ca5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:48.410228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db5d4d2a-972f-4b8a-a5ad-389fe9b32ca5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:48.410676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db5d4d2a-972f-4b8a-a5ad-389fe9b32ca5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:48.411443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db5d4d2a-972f-4b8a-a5ad-389fe9b32ca5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:48.411915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db5d4d2a-972f-4b8a-a5ad-389fe9b32ca5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:48.440332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-db5d4d2a-972f-4b8a-a5ad-389fe9b32ca5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040488 May 12 06:58:48.440875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 489/916] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:48 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:49.415915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4dce5ff3-a778-4fc5-abce-301d14b5b9e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:49.416545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4dce5ff3-a778-4fc5-abce-301d14b5b9e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:49.423545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4dce5ff3-a778-4fc5-abce-301d14b5b9e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:49.424020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4dce5ff3-a778-4fc5-abce-301d14b5b9e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:49.424782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4dce5ff3-a778-4fc5-abce-301d14b5b9e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:49.425223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4dce5ff3-a778-4fc5-abce-301d14b5b9e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:49.550575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4dce5ff3-a778-4fc5-abce-301d14b5b9e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:49.557822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4dce5ff3-a778-4fc5-abce-301d14b5b9e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145896 May 12 06:58:49.558380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 490/917] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:49 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:49.563441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9205a348-08d8-4753-83c5-8911ab6eb520 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:49.564363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9205a348-08d8-4753-83c5-8911ab6eb520 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:49.569754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9205a348-08d8-4753-83c5-8911ab6eb520 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:49.570203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9205a348-08d8-4753-83c5-8911ab6eb520 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:49.570983 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9205a348-08d8-4753-83c5-8911ab6eb520 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:49.571419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9205a348-08d8-4753-83c5-8911ab6eb520 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:49.598603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9205a348-08d8-4753-83c5-8911ab6eb520 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039260 May 12 06:58:49.599135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 491/918] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:49 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:50.574288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-462e3035-dc82-4a92-991b-02559706442f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:50.574928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-462e3035-dc82-4a92-991b-02559706442f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:50.581326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-462e3035-dc82-4a92-991b-02559706442f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:50.581777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-462e3035-dc82-4a92-991b-02559706442f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:50.582545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-462e3035-dc82-4a92-991b-02559706442f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:50.582981 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-462e3035-dc82-4a92-991b-02559706442f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:50.710487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-462e3035-dc82-4a92-991b-02559706442f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:50.717790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-462e3035-dc82-4a92-991b-02559706442f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147386 May 12 06:58:50.718964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 492/919] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:50 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:50.723439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-93f4144a-72bf-4236-b990-21929f960bbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:50.724360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-93f4144a-72bf-4236-b990-21929f960bbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:50.729697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93f4144a-72bf-4236-b990-21929f960bbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:50.730152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93f4144a-72bf-4236-b990-21929f960bbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:50.730918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93f4144a-72bf-4236-b990-21929f960bbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:50.731359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93f4144a-72bf-4236-b990-21929f960bbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:50.758780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-93f4144a-72bf-4236-b990-21929f960bbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038848 May 12 06:58:50.759316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 493/920] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:50 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:51.736069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-eb162eef-2af6-4f35-90a1-64fde31e699d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:51.736737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-eb162eef-2af6-4f35-90a1-64fde31e699d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:51.742948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb162eef-2af6-4f35-90a1-64fde31e699d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:51.743402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb162eef-2af6-4f35-90a1-64fde31e699d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:51.744201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb162eef-2af6-4f35-90a1-64fde31e699d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:51.744642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb162eef-2af6-4f35-90a1-64fde31e699d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:51.872715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eb162eef-2af6-4f35-90a1-64fde31e699d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:51.880103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-eb162eef-2af6-4f35-90a1-64fde31e699d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148595 May 12 06:58:51.880709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 494/921] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:51 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:51.885493 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fa10efaa-db37-4e97-b2e1-7b46230e876c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:51.886396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fa10efaa-db37-4e97-b2e1-7b46230e876c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:51.892154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fa10efaa-db37-4e97-b2e1-7b46230e876c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:51.892607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fa10efaa-db37-4e97-b2e1-7b46230e876c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:51.893373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fa10efaa-db37-4e97-b2e1-7b46230e876c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:51.893813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fa10efaa-db37-4e97-b2e1-7b46230e876c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:51.922839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fa10efaa-db37-4e97-b2e1-7b46230e876c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041114 May 12 06:58:51.923437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 495/922] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:51 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:52.897117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a9e08d87-a336-4215-b05f-662c51bc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:52.897737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a9e08d87-a336-4215-b05f-662c51bc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:52.904080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9e08d87-a336-4215-b05f-662c51bc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:52.904646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9e08d87-a336-4215-b05f-662c51bc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:52.905422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9e08d87-a336-4215-b05f-662c51bc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:52.906445 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9e08d87-a336-4215-b05f-662c51bc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:53.036470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a9e08d87-a336-4215-b05f-662c51bc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:53.043801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a9e08d87-a336-4215-b05f-662c51bc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150495 May 12 06:58:53.044383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 496/923] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:52 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:53.049098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b397427f-7b26-4727-9f85-be3da1adcc84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:53.049990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b397427f-7b26-4727-9f85-be3da1adcc84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:53.055318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b397427f-7b26-4727-9f85-be3da1adcc84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:53.055798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b397427f-7b26-4727-9f85-be3da1adcc84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:53.056561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b397427f-7b26-4727-9f85-be3da1adcc84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:53.056991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b397427f-7b26-4727-9f85-be3da1adcc84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:53.084610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b397427f-7b26-4727-9f85-be3da1adcc84 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039260 May 12 06:58:53.085156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 497/924] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:53 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:54.060668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-29f32c20-0325-44fa-850e-470d3861b208 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:54.062442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-29f32c20-0325-44fa-850e-470d3861b208 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:54.068120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29f32c20-0325-44fa-850e-470d3861b208 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:54.068571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29f32c20-0325-44fa-850e-470d3861b208 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:54.069348 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29f32c20-0325-44fa-850e-470d3861b208 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:54.069789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29f32c20-0325-44fa-850e-470d3861b208 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:54.200243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-29f32c20-0325-44fa-850e-470d3861b208 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:54.208105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-29f32c20-0325-44fa-850e-470d3861b208 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.151258 May 12 06:58:54.208665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 498/925] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:54 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:54.213143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-66c7c266-f55e-4d89-9439-a8d42e40d338 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:54.214070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-66c7c266-f55e-4d89-9439-a8d42e40d338 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:54.219452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66c7c266-f55e-4d89-9439-a8d42e40d338 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:54.219941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66c7c266-f55e-4d89-9439-a8d42e40d338 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:54.220705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66c7c266-f55e-4d89-9439-a8d42e40d338 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:54.221144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66c7c266-f55e-4d89-9439-a8d42e40d338 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:54.248597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-66c7c266-f55e-4d89-9439-a8d42e40d338 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038910 May 12 06:58:54.249078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 499/926] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:54 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:55.224534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4bd68215-a4e1-4760-8c66-810ed75e370f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:55.225259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4bd68215-a4e1-4760-8c66-810ed75e370f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:55.231387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bd68215-a4e1-4760-8c66-810ed75e370f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:55.231882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bd68215-a4e1-4760-8c66-810ed75e370f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:55.232653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bd68215-a4e1-4760-8c66-810ed75e370f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:55.233090 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bd68215-a4e1-4760-8c66-810ed75e370f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:55.359630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4bd68215-a4e1-4760-8c66-810ed75e370f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:55.366997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4bd68215-a4e1-4760-8c66-810ed75e370f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146351 May 12 06:58:55.367566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 500/927] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:55 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:55.372687 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-50c261a1-2f21-4f03-8c3e-a7f52d4e878f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:55.373617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-50c261a1-2f21-4f03-8c3e-a7f52d4e878f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:55.379137 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50c261a1-2f21-4f03-8c3e-a7f52d4e878f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:55.379587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50c261a1-2f21-4f03-8c3e-a7f52d4e878f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:55.380400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50c261a1-2f21-4f03-8c3e-a7f52d4e878f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:55.380821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50c261a1-2f21-4f03-8c3e-a7f52d4e878f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:55.409344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-50c261a1-2f21-4f03-8c3e-a7f52d4e878f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040796 May 12 06:58:55.409890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 501/928] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:55 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:56.385574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ef86c8fb-4606-443e-a811-90dc86c4a51a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:56.386204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ef86c8fb-4606-443e-a811-90dc86c4a51a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:56.393135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef86c8fb-4606-443e-a811-90dc86c4a51a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:56.393586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef86c8fb-4606-443e-a811-90dc86c4a51a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:56.394344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef86c8fb-4606-443e-a811-90dc86c4a51a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:56.394778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef86c8fb-4606-443e-a811-90dc86c4a51a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:56.523340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ef86c8fb-4606-443e-a811-90dc86c4a51a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:56.530700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ef86c8fb-4606-443e-a811-90dc86c4a51a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149043 May 12 06:58:56.531256 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 502/929] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:56 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:56.535891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e0be072f-92fe-4e2b-b1b1-075c23746d40 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:56.536788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e0be072f-92fe-4e2b-b1b1-075c23746d40 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:56.542166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e0be072f-92fe-4e2b-b1b1-075c23746d40 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:56.542615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e0be072f-92fe-4e2b-b1b1-075c23746d40 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:56.543379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e0be072f-92fe-4e2b-b1b1-075c23746d40 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:56.543858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e0be072f-92fe-4e2b-b1b1-075c23746d40 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:56.571873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e0be072f-92fe-4e2b-b1b1-075c23746d40 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039588 May 12 06:58:56.572415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 503/930] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:56 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:57.547673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-efa93968-19a0-40c8-b34f-acc8beb8471d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:57.548342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-efa93968-19a0-40c8-b34f-acc8beb8471d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:57.554630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efa93968-19a0-40c8-b34f-acc8beb8471d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:57.555078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efa93968-19a0-40c8-b34f-acc8beb8471d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:57.555888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efa93968-19a0-40c8-b34f-acc8beb8471d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:57.556331 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efa93968-19a0-40c8-b34f-acc8beb8471d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:57.682188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-efa93968-19a0-40c8-b34f-acc8beb8471d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:57.689494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-efa93968-19a0-40c8-b34f-acc8beb8471d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145956 May 12 06:58:57.690060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 504/931] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:57 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:57.694713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-94dfa4da-37f2-4da1-9132-be5aa04da11b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:57.695620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-94dfa4da-37f2-4da1-9132-be5aa04da11b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:57.701054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-94dfa4da-37f2-4da1-9132-be5aa04da11b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:57.701502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-94dfa4da-37f2-4da1-9132-be5aa04da11b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:57.702267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-94dfa4da-37f2-4da1-9132-be5aa04da11b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:57.703205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-94dfa4da-37f2-4da1-9132-be5aa04da11b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:57.732089 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-94dfa4da-37f2-4da1-9132-be5aa04da11b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040926 May 12 06:58:57.732631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 505/932] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:57 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:58.706732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-448f074e-0d36-474a-92a2-343aa05ed830 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:58.707350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-448f074e-0d36-474a-92a2-343aa05ed830 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:58.713714 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-448f074e-0d36-474a-92a2-343aa05ed830 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:58.714166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-448f074e-0d36-474a-92a2-343aa05ed830 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:58.714934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-448f074e-0d36-474a-92a2-343aa05ed830 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:58.715374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-448f074e-0d36-474a-92a2-343aa05ed830 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:58.841323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-448f074e-0d36-474a-92a2-343aa05ed830 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:58:58.848797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-448f074e-0d36-474a-92a2-343aa05ed830 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146559 May 12 06:58:58.849363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 506/933] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:58 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:58:58.853830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f61a21c8-c424-4cf0-970f-56bdda46b312 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:58.854737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f61a21c8-c424-4cf0-970f-56bdda46b312 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:58.860604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f61a21c8-c424-4cf0-970f-56bdda46b312 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:58.861054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f61a21c8-c424-4cf0-970f-56bdda46b312 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:58.861818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f61a21c8-c424-4cf0-970f-56bdda46b312 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:58.862255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f61a21c8-c424-4cf0-970f-56bdda46b312 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:58.890312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f61a21c8-c424-4cf0-970f-56bdda46b312 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039980 May 12 06:58:58.890852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 507/934] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:58:58 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:58:59.865924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-88f727a7-a711-40ee-9397-1080443247e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:58:59.866589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-88f727a7-a711-40ee-9397-1080443247e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:58:59.872878 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88f727a7-a711-40ee-9397-1080443247e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:59.873330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88f727a7-a711-40ee-9397-1080443247e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:58:59.874105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88f727a7-a711-40ee-9397-1080443247e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:58:59.874544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88f727a7-a711-40ee-9397-1080443247e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:00.006818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-88f727a7-a711-40ee-9397-1080443247e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:00.014161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-88f727a7-a711-40ee-9397-1080443247e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.152127 May 12 06:59:00.014722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 508/935] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:58:59 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:00.019169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-991be925-0b3f-46ed-8fe8-494b703ed87a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:00.020118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-991be925-0b3f-46ed-8fe8-494b703ed87a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:00.025505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-991be925-0b3f-46ed-8fe8-494b703ed87a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:00.025948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-991be925-0b3f-46ed-8fe8-494b703ed87a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:00.026719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-991be925-0b3f-46ed-8fe8-494b703ed87a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:00.027157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-991be925-0b3f-46ed-8fe8-494b703ed87a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:00.056418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-991be925-0b3f-46ed-8fe8-494b703ed87a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040685 May 12 06:59:00.056969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 509/936] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:00 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:01.030451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8734eb93-9d1d-4a53-95c1-2deabdc2b2be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:01.031094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8734eb93-9d1d-4a53-95c1-2deabdc2b2be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:01.037574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8734eb93-9d1d-4a53-95c1-2deabdc2b2be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:01.038023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8734eb93-9d1d-4a53-95c1-2deabdc2b2be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:01.038794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8734eb93-9d1d-4a53-95c1-2deabdc2b2be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:01.039235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8734eb93-9d1d-4a53-95c1-2deabdc2b2be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:01.167080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8734eb93-9d1d-4a53-95c1-2deabdc2b2be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:01.174625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8734eb93-9d1d-4a53-95c1-2deabdc2b2be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148182 May 12 06:59:01.175184 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 510/937] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:01 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:01.179819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0863d927-d3f0-4314-9c19-fe9a75e2a2a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:01.180716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0863d927-d3f0-4314-9c19-fe9a75e2a2a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:01.186322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0863d927-d3f0-4314-9c19-fe9a75e2a2a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:01.186758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0863d927-d3f0-4314-9c19-fe9a75e2a2a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:01.187533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0863d927-d3f0-4314-9c19-fe9a75e2a2a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:01.188004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0863d927-d3f0-4314-9c19-fe9a75e2a2a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:01.216591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0863d927-d3f0-4314-9c19-fe9a75e2a2a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040429 May 12 06:59:01.217138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 511/938] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:01 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:02.191536 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b3d94232-c843-450d-9331-7859fdd14101 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:02.192220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b3d94232-c843-450d-9331-7859fdd14101 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:02.198427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3d94232-c843-450d-9331-7859fdd14101 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:02.198864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3d94232-c843-450d-9331-7859fdd14101 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:02.199631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3d94232-c843-450d-9331-7859fdd14101 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:02.200094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3d94232-c843-450d-9331-7859fdd14101 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:02.329224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b3d94232-c843-450d-9331-7859fdd14101 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:02.337236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b3d94232-c843-450d-9331-7859fdd14101 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149603 May 12 06:59:02.337808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 512/939] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:02 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:02.342488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b8b6db35-dc57-435e-9def-c6aa3f1a230d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:02.343389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b8b6db35-dc57-435e-9def-c6aa3f1a230d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:02.349489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8b6db35-dc57-435e-9def-c6aa3f1a230d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:02.349948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8b6db35-dc57-435e-9def-c6aa3f1a230d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:02.350713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8b6db35-dc57-435e-9def-c6aa3f1a230d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:02.351153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8b6db35-dc57-435e-9def-c6aa3f1a230d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:02.378440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b8b6db35-dc57-435e-9def-c6aa3f1a230d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039663 May 12 06:59:02.378982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 513/940] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:02 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:03.042476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-8361654c-c077-4692-8baf-56e7c3e3a27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'services' on Instance uuid d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 06:59:03.354223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5112c6d0-3bea-4b43-baf6-203c49fc9b57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:03.354744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5112c6d0-3bea-4b43-baf6-203c49fc9b57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:03.361046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5112c6d0-3bea-4b43-baf6-203c49fc9b57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:03.361490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5112c6d0-3bea-4b43-baf6-203c49fc9b57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:03.362839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5112c6d0-3bea-4b43-baf6-203c49fc9b57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:03.363271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5112c6d0-3bea-4b43-baf6-203c49fc9b57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:03.500072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5112c6d0-3bea-4b43-baf6-203c49fc9b57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:03.507289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5112c6d0-3bea-4b43-baf6-203c49fc9b57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.156947 May 12 06:59:03.507875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 514/941] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:03 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:03.512462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-edc02247-acb8-4834-a2f5-98396380ed9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:03.513352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-edc02247-acb8-4834-a2f5-98396380ed9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:03.518699 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edc02247-acb8-4834-a2f5-98396380ed9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:03.519143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edc02247-acb8-4834-a2f5-98396380ed9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:03.519965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edc02247-acb8-4834-a2f5-98396380ed9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:03.520398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edc02247-acb8-4834-a2f5-98396380ed9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:03.548403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-edc02247-acb8-4834-a2f5-98396380ed9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039559 May 12 06:59:03.549546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 515/942] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:04.524412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-57ef4dfe-f5a8-41dc-916e-759d11cf5c47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:04.525061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-57ef4dfe-f5a8-41dc-916e-759d11cf5c47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:04.531409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-57ef4dfe-f5a8-41dc-916e-759d11cf5c47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:04.531887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-57ef4dfe-f5a8-41dc-916e-759d11cf5c47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:04.532699 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-57ef4dfe-f5a8-41dc-916e-759d11cf5c47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:04.533138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-57ef4dfe-f5a8-41dc-916e-759d11cf5c47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:04.659845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-57ef4dfe-f5a8-41dc-916e-759d11cf5c47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:04.667647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-57ef4dfe-f5a8-41dc-916e-759d11cf5c47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147153 May 12 06:59:04.668581 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 516/943] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:04.673688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-34d6f9c0-f674-42ce-b72d-849cc26457ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:04.676154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-34d6f9c0-f674-42ce-b72d-849cc26457ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:04.680889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34d6f9c0-f674-42ce-b72d-849cc26457ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:04.682392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34d6f9c0-f674-42ce-b72d-849cc26457ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:04.682392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34d6f9c0-f674-42ce-b72d-849cc26457ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:04.682572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34d6f9c0-f674-42ce-b72d-849cc26457ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:04.712047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-34d6f9c0-f674-42ce-b72d-849cc26457ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042564 May 12 06:59:04.712591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 517/944] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:04 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:05.685417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b6af14a2-cb20-4b0e-b7c0-da8d2fa9c613 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:05.686024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b6af14a2-cb20-4b0e-b7c0-da8d2fa9c613 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:05.692843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6af14a2-cb20-4b0e-b7c0-da8d2fa9c613 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:05.693286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6af14a2-cb20-4b0e-b7c0-da8d2fa9c613 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:05.694045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6af14a2-cb20-4b0e-b7c0-da8d2fa9c613 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:05.694478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6af14a2-cb20-4b0e-b7c0-da8d2fa9c613 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:05.824955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b6af14a2-cb20-4b0e-b7c0-da8d2fa9c613 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:05.833079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b6af14a2-cb20-4b0e-b7c0-da8d2fa9c613 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.151545 May 12 06:59:05.841228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 518/945] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:05 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:05.841228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-be7b0a6e-919f-48b6-88d5-dce31573d5e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:05.841228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-be7b0a6e-919f-48b6-88d5-dce31573d5e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:05.844444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-be7b0a6e-919f-48b6-88d5-dce31573d5e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:05.844887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-be7b0a6e-919f-48b6-88d5-dce31573d5e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:05.845646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-be7b0a6e-919f-48b6-88d5-dce31573d5e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:05.846077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-be7b0a6e-919f-48b6-88d5-dce31573d5e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:05.874009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-be7b0a6e-919f-48b6-88d5-dce31573d5e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039304 May 12 06:59:05.874493 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 519/946] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:05 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:06.850183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e6131323-eb36-4e59-a9dd-a3bf58cc2719 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:06.854708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e6131323-eb36-4e59-a9dd-a3bf58cc2719 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:06.857145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6131323-eb36-4e59-a9dd-a3bf58cc2719 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:06.857593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6131323-eb36-4e59-a9dd-a3bf58cc2719 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:06.858351 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6131323-eb36-4e59-a9dd-a3bf58cc2719 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:06.858782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6131323-eb36-4e59-a9dd-a3bf58cc2719 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:06.985704 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e6131323-eb36-4e59-a9dd-a3bf58cc2719 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:06.993342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e6131323-eb36-4e59-a9dd-a3bf58cc2719 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147611 May 12 06:59:06.994118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 520/947] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:06 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:06.998397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4505f6ec-cdfe-462b-93a6-e04c2f94e903 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:06.999344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4505f6ec-cdfe-462b-93a6-e04c2f94e903 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:07.004979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4505f6ec-cdfe-462b-93a6-e04c2f94e903 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:07.005428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4505f6ec-cdfe-462b-93a6-e04c2f94e903 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:07.006199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4505f6ec-cdfe-462b-93a6-e04c2f94e903 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:07.006634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4505f6ec-cdfe-462b-93a6-e04c2f94e903 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:07.036147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4505f6ec-cdfe-462b-93a6-e04c2f94e903 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041256 May 12 06:59:07.036691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 521/948] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:06 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:08.010272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7430700d-a926-47fc-b9b9-79e640db77fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:08.010911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7430700d-a926-47fc-b9b9-79e640db77fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:08.017161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7430700d-a926-47fc-b9b9-79e640db77fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:08.017608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7430700d-a926-47fc-b9b9-79e640db77fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:08.018367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7430700d-a926-47fc-b9b9-79e640db77fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:08.018800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7430700d-a926-47fc-b9b9-79e640db77fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:08.151301 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7430700d-a926-47fc-b9b9-79e640db77fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:08.158662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7430700d-a926-47fc-b9b9-79e640db77fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.152260 May 12 06:59:08.159895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 522/949] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:08 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:08.164451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b050e0b5-7291-47a3-b00b-5b49aae2c6a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:08.165347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b050e0b5-7291-47a3-b00b-5b49aae2c6a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:08.171033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b050e0b5-7291-47a3-b00b-5b49aae2c6a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:08.171483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b050e0b5-7291-47a3-b00b-5b49aae2c6a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:08.172553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b050e0b5-7291-47a3-b00b-5b49aae2c6a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:08.172986 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b050e0b5-7291-47a3-b00b-5b49aae2c6a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:08.201362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b050e0b5-7291-47a3-b00b-5b49aae2c6a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040449 May 12 06:59:08.201924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 523/950] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:09.176804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2a650daa-7110-4718-b0b2-a2f8b422e628 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:09.177462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2a650daa-7110-4718-b0b2-a2f8b422e628 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:09.183659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a650daa-7110-4718-b0b2-a2f8b422e628 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:09.184134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a650daa-7110-4718-b0b2-a2f8b422e628 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:09.184899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a650daa-7110-4718-b0b2-a2f8b422e628 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:09.185335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a650daa-7110-4718-b0b2-a2f8b422e628 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:09.311412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2a650daa-7110-4718-b0b2-a2f8b422e628 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:09.318765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2a650daa-7110-4718-b0b2-a2f8b422e628 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146413 May 12 06:59:09.319339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 524/951] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:09 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:09.323857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-07720e65-be41-4e24-b9cc-9514311177e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:09.324788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-07720e65-be41-4e24-b9cc-9514311177e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:09.330182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07720e65-be41-4e24-b9cc-9514311177e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:09.330634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07720e65-be41-4e24-b9cc-9514311177e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:09.331403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07720e65-be41-4e24-b9cc-9514311177e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:09.331882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07720e65-be41-4e24-b9cc-9514311177e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:09.361385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-07720e65-be41-4e24-b9cc-9514311177e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041042 May 12 06:59:09.361933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 525/952] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:10.336155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6b99870a-1ad9-4ed1-9342-1abfc72a577e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:10.336844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6b99870a-1ad9-4ed1-9342-1abfc72a577e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:10.343349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b99870a-1ad9-4ed1-9342-1abfc72a577e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:10.345379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b99870a-1ad9-4ed1-9342-1abfc72a577e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:10.345379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b99870a-1ad9-4ed1-9342-1abfc72a577e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:10.345379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b99870a-1ad9-4ed1-9342-1abfc72a577e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:10.473532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6b99870a-1ad9-4ed1-9342-1abfc72a577e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:10.480743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6b99870a-1ad9-4ed1-9342-1abfc72a577e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148479 May 12 06:59:10.481310 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 526/953] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:10 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:10.485746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7967eb17-ded5-40fa-b733-04a8ea408006 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:10.486637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7967eb17-ded5-40fa-b733-04a8ea408006 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:10.492544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7967eb17-ded5-40fa-b733-04a8ea408006 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:10.492992 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7967eb17-ded5-40fa-b733-04a8ea408006 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:10.493753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7967eb17-ded5-40fa-b733-04a8ea408006 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:10.494185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7967eb17-ded5-40fa-b733-04a8ea408006 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:10.521951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7967eb17-ded5-40fa-b733-04a8ea408006 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039685 May 12 06:59:10.522485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 527/954] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:10 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:11.498100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b45eb684-91a4-40f6-a1f9-291e1d39daf3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:11.498743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b45eb684-91a4-40f6-a1f9-291e1d39daf3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:11.504951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b45eb684-91a4-40f6-a1f9-291e1d39daf3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:11.505399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b45eb684-91a4-40f6-a1f9-291e1d39daf3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:11.506161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b45eb684-91a4-40f6-a1f9-291e1d39daf3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:11.506601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b45eb684-91a4-40f6-a1f9-291e1d39daf3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:11.632836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b45eb684-91a4-40f6-a1f9-291e1d39daf3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:11.640036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b45eb684-91a4-40f6-a1f9-291e1d39daf3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145705 May 12 06:59:11.640604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 528/955] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:11 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:11.645571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a212b47f-af8c-4a9b-9e43-508ab01f3022 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:11.646517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a212b47f-af8c-4a9b-9e43-508ab01f3022 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:11.651839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a212b47f-af8c-4a9b-9e43-508ab01f3022 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:11.652309 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a212b47f-af8c-4a9b-9e43-508ab01f3022 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:11.653066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a212b47f-af8c-4a9b-9e43-508ab01f3022 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:11.653496 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a212b47f-af8c-4a9b-9e43-508ab01f3022 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:11.682045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a212b47f-af8c-4a9b-9e43-508ab01f3022 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040485 May 12 06:59:11.682580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 529/956] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:12.657676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cfb3f436-4c8a-4145-8e44-f6dd87518764 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:12.658321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cfb3f436-4c8a-4145-8e44-f6dd87518764 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:12.664575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfb3f436-4c8a-4145-8e44-f6dd87518764 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:12.665019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfb3f436-4c8a-4145-8e44-f6dd87518764 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:12.665784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfb3f436-4c8a-4145-8e44-f6dd87518764 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:12.666218 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfb3f436-4c8a-4145-8e44-f6dd87518764 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:12.792914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cfb3f436-4c8a-4145-8e44-f6dd87518764 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:12.800951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cfb3f436-4c8a-4145-8e44-f6dd87518764 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147102 May 12 06:59:12.801508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 530/957] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:12 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:12.806118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4f424882-4b63-4a70-ae50-31a98be6b309 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:12.807020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4f424882-4b63-4a70-ae50-31a98be6b309 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:12.812394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f424882-4b63-4a70-ae50-31a98be6b309 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:12.812837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f424882-4b63-4a70-ae50-31a98be6b309 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:12.813597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f424882-4b63-4a70-ae50-31a98be6b309 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:12.814033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f424882-4b63-4a70-ae50-31a98be6b309 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:12.842020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4f424882-4b63-4a70-ae50-31a98be6b309 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039554 May 12 06:59:12.842555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 531/958] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:12 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:13.818800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-576ae45d-cb67-4ab3-9a8c-ef58851bddc5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:13.819467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-576ae45d-cb67-4ab3-9a8c-ef58851bddc5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:13.825867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-576ae45d-cb67-4ab3-9a8c-ef58851bddc5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:13.826323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-576ae45d-cb67-4ab3-9a8c-ef58851bddc5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:13.827099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-576ae45d-cb67-4ab3-9a8c-ef58851bddc5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:13.827542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-576ae45d-cb67-4ab3-9a8c-ef58851bddc5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:13.961381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-576ae45d-cb67-4ab3-9a8c-ef58851bddc5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:13.968785 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-576ae45d-cb67-4ab3-9a8c-ef58851bddc5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.154480 May 12 06:59:13.969338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 532/959] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:13 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:13.973803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-748a02c1-bbaa-48ed-b8b0-d74902892fc5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:13.974697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-748a02c1-bbaa-48ed-b8b0-d74902892fc5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:13.980123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-748a02c1-bbaa-48ed-b8b0-d74902892fc5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:13.980572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-748a02c1-bbaa-48ed-b8b0-d74902892fc5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:13.981333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-748a02c1-bbaa-48ed-b8b0-d74902892fc5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:13.981766 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-748a02c1-bbaa-48ed-b8b0-d74902892fc5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:14.011369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-748a02c1-bbaa-48ed-b8b0-d74902892fc5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041040 May 12 06:59:14.011956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 533/960] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:14.599701 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-594a5895-5eea-405b-a099-cba6b4c09b5c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:14.600192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-594a5895-5eea-405b-a099-cba6b4c09b5c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:14.605996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-594a5895-5eea-405b-a099-cba6b4c09b5c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:14.606442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-594a5895-5eea-405b-a099-cba6b4c09b5c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:14.607201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-594a5895-5eea-405b-a099-cba6b4c09b5c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:14.607634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-594a5895-5eea-405b-a099-cba6b4c09b5c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:14.630231 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-594a5895-5eea-405b-a099-cba6b4c09b5c tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df/ips" status: 200 len: 149 microversion: 2.1 time: 0.034891 May 12 06:59:14.630774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 534/961] 10.222.0.25 () {58 vars in 1247 bytes} [Thu May 12 06:59:14 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 06:59:14.985636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-845304ae-13f2-442b-865b-690f0457b6e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:14.986250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-845304ae-13f2-442b-865b-690f0457b6e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:14.993013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-845304ae-13f2-442b-865b-690f0457b6e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:14.993013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-845304ae-13f2-442b-865b-690f0457b6e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:14.993701 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-845304ae-13f2-442b-865b-690f0457b6e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:14.994137 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-845304ae-13f2-442b-865b-690f0457b6e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:15.121464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-845304ae-13f2-442b-865b-690f0457b6e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:15.129381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-845304ae-13f2-442b-865b-690f0457b6e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147662 May 12 06:59:15.129949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 535/962] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:14 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:15.134824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-43ef48f3-bf65-488f-8242-9c5a1760cf9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:15.135746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-43ef48f3-bf65-488f-8242-9c5a1760cf9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:15.141208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43ef48f3-bf65-488f-8242-9c5a1760cf9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:15.141660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43ef48f3-bf65-488f-8242-9c5a1760cf9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:15.142435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43ef48f3-bf65-488f-8242-9c5a1760cf9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:15.142876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43ef48f3-bf65-488f-8242-9c5a1760cf9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:15.170699 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-43ef48f3-bf65-488f-8242-9c5a1760cf9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039665 May 12 06:59:15.171247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 536/963] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:16.146096 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-226a26ea-47c1-4746-8775-699b32d250ce tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:16.146755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-226a26ea-47c1-4746-8775-699b32d250ce tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:16.153003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-226a26ea-47c1-4746-8775-699b32d250ce tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:16.153457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-226a26ea-47c1-4746-8775-699b32d250ce tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:16.154227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-226a26ea-47c1-4746-8775-699b32d250ce tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:16.154667 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-226a26ea-47c1-4746-8775-699b32d250ce tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:16.282142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-226a26ea-47c1-4746-8775-699b32d250ce tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:16.289405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-226a26ea-47c1-4746-8775-699b32d250ce tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147783 May 12 06:59:16.289973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 537/964] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:16 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:16.294562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c6052584-9222-4f80-806b-2c993956a49b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:16.295462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c6052584-9222-4f80-806b-2c993956a49b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:16.301203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6052584-9222-4f80-806b-2c993956a49b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:16.301651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6052584-9222-4f80-806b-2c993956a49b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:16.302428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6052584-9222-4f80-806b-2c993956a49b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:16.302864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6052584-9222-4f80-806b-2c993956a49b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:16.332384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c6052584-9222-4f80-806b-2c993956a49b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041391 May 12 06:59:16.332949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 538/965] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:17.306550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-04a8db85-357a-4834-b87d-744d1654120a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:17.307172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-04a8db85-357a-4834-b87d-744d1654120a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:17.313429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a8db85-357a-4834-b87d-744d1654120a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:17.313883 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a8db85-357a-4834-b87d-744d1654120a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:17.314655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a8db85-357a-4834-b87d-744d1654120a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:17.315098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04a8db85-357a-4834-b87d-744d1654120a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:17.441117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-04a8db85-357a-4834-b87d-744d1654120a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:17.448583 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-04a8db85-357a-4834-b87d-744d1654120a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146009 May 12 06:59:17.449152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 539/966] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:17 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:17.453651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-351c71c3-2c75-4ae0-841b-4f2999d06815 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:17.454556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-351c71c3-2c75-4ae0-841b-4f2999d06815 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:17.460430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-351c71c3-2c75-4ae0-841b-4f2999d06815 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:17.460885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-351c71c3-2c75-4ae0-841b-4f2999d06815 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:17.461655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-351c71c3-2c75-4ae0-841b-4f2999d06815 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:17.462095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-351c71c3-2c75-4ae0-841b-4f2999d06815 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:17.490228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-351c71c3-2c75-4ae0-841b-4f2999d06815 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040099 May 12 06:59:17.490770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 540/967] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:17 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:18.465954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-14b67ca6-2e02-40af-b32b-33634af7c019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:18.466589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-14b67ca6-2e02-40af-b32b-33634af7c019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:18.473464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14b67ca6-2e02-40af-b32b-33634af7c019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:18.473912 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14b67ca6-2e02-40af-b32b-33634af7c019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:18.474688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14b67ca6-2e02-40af-b32b-33634af7c019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:18.475122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14b67ca6-2e02-40af-b32b-33634af7c019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:18.601602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-14b67ca6-2e02-40af-b32b-33634af7c019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:18.608823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-14b67ca6-2e02-40af-b32b-33634af7c019 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146809 May 12 06:59:18.609384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 541/968] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:18 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:18.613944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9ed33d39-4cd8-462b-b8d6-8f6c24db4da6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:18.614835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9ed33d39-4cd8-462b-b8d6-8f6c24db4da6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:18.620173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9ed33d39-4cd8-462b-b8d6-8f6c24db4da6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:18.620617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9ed33d39-4cd8-462b-b8d6-8f6c24db4da6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:18.621378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9ed33d39-4cd8-462b-b8d6-8f6c24db4da6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:18.621805 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9ed33d39-4cd8-462b-b8d6-8f6c24db4da6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:18.650081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9ed33d39-4cd8-462b-b8d6-8f6c24db4da6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039692 May 12 06:59:18.650628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 542/969] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:19.624998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2097748f-247b-4889-841c-4a2227ed5772 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:19.625650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2097748f-247b-4889-841c-4a2227ed5772 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:19.632513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2097748f-247b-4889-841c-4a2227ed5772 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:19.632962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2097748f-247b-4889-841c-4a2227ed5772 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:19.633718 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2097748f-247b-4889-841c-4a2227ed5772 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:19.634151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2097748f-247b-4889-841c-4a2227ed5772 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:19.763240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2097748f-247b-4889-841c-4a2227ed5772 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:19.771119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2097748f-247b-4889-841c-4a2227ed5772 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149975 May 12 06:59:19.771706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 543/970] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:19 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:19.776236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4bbba07f-646f-4513-b5c5-abe583e6da26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:19.777129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4bbba07f-646f-4513-b5c5-abe583e6da26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:19.782424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bbba07f-646f-4513-b5c5-abe583e6da26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:19.782867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bbba07f-646f-4513-b5c5-abe583e6da26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:19.783623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bbba07f-646f-4513-b5c5-abe583e6da26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:19.784079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bbba07f-646f-4513-b5c5-abe583e6da26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:19.811877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4bbba07f-646f-4513-b5c5-abe583e6da26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039161 May 12 06:59:19.812419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 544/971] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:19 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:20.788525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-69516aa0-ac47-43cf-8dba-755d22d4f21b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:20.789149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-69516aa0-ac47-43cf-8dba-755d22d4f21b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:20.795462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69516aa0-ac47-43cf-8dba-755d22d4f21b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:20.795958 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69516aa0-ac47-43cf-8dba-755d22d4f21b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:20.796984 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69516aa0-ac47-43cf-8dba-755d22d4f21b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:20.797426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69516aa0-ac47-43cf-8dba-755d22d4f21b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:20.924016 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-69516aa0-ac47-43cf-8dba-755d22d4f21b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 06:59:20.931379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-69516aa0-ac47-43cf-8dba-755d22d4f21b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147214 May 12 06:59:20.931981 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 545/972] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 06:59:20 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 06:59:20.936554 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9e6fdda0-89be-4e0c-a50b-c8c767ce87c5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:20.937454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9e6fdda0-89be-4e0c-a50b-c8c767ce87c5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:20.943099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e6fdda0-89be-4e0c-a50b-c8c767ce87c5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:20.943555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e6fdda0-89be-4e0c-a50b-c8c767ce87c5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:20.944353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e6fdda0-89be-4e0c-a50b-c8c767ce87c5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:20.944791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e6fdda0-89be-4e0c-a50b-c8c767ce87c5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:20.973339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9e6fdda0-89be-4e0c-a50b-c8c767ce87c5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040334 May 12 06:59:20.974531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 546/973] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 06:59:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 06:59:21.625347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0907dfab-40e4-4c82-b2a0-1ede9c2ae64c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 06:59:21.625840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0907dfab-40e4-4c82-b2a0-1ede9c2ae64c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 06:59:21.632366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0907dfab-40e4-4c82-b2a0-1ede9c2ae64c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:21.632819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0907dfab-40e4-4c82-b2a0-1ede9c2ae64c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 06:59:21.633587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0907dfab-40e4-4c82-b2a0-1ede9c2ae64c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 06:59:21.634012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0907dfab-40e4-4c82-b2a0-1ede9c2ae64c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:00:00.991316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:00:00.991975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:00:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c (ip 10.222.0.25) !!! May 12 07:00:21.796627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8361654c-c077-4692-8baf-56e7c3e3a27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c" status: 202 len: 0 microversion: 2.1 time: 120.214698 May 12 07:00:21.797693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 428/974] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 06:58:21 2022] DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c => generated 0 bytes in 120217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:00:21.803423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-92e96953-90a6-47cc-a4ef-d75e1c9f46f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:00:21.804140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-92e96953-90a6-47cc-a4ef-d75e1c9f46f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:00:21.812507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92e96953-90a6-47cc-a4ef-d75e1c9f46f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:00:21.812954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92e96953-90a6-47cc-a4ef-d75e1c9f46f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:00:21.813751 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92e96953-90a6-47cc-a4ef-d75e1c9f46f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:00:21.814192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92e96953-90a6-47cc-a4ef-d75e1c9f46f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:00:21.951481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-92e96953-90a6-47cc-a4ef-d75e1c9f46f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:00:21.958923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-92e96953-90a6-47cc-a4ef-d75e1c9f46f1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.160124 May 12 07:00:21.959715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 429/975] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:00:21 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:00:21.973134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-00dc2de9-f332-430b-a168-8476aa3d1370 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:00:21.974118 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-00dc2de9-f332-430b-a168-8476aa3d1370 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:00:21.980067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00dc2de9-f332-430b-a168-8476aa3d1370 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:00:21.980518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00dc2de9-f332-430b-a168-8476aa3d1370 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:00:21.981444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00dc2de9-f332-430b-a168-8476aa3d1370 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:00:21.981888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00dc2de9-f332-430b-a168-8476aa3d1370 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:00:22.012301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-00dc2de9-f332-430b-a168-8476aa3d1370 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043035 May 12 07:00:22.012854 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 430/976] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:00:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:00:22.017255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2fc90b97-3c0e-4bc7-9b98-7750efaf74a9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:00:22.017742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2fc90b97-3c0e-4bc7-9b98-7750efaf74a9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:00:22.023084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fc90b97-3c0e-4bc7-9b98-7750efaf74a9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:00:22.024656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fc90b97-3c0e-4bc7-9b98-7750efaf74a9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:00:22.024656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fc90b97-3c0e-4bc7-9b98-7750efaf74a9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:00:22.024862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fc90b97-3c0e-4bc7-9b98-7750efaf74a9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:00:22.048681 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2fc90b97-3c0e-4bc7-9b98-7750efaf74a9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:00:22.348843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2fc90b97-3c0e-4bc7-9b98-7750efaf74a9 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 204 len: 0 microversion: 2.1 time: 0.334760 May 12 07:00:22.349432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 431/977] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:00:22 2022] DELETE /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:00:22.355020 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-04606691-8dc9-4d51-b346-ee492df7bb8f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:00:22.356930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-04606691-8dc9-4d51-b346-ee492df7bb8f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:00:22.361656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04606691-8dc9-4d51-b346-ee492df7bb8f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:00:22.362105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04606691-8dc9-4d51-b346-ee492df7bb8f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:00:22.362903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04606691-8dc9-4d51-b346-ee492df7bb8f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:00:22.363356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04606691-8dc9-4d51-b346-ee492df7bb8f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:00:22.396773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-0907dfab-40e4-4c82-b2a0-1ede9c2ae64c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'services' on Instance uuid d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:01:03.169193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-04606691-8dc9-4d51-b346-ee492df7bb8f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'services' on Instance uuid d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:01:03.196606 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-0907dfab-40e4-4c82-b2a0-1ede9c2ae64c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f53cdfab-1274-4d3b-93e1-d5eb4c806c72) May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0907dfab-40e4-4c82-b2a0-1ede9c2ae64c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c HTTP/1.1 May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:01:03.198930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:01:03.200456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 07:01:03.200456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:01:03.200456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:01:03.200456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:01:03.200456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:01:03.200456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:01:03.200456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:01:03.200456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 07:01:03.200456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:01:03.200456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f53cdfab-1274-4d3b-93e1-d5eb4c806c72) May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'server_id': 'd1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106', 'id': 'ce7be931-41dc-455d-b15d-fbd24ac0f57c'} May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:01:03.201371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f53cdfab-1274-4d3b-93e1-d5eb4c806c72) May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:01:03.203296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f53cdfab-1274-4d3b-93e1-d5eb4c806c72) May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:03.204995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f53cdfab-1274-4d3b-93e1-d5eb4c806c72) May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:03.206039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f53cdfab-1274-4d3b-93e1-d5eb4c806c72) May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f53cdfab-1274-4d3b-93e1-d5eb4c806c72) May 12 07:01:03.207233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.208563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0907dfab-40e4-4c82-b2a0-1ede9c2ae64c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f53cdfab-1274-4d3b-93e1-d5eb4c806c72) {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:01:03.208563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0907dfab-40e4-4c82-b2a0-1ede9c2ae64c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c" status: 400 len: 269 microversion: 2.1 time: 101.579131 May 12 07:01:03.208563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 547/978] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 06:59:21 2022] DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c => generated 269 bytes in 101581 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 12 07:01:03.209566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-171e3b1c-09bf-47c0-9c1d-9c8c793b0c99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:03.210541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-171e3b1c-09bf-47c0-9c1d-9c8c793b0c99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:03.217339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-171e3b1c-09bf-47c0-9c1d-9c8c793b0c99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:03.217811 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-171e3b1c-09bf-47c0-9c1d-9c8c793b0c99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:03.218587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-171e3b1c-09bf-47c0-9c1d-9c8c793b0c99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:03.219019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-171e3b1c-09bf-47c0-9c1d-9c8c793b0c99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:03.232171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-171e3b1c-09bf-47c0-9c1d-9c8c793b0c99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-171e3b1c-09bf-47c0-9c1d-9c8c793b0c99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df HTTP/1.1 May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:01:03.233764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:03.235390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '19d32c82-7a33-4e43-b678-1944501fa5df'} May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:01:03.236379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:03.237668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:03.239249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-171e3b1c-09bf-47c0-9c1d-9c8c793b0c99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:01:03.239249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-171e3b1c-09bf-47c0-9c1d-9c8c793b0c99 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 404 len: 111 microversion: 2.1 time: 0.032956 May 12 07:01:03.239249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 548/979] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:03 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:01:03.242223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-569b6a5e-4b67-461a-84ff-3f0e9f4a1510 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:03.242223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-569b6a5e-4b67-461a-84ff-3f0e9f4a1510 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:03.246915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-569b6a5e-4b67-461a-84ff-3f0e9f4a1510 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:03.247368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-569b6a5e-4b67-461a-84ff-3f0e9f4a1510 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:03.248208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-569b6a5e-4b67-461a-84ff-3f0e9f4a1510 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:03.248659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-569b6a5e-4b67-461a-84ff-3f0e9f4a1510 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:03.378522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-569b6a5e-4b67-461a-84ff-3f0e9f4a1510 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:03.386072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-569b6a5e-4b67-461a-84ff-3f0e9f4a1510 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149425 May 12 07:01:03.386631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 549/980] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:03 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:01:03.391811 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2e8f0f44-8c50-4c34-8a2b-52b32cdb199b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:03.392891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2e8f0f44-8c50-4c34-8a2b-52b32cdb199b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:03.398410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2e8f0f44-8c50-4c34-8a2b-52b32cdb199b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:03.398851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2e8f0f44-8c50-4c34-8a2b-52b32cdb199b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:03.399717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2e8f0f44-8c50-4c34-8a2b-52b32cdb199b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:03.400069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2e8f0f44-8c50-4c34-8a2b-52b32cdb199b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:03.428442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2e8f0f44-8c50-4c34-8a2b-52b32cdb199b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040851 May 12 07:01:03.428974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 550/981] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:03.433214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-3ec8b8f5-bac6-4472-944d-4810f9a0fd08 req-b28d38be-b710-49ad-845e-f03425285bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d32c82-7a33-4e43-b678-1944501fa5df", "name": "network-vif-deleted", "tag": "56ed9e0d-5810-4eec-9ff8-9544a2f94571"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:01:03.440369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-3ec8b8f5-bac6-4472-944d-4810f9a0fd08 req-b28d38be-b710-49ad-845e-f03425285bdd service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:03.440815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-3ec8b8f5-bac6-4472-944d-4810f9a0fd08 req-b28d38be-b710-49ad-845e-f03425285bdd service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:03.451051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-3ec8b8f5-bac6-4472-944d-4810f9a0fd08 req-b28d38be-b710-49ad-845e-f03425285bdd service nova] Creating event network-vif-deleted:56ed9e0d-5810-4eec-9ff8-9544a2f94571 for instance 19d32c82-7a33-4e43-b678-1944501fa5df on hv-cinder-76606 May 12 07:01:03.456631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-3ec8b8f5-bac6-4472-944d-4810f9a0fd08 req-b28d38be-b710-49ad-845e-f03425285bdd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026551 May 12 07:01:03.457205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 551/982] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:01:03.462590 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9882635f-f9e4-4ecd-a6b4-005bf8689436 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '.version_select at 0x7f89da306430>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:03.563531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9882635f-f9e4-4ecd-a6b4-005bf8689436 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1590584630" status: 202 len: 0 microversion: 2.1 time: 0.105196 May 12 07:01:03.565006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 552/983] 10.222.0.25 () {58 vars in 1220 bytes} [Thu May 12 07:01:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1590584630 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:01:04.303333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3a70ad0c-82b1-4444-9a81-2ffcdd8a6293 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:04.303988 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3a70ad0c-82b1-4444-9a81-2ffcdd8a6293 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:04.310236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a70ad0c-82b1-4444-9a81-2ffcdd8a6293 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.310686 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a70ad0c-82b1-4444-9a81-2ffcdd8a6293 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.311486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a70ad0c-82b1-4444-9a81-2ffcdd8a6293 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.311956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a70ad0c-82b1-4444-9a81-2ffcdd8a6293 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.326112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-3a70ad0c-82b1-4444-9a81-2ffcdd8a6293 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3a70ad0c-82b1-4444-9a81-2ffcdd8a6293 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df HTTP/1.1 May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:01:04.328247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:04.329794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '19d32c82-7a33-4e43-b678-1944501fa5df'} May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:01:04.330916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:04.332383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.333937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3a70ad0c-82b1-4444-9a81-2ffcdd8a6293 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:01:04.333937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3a70ad0c-82b1-4444-9a81-2ffcdd8a6293 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 404 len: 111 microversion: 2.1 time: 0.030766 May 12 07:01:04.333937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 553/984] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:01:04 2022] DELETE /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 07:01:04.337429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1df1e27f-0bf5-40b8-855d-4735f9f230ea tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:04.338041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1df1e27f-0bf5-40b8-855d-4735f9f230ea tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 19d32c82-7a33-4e43-b678-1944501fa5df] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:04.344191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1df1e27f-0bf5-40b8-855d-4735f9f230ea tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.344648 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1df1e27f-0bf5-40b8-855d-4735f9f230ea tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.345410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1df1e27f-0bf5-40b8-855d-4735f9f230ea tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.345849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1df1e27f-0bf5-40b8-855d-4735f9f230ea tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.358798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-1df1e27f-0bf5-40b8-855d-4735f9f230ea tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1df1e27f-0bf5-40b8-855d-4735f9f230ea tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df HTTP/1.1 May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:01:04.360330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:04.361844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '19d32c82-7a33-4e43-b678-1944501fa5df'} May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:01:04.362831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. May 12 07:01:04.364041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.365158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1df1e27f-0bf5-40b8-855d-4735f9f230ea tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 19d32c82-7a33-4e43-b678-1944501fa5df could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:01:04.365158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1df1e27f-0bf5-40b8-855d-4735f9f230ea tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df" status: 404 len: 111 microversion: 2.1 time: 0.027759 May 12 07:01:04.365158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 554/985] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:04 2022] GET /compute/v2.1/servers/19d32c82-7a33-4e43-b678-1944501fa5df => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:01:04.369261 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fe450dcb-304c-4e40-a4d7-46f63f388a14 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:04.369750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fe450dcb-304c-4e40-a4d7-46f63f388a14 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:04.375191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe450dcb-304c-4e40-a4d7-46f63f388a14 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.375638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe450dcb-304c-4e40-a4d7-46f63f388a14 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.376427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe450dcb-304c-4e40-a4d7-46f63f388a14 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.376862 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe450dcb-304c-4e40-a4d7-46f63f388a14 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.390148 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-fe450dcb-304c-4e40-a4d7-46f63f388a14 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fe450dcb-304c-4e40-a4d7-46f63f388a14 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 HTTP/1.1 May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:01:04.391639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 07:01:04.393180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '21c151d1-8962-4a06-b362-6b195a231bb1'} May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:01:04.394115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 07:01:04.395628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.397114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fe450dcb-304c-4e40-a4d7-46f63f388a14 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:01:04.397114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fe450dcb-304c-4e40-a4d7-46f63f388a14 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 404 len: 111 microversion: 2.1 time: 0.027900 May 12 07:01:04.397114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 555/986] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:01:04 2022] DELETE /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 07:01:04.402007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-39a80011-9446-4cbd-8def-71bd7f1cf755 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:04.402621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-39a80011-9446-4cbd-8def-71bd7f1cf755 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 21c151d1-8962-4a06-b362-6b195a231bb1] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:04.408773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39a80011-9446-4cbd-8def-71bd7f1cf755 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.409213 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39a80011-9446-4cbd-8def-71bd7f1cf755 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.409980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39a80011-9446-4cbd-8def-71bd7f1cf755 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.410421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39a80011-9446-4cbd-8def-71bd7f1cf755 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.423895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-39a80011-9446-4cbd-8def-71bd7f1cf755 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-39a80011-9446-4cbd-8def-71bd7f1cf755 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 HTTP/1.1 May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:01:04.425403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 07:01:04.427018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '21c151d1-8962-4a06-b362-6b195a231bb1'} May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:01:04.427956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. May 12 07:01:04.429611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.431006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-39a80011-9446-4cbd-8def-71bd7f1cf755 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 21c151d1-8962-4a06-b362-6b195a231bb1 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:01:04.431006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-39a80011-9446-4cbd-8def-71bd7f1cf755 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1" status: 404 len: 111 microversion: 2.1 time: 0.028242 May 12 07:01:04.431006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 556/987] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:04 2022] GET /compute/v2.1/servers/21c151d1-8962-4a06-b362-6b195a231bb1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 07:01:04.432081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-81b6741f-bcff-4690-bfa2-9a9b46de4ed1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:04.432693 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-81b6741f-bcff-4690-bfa2-9a9b46de4ed1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:04.438776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81b6741f-bcff-4690-bfa2-9a9b46de4ed1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.443064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81b6741f-bcff-4690-bfa2-9a9b46de4ed1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.443064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81b6741f-bcff-4690-bfa2-9a9b46de4ed1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.443064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-81b6741f-bcff-4690-bfa2-9a9b46de4ed1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.568997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-81b6741f-bcff-4690-bfa2-9a9b46de4ed1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:04.576596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-81b6741f-bcff-4690-bfa2-9a9b46de4ed1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148117 May 12 07:01:04.577807 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 557/988] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:01:04.582222 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-019aa870-1f3d-4656-b9e4-c1ddffd9d94f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:04.582814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-019aa870-1f3d-4656-b9e4-c1ddffd9d94f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:04.588733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-019aa870-1f3d-4656-b9e4-c1ddffd9d94f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.589182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-019aa870-1f3d-4656-b9e4-c1ddffd9d94f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.589953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-019aa870-1f3d-4656-b9e4-c1ddffd9d94f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.590392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-019aa870-1f3d-4656-b9e4-c1ddffd9d94f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.603605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-019aa870-1f3d-4656-b9e4-c1ddffd9d94f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-019aa870-1f3d-4656-b9e4-c1ddffd9d94f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 HTTP/1.1 May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:01:04.605162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 07:01:04.606749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '4a57c872-cacc-4345-b372-154b251e3661'} May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:01:04.607668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 07:01:04.609312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.610772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-019aa870-1f3d-4656-b9e4-c1ddffd9d94f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:01:04.610772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-019aa870-1f3d-4656-b9e4-c1ddffd9d94f tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 404 len: 111 microversion: 2.1 time: 0.027762 May 12 07:01:04.610772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 558/989] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:01:04 2022] DELETE /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:01:04.611897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ab87d20f-a540-49aa-b87d-127e4188fb2b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:04.612802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ab87d20f-a540-49aa-b87d-127e4188fb2b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:04.618505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab87d20f-a540-49aa-b87d-127e4188fb2b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.618965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab87d20f-a540-49aa-b87d-127e4188fb2b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.620178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab87d20f-a540-49aa-b87d-127e4188fb2b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.620618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab87d20f-a540-49aa-b87d-127e4188fb2b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.649923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ab87d20f-a540-49aa-b87d-127e4188fb2b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041626 May 12 07:01:04.650466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 559/990] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:04 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:04.654807 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-99073dd9-1883-4fd5-8e95-ea9e510e04cf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:04.655442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-99073dd9-1883-4fd5-8e95-ea9e510e04cf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 4a57c872-cacc-4345-b372-154b251e3661] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:04.660781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99073dd9-1883-4fd5-8e95-ea9e510e04cf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.661232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99073dd9-1883-4fd5-8e95-ea9e510e04cf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.662044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99073dd9-1883-4fd5-8e95-ea9e510e04cf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:04.662482 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99073dd9-1883-4fd5-8e95-ea9e510e04cf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:04.676003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-99073dd9-1883-4fd5-8e95-ea9e510e04cf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-99073dd9-1883-4fd5-8e95-ea9e510e04cf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 HTTP/1.1 May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:01:04.677855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 07:01:04.679425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '4a57c872-cacc-4345-b372-154b251e3661'} May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:01:04.680419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. May 12 07:01:04.681873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:01:04.683195 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-99073dd9-1883-4fd5-8e95-ea9e510e04cf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 4a57c872-cacc-4345-b372-154b251e3661 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:01:04.683195 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-99073dd9-1883-4fd5-8e95-ea9e510e04cf tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661" status: 404 len: 111 microversion: 2.1 time: 0.028023 May 12 07:01:04.683195 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 560/991] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:04 2022] GET /compute/v2.1/servers/4a57c872-cacc-4345-b372-154b251e3661 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:01:05.593515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-abf4523f-ccd4-4a1e-b642-f26284348cf4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:05.594127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-abf4523f-ccd4-4a1e-b642-f26284348cf4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:05.600389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-abf4523f-ccd4-4a1e-b642-f26284348cf4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:05.600836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-abf4523f-ccd4-4a1e-b642-f26284348cf4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:05.601597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-abf4523f-ccd4-4a1e-b642-f26284348cf4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:05.602029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-abf4523f-ccd4-4a1e-b642-f26284348cf4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:05.727340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-abf4523f-ccd4-4a1e-b642-f26284348cf4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:05.735164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-abf4523f-ccd4-4a1e-b642-f26284348cf4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145728 May 12 07:01:05.735739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 561/992] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:05 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:05.740209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-99e7e516-f938-4008-9365-f8138b6be164 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:05.741102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-99e7e516-f938-4008-9365-f8138b6be164 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:05.746453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e7e516-f938-4008-9365-f8138b6be164 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:05.746897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e7e516-f938-4008-9365-f8138b6be164 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:05.747652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e7e516-f938-4008-9365-f8138b6be164 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:05.748107 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e7e516-f938-4008-9365-f8138b6be164 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:05.776200 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-99e7e516-f938-4008-9365-f8138b6be164 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039488 May 12 07:01:05.776731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 562/993] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:05 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:06.751980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2cd3f154-2ce0-40db-907c-01389e3334e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:06.752594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2cd3f154-2ce0-40db-907c-01389e3334e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:06.758847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2cd3f154-2ce0-40db-907c-01389e3334e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:06.759292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2cd3f154-2ce0-40db-907c-01389e3334e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:06.760074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2cd3f154-2ce0-40db-907c-01389e3334e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:06.760505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2cd3f154-2ce0-40db-907c-01389e3334e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:06.890758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2cd3f154-2ce0-40db-907c-01389e3334e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:06.898066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2cd3f154-2ce0-40db-907c-01389e3334e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150456 May 12 07:01:06.898629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 563/994] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:06 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:06.903274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ab89a663-b216-4ce1-b2fa-2ee551da87b7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:06.910300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ab89a663-b216-4ce1-b2fa-2ee551da87b7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:06.910300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab89a663-b216-4ce1-b2fa-2ee551da87b7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:06.910300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab89a663-b216-4ce1-b2fa-2ee551da87b7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:06.910796 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab89a663-b216-4ce1-b2fa-2ee551da87b7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:06.911227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab89a663-b216-4ce1-b2fa-2ee551da87b7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:06.939823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ab89a663-b216-4ce1-b2fa-2ee551da87b7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040161 May 12 07:01:06.940374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 564/995] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:06 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:07.914194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-58e10e87-5715-448e-a467-cd14a73b9a19 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:07.914845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-58e10e87-5715-448e-a467-cd14a73b9a19 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:07.921190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58e10e87-5715-448e-a467-cd14a73b9a19 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:07.921637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58e10e87-5715-448e-a467-cd14a73b9a19 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:07.922398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58e10e87-5715-448e-a467-cd14a73b9a19 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:07.923102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58e10e87-5715-448e-a467-cd14a73b9a19 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:08.048477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-58e10e87-5715-448e-a467-cd14a73b9a19 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:08.055735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-58e10e87-5715-448e-a467-cd14a73b9a19 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.145345 May 12 07:01:08.056300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 565/996] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:07 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:08.060939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f8d5260f-b4f4-40e1-a661-e802c95dafde tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:08.061847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f8d5260f-b4f4-40e1-a661-e802c95dafde tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:08.067283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8d5260f-b4f4-40e1-a661-e802c95dafde tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:08.067769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8d5260f-b4f4-40e1-a661-e802c95dafde tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:08.068537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8d5260f-b4f4-40e1-a661-e802c95dafde tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:08.068973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8d5260f-b4f4-40e1-a661-e802c95dafde tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:08.097429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f8d5260f-b4f4-40e1-a661-e802c95dafde tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040160 May 12 07:01:08.097974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 566/997] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:09.072776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6ed0ee2d-53f7-47c8-bdf0-7254bab0d118 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:09.073419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6ed0ee2d-53f7-47c8-bdf0-7254bab0d118 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:09.079815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6ed0ee2d-53f7-47c8-bdf0-7254bab0d118 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:09.080264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6ed0ee2d-53f7-47c8-bdf0-7254bab0d118 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:09.081031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6ed0ee2d-53f7-47c8-bdf0-7254bab0d118 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:09.081469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6ed0ee2d-53f7-47c8-bdf0-7254bab0d118 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:09.209190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6ed0ee2d-53f7-47c8-bdf0-7254bab0d118 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:09.216952 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6ed0ee2d-53f7-47c8-bdf0-7254bab0d118 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148087 May 12 07:01:09.218026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 567/998] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:09 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:09.222809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-87583987-1291-4b79-8a56-83be58306eba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:09.223736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-87583987-1291-4b79-8a56-83be58306eba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:09.229127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87583987-1291-4b79-8a56-83be58306eba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:09.229574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87583987-1291-4b79-8a56-83be58306eba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:09.230341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87583987-1291-4b79-8a56-83be58306eba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:09.230773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87583987-1291-4b79-8a56-83be58306eba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:09.258885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-87583987-1291-4b79-8a56-83be58306eba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039820 May 12 07:01:09.259364 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 568/999] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:10.234512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-662a49f6-27dd-4a59-84f3-31fd10d321e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:10.235141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-662a49f6-27dd-4a59-84f3-31fd10d321e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:10.241355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-662a49f6-27dd-4a59-84f3-31fd10d321e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:10.241799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-662a49f6-27dd-4a59-84f3-31fd10d321e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:10.242677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-662a49f6-27dd-4a59-84f3-31fd10d321e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:10.243226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-662a49f6-27dd-4a59-84f3-31fd10d321e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:10.367251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-662a49f6-27dd-4a59-84f3-31fd10d321e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:10.374593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-662a49f6-27dd-4a59-84f3-31fd10d321e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.144120 May 12 07:01:10.376113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 569/1000] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:10 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:10.379923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-78d39b70-96dd-48b2-a324-1397b9551d0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:10.380821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-78d39b70-96dd-48b2-a324-1397b9551d0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:10.386395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d39b70-96dd-48b2-a324-1397b9551d0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:10.386845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d39b70-96dd-48b2-a324-1397b9551d0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:10.387647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d39b70-96dd-48b2-a324-1397b9551d0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:10.388101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d39b70-96dd-48b2-a324-1397b9551d0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:10.417106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-78d39b70-96dd-48b2-a324-1397b9551d0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040750 May 12 07:01:10.417651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 570/1001] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:10 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:11.391957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-eabe3454-0f0b-47b6-8af5-8744a2ca064b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:11.392570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-eabe3454-0f0b-47b6-8af5-8744a2ca064b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:11.398720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eabe3454-0f0b-47b6-8af5-8744a2ca064b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:11.399168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eabe3454-0f0b-47b6-8af5-8744a2ca064b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:11.399949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eabe3454-0f0b-47b6-8af5-8744a2ca064b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:11.400381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eabe3454-0f0b-47b6-8af5-8744a2ca064b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:11.529599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eabe3454-0f0b-47b6-8af5-8744a2ca064b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:11.537562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-eabe3454-0f0b-47b6-8af5-8744a2ca064b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149677 May 12 07:01:11.538118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 571/1002] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:11 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:11.542597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d2001f5d-965a-4d67-9d88-45b5cd55f8d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:11.543489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d2001f5d-965a-4d67-9d88-45b5cd55f8d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:11.549205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d2001f5d-965a-4d67-9d88-45b5cd55f8d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:11.549649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d2001f5d-965a-4d67-9d88-45b5cd55f8d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:11.550584 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d2001f5d-965a-4d67-9d88-45b5cd55f8d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:11.552960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d2001f5d-965a-4d67-9d88-45b5cd55f8d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:11.578912 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d2001f5d-965a-4d67-9d88-45b5cd55f8d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039827 May 12 07:01:11.579501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 572/1003] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:12.554516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fabc7b41-9b40-426d-8d2b-682857a577be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:12.555171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fabc7b41-9b40-426d-8d2b-682857a577be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:12.561662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fabc7b41-9b40-426d-8d2b-682857a577be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:12.567935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fabc7b41-9b40-426d-8d2b-682857a577be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:12.567935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fabc7b41-9b40-426d-8d2b-682857a577be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:12.567935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fabc7b41-9b40-426d-8d2b-682857a577be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:12.690405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fabc7b41-9b40-426d-8d2b-682857a577be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:12.697761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fabc7b41-9b40-426d-8d2b-682857a577be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147126 May 12 07:01:12.698327 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 573/1004] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:12 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:12.703356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dd5c05d5-dc57-492e-ac17-e8d2a0862621 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:12.704291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dd5c05d5-dc57-492e-ac17-e8d2a0862621 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:12.709695 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dd5c05d5-dc57-492e-ac17-e8d2a0862621 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:12.710146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dd5c05d5-dc57-492e-ac17-e8d2a0862621 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:12.710937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dd5c05d5-dc57-492e-ac17-e8d2a0862621 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:12.711375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dd5c05d5-dc57-492e-ac17-e8d2a0862621 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:12.739143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dd5c05d5-dc57-492e-ac17-e8d2a0862621 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039802 May 12 07:01:12.739709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 574/1005] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:12 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:13.715164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5c2ea24a-1866-47eb-b110-ebf770694ebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:13.715848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5c2ea24a-1866-47eb-b110-ebf770694ebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:13.722116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c2ea24a-1866-47eb-b110-ebf770694ebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:13.722575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c2ea24a-1866-47eb-b110-ebf770694ebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:13.723346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c2ea24a-1866-47eb-b110-ebf770694ebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:13.723820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c2ea24a-1866-47eb-b110-ebf770694ebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:13.851501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5c2ea24a-1866-47eb-b110-ebf770694ebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:13.859345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5c2ea24a-1866-47eb-b110-ebf770694ebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.148047 May 12 07:01:13.859939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 575/1006] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:13 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:13.864657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-75e21b55-25f8-4e1b-a0cb-5ed98a5a8a66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:13.865561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-75e21b55-25f8-4e1b-a0cb-5ed98a5a8a66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:13.871078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-75e21b55-25f8-4e1b-a0cb-5ed98a5a8a66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:13.871533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-75e21b55-25f8-4e1b-a0cb-5ed98a5a8a66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:13.872340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-75e21b55-25f8-4e1b-a0cb-5ed98a5a8a66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:13.872787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-75e21b55-25f8-4e1b-a0cb-5ed98a5a8a66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:13.901694 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-75e21b55-25f8-4e1b-a0cb-5ed98a5a8a66 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040758 May 12 07:01:13.902249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 576/1007] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:14.876092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bc59a3fc-a6b2-4284-ac60-08a9c66085cc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:14.876794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bc59a3fc-a6b2-4284-ac60-08a9c66085cc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:14.883040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc59a3fc-a6b2-4284-ac60-08a9c66085cc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:14.883484 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc59a3fc-a6b2-4284-ac60-08a9c66085cc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:14.884268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc59a3fc-a6b2-4284-ac60-08a9c66085cc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:14.884710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bc59a3fc-a6b2-4284-ac60-08a9c66085cc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:15.235277 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bc59a3fc-a6b2-4284-ac60-08a9c66085cc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:15.246957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bc59a3fc-a6b2-4284-ac60-08a9c66085cc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.374640 May 12 07:01:15.247465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 577/1008] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:14 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:15.252442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f4c924b3-d7c2-4ace-a8ee-e7e3972d5ef6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:15.253332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f4c924b3-d7c2-4ace-a8ee-e7e3972d5ef6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:15.258749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f4c924b3-d7c2-4ace-a8ee-e7e3972d5ef6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:15.259193 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f4c924b3-d7c2-4ace-a8ee-e7e3972d5ef6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:15.259978 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f4c924b3-d7c2-4ace-a8ee-e7e3972d5ef6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:15.260411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f4c924b3-d7c2-4ace-a8ee-e7e3972d5ef6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:15.288844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f4c924b3-d7c2-4ace-a8ee-e7e3972d5ef6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040374 May 12 07:01:15.289396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 578/1009] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:16.264680 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d7f0bd9a-c7a1-4c17-a343-4968adf32807 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:16.265300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d7f0bd9a-c7a1-4c17-a343-4968adf32807 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:16.271558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7f0bd9a-c7a1-4c17-a343-4968adf32807 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:16.272044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7f0bd9a-c7a1-4c17-a343-4968adf32807 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:16.272822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7f0bd9a-c7a1-4c17-a343-4968adf32807 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:16.273267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7f0bd9a-c7a1-4c17-a343-4968adf32807 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:16.399288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d7f0bd9a-c7a1-4c17-a343-4968adf32807 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:16.407064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d7f0bd9a-c7a1-4c17-a343-4968adf32807 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146330 May 12 07:01:16.407633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 579/1010] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:16 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:16.412151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-68e0f60a-44e9-4c54-ad9f-8bebffdebe55 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:16.413056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-68e0f60a-44e9-4c54-ad9f-8bebffdebe55 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:16.418639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68e0f60a-44e9-4c54-ad9f-8bebffdebe55 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:16.419123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68e0f60a-44e9-4c54-ad9f-8bebffdebe55 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:16.419948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68e0f60a-44e9-4c54-ad9f-8bebffdebe55 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:16.421031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68e0f60a-44e9-4c54-ad9f-8bebffdebe55 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:16.448931 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-68e0f60a-44e9-4c54-ad9f-8bebffdebe55 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040307 May 12 07:01:16.449477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 580/1011] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:17.424253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3ce8b92f-2710-40eb-b1b6-65439b9a75a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:17.424917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3ce8b92f-2710-40eb-b1b6-65439b9a75a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:17.431126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ce8b92f-2710-40eb-b1b6-65439b9a75a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:17.431575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ce8b92f-2710-40eb-b1b6-65439b9a75a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:17.432374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ce8b92f-2710-40eb-b1b6-65439b9a75a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:17.432813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ce8b92f-2710-40eb-b1b6-65439b9a75a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:17.562633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3ce8b92f-2710-40eb-b1b6-65439b9a75a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:17.570993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3ce8b92f-2710-40eb-b1b6-65439b9a75a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.150937 May 12 07:01:17.571608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 581/1012] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:17 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:17.576943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-41caa271-a42a-416f-8032-65c5a34a2f21 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:17.588129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-41caa271-a42a-416f-8032-65c5a34a2f21 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:17.588129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-41caa271-a42a-416f-8032-65c5a34a2f21 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:17.588129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-41caa271-a42a-416f-8032-65c5a34a2f21 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:17.588129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-41caa271-a42a-416f-8032-65c5a34a2f21 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:17.588513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-41caa271-a42a-416f-8032-65c5a34a2f21 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:17.618513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-41caa271-a42a-416f-8032-65c5a34a2f21 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045758 May 12 07:01:17.619158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 582/1013] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:17 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:18.587883 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-875cd4c3-05a3-4bb4-9a1f-9e58ae570a26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:18.588536 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-875cd4c3-05a3-4bb4-9a1f-9e58ae570a26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:18.594876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-875cd4c3-05a3-4bb4-9a1f-9e58ae570a26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:18.595329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-875cd4c3-05a3-4bb4-9a1f-9e58ae570a26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:18.596122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-875cd4c3-05a3-4bb4-9a1f-9e58ae570a26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:18.596560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-875cd4c3-05a3-4bb4-9a1f-9e58ae570a26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:18.723142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-875cd4c3-05a3-4bb4-9a1f-9e58ae570a26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:18.730584 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-875cd4c3-05a3-4bb4-9a1f-9e58ae570a26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.146693 May 12 07:01:18.731150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 583/1014] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:18 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:18.735618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-76481cf6-fa66-4de0-9ab7-cf97aea69f42 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:18.736536 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-76481cf6-fa66-4de0-9ab7-cf97aea69f42 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:18.742061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76481cf6-fa66-4de0-9ab7-cf97aea69f42 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:18.742503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76481cf6-fa66-4de0-9ab7-cf97aea69f42 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:18.743268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76481cf6-fa66-4de0-9ab7-cf97aea69f42 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:18.743710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76481cf6-fa66-4de0-9ab7-cf97aea69f42 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:18.772564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-76481cf6-fa66-4de0-9ab7-cf97aea69f42 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040446 May 12 07:01:18.773109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 584/1015] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:19.747711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7a39f0e1-9eba-410e-8d30-70e359accf44 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:19.748869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7a39f0e1-9eba-410e-8d30-70e359accf44 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:19.755145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a39f0e1-9eba-410e-8d30-70e359accf44 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:19.755596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a39f0e1-9eba-410e-8d30-70e359accf44 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:19.756402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a39f0e1-9eba-410e-8d30-70e359accf44 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:19.756845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a39f0e1-9eba-410e-8d30-70e359accf44 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:19.886339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7a39f0e1-9eba-410e-8d30-70e359accf44 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:19.893732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7a39f0e1-9eba-410e-8d30-70e359accf44 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.149941 May 12 07:01:19.894302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 585/1016] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:19 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:19.898813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1948349e-fe42-4916-a209-604daac58a2f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:19.899773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1948349e-fe42-4916-a209-604daac58a2f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:19.905255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1948349e-fe42-4916-a209-604daac58a2f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:19.905709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1948349e-fe42-4916-a209-604daac58a2f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:19.906481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1948349e-fe42-4916-a209-604daac58a2f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:19.906927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1948349e-fe42-4916-a209-604daac58a2f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:19.935109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1948349e-fe42-4916-a209-604daac58a2f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039834 May 12 07:01:19.935649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 586/1017] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:19 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:20.910845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fdd390ad-8da8-4f96-9187-25477fbb64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:20.911499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fdd390ad-8da8-4f96-9187-25477fbb64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:20.917729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdd390ad-8da8-4f96-9187-25477fbb64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:20.918173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdd390ad-8da8-4f96-9187-25477fbb64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:20.918934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdd390ad-8da8-4f96-9187-25477fbb64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:20.919362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdd390ad-8da8-4f96-9187-25477fbb64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:21.047070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fdd390ad-8da8-4f96-9187-25477fbb64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:01:21.054562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fdd390ad-8da8-4f96-9187-25477fbb64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.147614 May 12 07:01:21.055123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 587/1018] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:01:20 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:01:21.059592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0fcaaaf2-2331-4a44-ae16-7704ba35ba0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:21.060516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0fcaaaf2-2331-4a44-ae16-7704ba35ba0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:21.065969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0fcaaaf2-2331-4a44-ae16-7704ba35ba0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:21.066411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0fcaaaf2-2331-4a44-ae16-7704ba35ba0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:21.067169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0fcaaaf2-2331-4a44-ae16-7704ba35ba0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:21.067602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0fcaaaf2-2331-4a44-ae16-7704ba35ba0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:21.096004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0fcaaaf2-2331-4a44-ae16-7704ba35ba0d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039828 May 12 07:01:21.096562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 588/1019] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:01:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:01:21.745316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2c902348-3cf9-49be-8f61-aca7514c1ec4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:01:21.745813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2c902348-3cf9-49be-8f61-aca7514c1ec4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:01:21.752206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c902348-3cf9-49be-8f61-aca7514c1ec4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:21.752656 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c902348-3cf9-49be-8f61-aca7514c1ec4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:21.753423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c902348-3cf9-49be-8f61-aca7514c1ec4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:01:21.753862 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c902348-3cf9-49be-8f61-aca7514c1ec4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:01:52.620708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:01:52.621298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c (ip 10.222.0.25) !!! May 12 07:02:22.555163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-04606691-8dc9-4d51-b346-ee492df7bb8f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad09f271-e8cd-4273-9d60-fa8d09ca5cb6) May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-04606691-8dc9-4d51-b346-ee492df7bb8f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c HTTP/1.1 May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:02:22.558951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:02:22.560352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 07:02:22.560352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:02:22.560352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:02:22.560352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:02:22.560352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:02:22.560352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:02:22.560352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:02:22.560352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 07:02:22.560352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:02:22.560352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad09f271-e8cd-4273-9d60-fa8d09ca5cb6) May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'server_id': 'd1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106', 'id': 'ce7be931-41dc-455d-b15d-fbd24ac0f57c'} May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:02:22.561022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad09f271-e8cd-4273-9d60-fa8d09ca5cb6) May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:02:22.562095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad09f271-e8cd-4273-9d60-fa8d09ca5cb6) May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:02:22.563234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad09f271-e8cd-4273-9d60-fa8d09ca5cb6) May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:02:22.565158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad09f271-e8cd-4273-9d60-fa8d09ca5cb6) May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad09f271-e8cd-4273-9d60-fa8d09ca5cb6) May 12 07:02:22.566623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:02:22.569068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-04606691-8dc9-4d51-b346-ee492df7bb8f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad09f271-e8cd-4273-9d60-fa8d09ca5cb6) {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:02:22.569068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-04606691-8dc9-4d51-b346-ee492df7bb8f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c" status: 400 len: 269 microversion: 2.1 time: 120.209572 May 12 07:02:22.569068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 432/1020] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:00:22 2022] DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c => generated 269 bytes in 120211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 07:02:22.569068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cd4c12d3-bb6f-45cf-96de-22407b4a229b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:02:22.569831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cd4c12d3-bb6f-45cf-96de-22407b4a229b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:02:22.573824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd4c12d3-bb6f-45cf-96de-22407b4a229b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:02:22.574272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd4c12d3-bb6f-45cf-96de-22407b4a229b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:02:22.575037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd4c12d3-bb6f-45cf-96de-22407b4a229b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:02:22.575472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd4c12d3-bb6f-45cf-96de-22407b4a229b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:02:22.709516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cd4c12d3-bb6f-45cf-96de-22407b4a229b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:02:22.716800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cd4c12d3-bb6f-45cf-96de-22407b4a229b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.154903 May 12 07:02:22.717368 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 433/1021] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:02:22 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:02:22.721899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2376fe43-85aa-4b61-902f-597bd56fded1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:02:22.723303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2376fe43-85aa-4b61-902f-597bd56fded1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:02:22.728703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2376fe43-85aa-4b61-902f-597bd56fded1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:02:22.729207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2376fe43-85aa-4b61-902f-597bd56fded1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:02:22.729940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2376fe43-85aa-4b61-902f-597bd56fded1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:02:22.730379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2376fe43-85aa-4b61-902f-597bd56fded1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:02:22.758670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2376fe43-85aa-4b61-902f-597bd56fded1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040299 May 12 07:02:22.759233 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 434/1022] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:02:22 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:02:22.763722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-512cdd77-be86-46ef-b113-f3ffc59b9d4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:02:22.764191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-512cdd77-be86-46ef-b113-f3ffc59b9d4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:02:22.770820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-512cdd77-be86-46ef-b113-f3ffc59b9d4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:02:22.770820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-512cdd77-be86-46ef-b113-f3ffc59b9d4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:02:22.771322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-512cdd77-be86-46ef-b113-f3ffc59b9d4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:02:22.771784 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-512cdd77-be86-46ef-b113-f3ffc59b9d4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:02:23.116272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-2c902348-3cf9-49be-8f61-aca7514c1ec4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'services' on Instance uuid d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:03:03.373463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-512cdd77-be86-46ef-b113-f3ffc59b9d4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'services' on Instance uuid d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:03:03.400812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-2c902348-3cf9-49be-8f61-aca7514c1ec4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d1cf8367-e3c7-4292-8abe-d465b8d6ba63) May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2c902348-3cf9-49be-8f61-aca7514c1ec4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c HTTP/1.1 May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:03:03.403000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:03:03.404649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 07:03:03.404649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:03:03.404649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:03:03.404649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:03:03.404649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:03:03.404649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:03:03.404649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:03:03.404649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 07:03:03.404649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:03:03.404649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d1cf8367-e3c7-4292-8abe-d465b8d6ba63) May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'server_id': 'd1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106', 'id': 'ce7be931-41dc-455d-b15d-fbd24ac0f57c'} May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:03:03.405582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d1cf8367-e3c7-4292-8abe-d465b8d6ba63) May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:03:03.406675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d1cf8367-e3c7-4292-8abe-d465b8d6ba63) May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:03:03.407873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d1cf8367-e3c7-4292-8abe-d465b8d6ba63) May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:03:03.408943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d1cf8367-e3c7-4292-8abe-d465b8d6ba63) May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d1cf8367-e3c7-4292-8abe-d465b8d6ba63) May 12 07:03:03.410080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:03:03.411173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2c902348-3cf9-49be-8f61-aca7514c1ec4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d1cf8367-e3c7-4292-8abe-d465b8d6ba63) {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:03:03.411173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2c902348-3cf9-49be-8f61-aca7514c1ec4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c" status: 400 len: 269 microversion: 2.1 time: 101.663169 May 12 07:03:03.411173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 589/1023] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:01:21 2022] DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c => generated 269 bytes in 101664 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 12 07:03:03.411173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3cb0389d-7d77-4524-bef2-e24bd2255b1c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:03:03.411467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3cb0389d-7d77-4524-bef2-e24bd2255b1c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:03:03.418862 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cb0389d-7d77-4524-bef2-e24bd2255b1c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:03:03.419317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cb0389d-7d77-4524-bef2-e24bd2255b1c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:03:03.420132 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cb0389d-7d77-4524-bef2-e24bd2255b1c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:03:03.420575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3cb0389d-7d77-4524-bef2-e24bd2255b1c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:03:03.557852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3cb0389d-7d77-4524-bef2-e24bd2255b1c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:03:03.565187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3cb0389d-7d77-4524-bef2-e24bd2255b1c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1568 microversion: 2.1 time: 0.159242 May 12 07:03:03.565765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 590/1024] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:03:03 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:03:03.570261 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f8b08396-45f3-474a-a074-10ddac0ac560 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:03:03.571153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f8b08396-45f3-474a-a074-10ddac0ac560 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:03:03.576684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8b08396-45f3-474a-a074-10ddac0ac560 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:03:03.576977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8b08396-45f3-474a-a074-10ddac0ac560 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:03:03.577737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8b08396-45f3-474a-a074-10ddac0ac560 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:03:03.578174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f8b08396-45f3-474a-a074-10ddac0ac560 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:03:03.607279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f8b08396-45f3-474a-a074-10ddac0ac560 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040478 May 12 07:03:03.609957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 591/1025] 10.222.0.25 () {60 vars in 1342 bytes} [Thu May 12 07:03:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:03:03.612670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-15aa47eb-016a-4006-92d4-b8e4e3245ce0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:03:03.613159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-15aa47eb-016a-4006-92d4-b8e4e3245ce0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:03:03.619638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15aa47eb-016a-4006-92d4-b8e4e3245ce0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:03:03.620117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15aa47eb-016a-4006-92d4-b8e4e3245ce0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:03:03.620945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15aa47eb-016a-4006-92d4-b8e4e3245ce0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:03:03.621475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15aa47eb-016a-4006-92d4-b8e4e3245ce0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:03:20.999457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:03:20.999970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:03:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c (ip 10.222.0.25) !!! May 12 07:03:30.009498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:03:30.009934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:03:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa (ip 10.222.0.25) !!! May 12 07:03:36.548780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:03:36.549416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa (ip 10.222.0.25) !!! May 12 07:03:50.038394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:03:50.038927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:03:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa (ip 10.222.0.25) !!! May 12 07:04:23.340127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-512cdd77-be86-46ef-b113-f3ffc59b9d4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-adbd36b0-991d-4ba1-ba20-4f36d8ad5acf) May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-512cdd77-be86-46ef-b113-f3ffc59b9d4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c HTTP/1.1 May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:04:23.342881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:04:23.344546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 07:04:23.344546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:04:23.344546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:04:23.344546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:04:23.344546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:04:23.344546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:04:23.344546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:04:23.344546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 07:04:23.344546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:04:23.344546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-adbd36b0-991d-4ba1-ba20-4f36d8ad5acf) May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'server_id': 'd1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106', 'id': 'ce7be931-41dc-455d-b15d-fbd24ac0f57c'} May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:04:23.345556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-adbd36b0-991d-4ba1-ba20-4f36d8ad5acf) May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:04:23.347126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-adbd36b0-991d-4ba1-ba20-4f36d8ad5acf) May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:04:23.348704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-adbd36b0-991d-4ba1-ba20-4f36d8ad5acf) May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:04:23.349922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-adbd36b0-991d-4ba1-ba20-4f36d8ad5acf) May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-adbd36b0-991d-4ba1-ba20-4f36d8ad5acf) May 12 07:04:23.351267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:04:23.352600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-512cdd77-be86-46ef-b113-f3ffc59b9d4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-adbd36b0-991d-4ba1-ba20-4f36d8ad5acf) {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:04:23.352600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-512cdd77-be86-46ef-b113-f3ffc59b9d4c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c" status: 400 len: 269 microversion: 2.1 time: 120.584250 May 12 07:04:23.352600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 435/1026] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:02:22 2022] DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c => generated 269 bytes in 120585 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 07:04:23.352600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5a586f6b-bad1-4e2a-8578-13beb44f4ab0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:04:23.352959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5a586f6b-bad1-4e2a-8578-13beb44f4ab0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:04:23.357544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a586f6b-bad1-4e2a-8578-13beb44f4ab0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:04:23.358001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a586f6b-bad1-4e2a-8578-13beb44f4ab0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:04:23.358776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a586f6b-bad1-4e2a-8578-13beb44f4ab0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:04:23.359210 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a586f6b-bad1-4e2a-8578-13beb44f4ab0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:04:23.388658 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-15aa47eb-016a-4006-92d4-b8e4e3245ce0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lazy-loading 'services' on Instance uuid 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:04:23.389305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5a586f6b-bad1-4e2a-8578-13beb44f4ab0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043046 May 12 07:04:23.390055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 436/1027] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:04:23 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:04:23.482515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-67c1c156-22a0-4e4c-a5d8-6e9e1ca5ec4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:04:23.483015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-67c1c156-22a0-4e4c-a5d8-6e9e1ca5ec4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:04:23.489280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67c1c156-22a0-4e4c-a5d8-6e9e1ca5ec4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:04:23.489724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67c1c156-22a0-4e4c-a5d8-6e9e1ca5ec4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:04:23.490518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67c1c156-22a0-4e4c-a5d8-6e9e1ca5ec4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:04:23.491218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67c1c156-22a0-4e4c-a5d8-6e9e1ca5ec4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:04:23.515943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-67c1c156-22a0-4e4c-a5d8-6e9e1ca5ec4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:04:23.823278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-67c1c156-22a0-4e4c-a5d8-6e9e1ca5ec4f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 204 len: 0 microversion: 2.1 time: 0.431773 May 12 07:04:23.823910 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 437/1028] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:04:23 2022] DELETE /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:04:23.881074 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-f657be9a-baee-49eb-8977-fd57c78e3ce0 req-8bc8f3e5-e477-4856-8f77-45f2301128c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0fa87a-f20f-489f-b64c-04073a58a792", "tag": "bbe011a7-6d2c-4588-95a8-e8d354355950"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:04:23.889078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-f657be9a-baee-49eb-8977-fd57c78e3ce0 req-8bc8f3e5-e477-4856-8f77-45f2301128c5 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:04:23.889891 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-f657be9a-baee-49eb-8977-fd57c78e3ce0 req-8bc8f3e5-e477-4856-8f77-45f2301128c5 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:04:23.960051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-f657be9a-baee-49eb-8977-fd57c78e3ce0 req-8bc8f3e5-e477-4856-8f77-45f2301128c5 service nova] Creating event network-changed:bbe011a7-6d2c-4588-95a8-e8d354355950 for instance 0f0fa87a-f20f-489f-b64c-04073a58a792 on hv-cinder-76606 May 12 07:04:23.965068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-f657be9a-baee-49eb-8977-fd57c78e3ce0 req-8bc8f3e5-e477-4856-8f77-45f2301128c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139827 May 12 07:04:23.965678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 438/1029] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:04:23.971470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-308578c5-2c77-4722-bd15-1b68cd7de09b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:04:23.972491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-308578c5-2c77-4722-bd15-1b68cd7de09b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:04:23.978811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-308578c5-2c77-4722-bd15-1b68cd7de09b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:04:23.979298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-308578c5-2c77-4722-bd15-1b68cd7de09b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:04:23.980118 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-308578c5-2c77-4722-bd15-1b68cd7de09b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:04:23.980559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-308578c5-2c77-4722-bd15-1b68cd7de09b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:04:24.064186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-308578c5-2c77-4722-bd15-1b68cd7de09b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "POST /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/action" status: 200 len: 38077 microversion: 2.20 time: 0.096941 May 12 07:04:24.064857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 439/1030] 10.222.0.25 () {62 vars in 1318 bytes} [Thu May 12 07:04:23 2022] POST /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3/action => generated 38077 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 12 07:04:24.070134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-528e7785-057b-4667-8a30-ecc050c3aa7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:04:24.070728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-528e7785-057b-4667-8a30-ecc050c3aa7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:04:24.077708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-528e7785-057b-4667-8a30-ecc050c3aa7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:04:24.078131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-528e7785-057b-4667-8a30-ecc050c3aa7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:04:24.079432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-528e7785-057b-4667-8a30-ecc050c3aa7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:04:24.079909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-528e7785-057b-4667-8a30-ecc050c3aa7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:05:03.657753 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-528e7785-057b-4667-8a30-ecc050c3aa7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'services' on Instance uuid d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:05:03.703255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-15aa47eb-016a-4006-92d4-b8e4e3245ce0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa" status: 202 len: 0 microversion: 2.1 time: 120.094000 May 12 07:05:03.704193 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 592/1031] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:03:03 2022] DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa => generated 0 bytes in 120096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:05:03.710147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bd525d97-4bd9-4146-8fc2-1ef42f8edb93 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:05:03.710764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bd525d97-4bd9-4146-8fc2-1ef42f8edb93 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:05:03.717145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd525d97-4bd9-4146-8fc2-1ef42f8edb93 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:05:03.717766 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd525d97-4bd9-4146-8fc2-1ef42f8edb93 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:05:03.719018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd525d97-4bd9-4146-8fc2-1ef42f8edb93 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:05:03.719795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd525d97-4bd9-4146-8fc2-1ef42f8edb93 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:05:12.628850 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:05:12.629413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c (ip 10.222.0.25) !!! May 12 07:06:23.613078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-528e7785-057b-4667-8a30-ecc050c3aa7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b262ba-4cd7-4ab4-a077-5b1bf61965e7) May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-528e7785-057b-4667-8a30-ecc050c3aa7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c HTTP/1.1 May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:06:23.615357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:06:23.616991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 07:06:23.616991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:06:23.616991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:06:23.616991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:06:23.616991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:06:23.616991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:06:23.616991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:06:23.616991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 07:06:23.616991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:06:23.616991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b262ba-4cd7-4ab4-a077-5b1bf61965e7) May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'server_id': 'd1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106', 'id': 'ce7be931-41dc-455d-b15d-fbd24ac0f57c'} May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:06:23.617754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b262ba-4cd7-4ab4-a077-5b1bf61965e7) May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:06:23.619041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b262ba-4cd7-4ab4-a077-5b1bf61965e7) May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:23.624579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b262ba-4cd7-4ab4-a077-5b1bf61965e7) May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:06:23.625801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b262ba-4cd7-4ab4-a077-5b1bf61965e7) May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b262ba-4cd7-4ab4-a077-5b1bf61965e7) May 12 07:06:23.627123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:23.629305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-528e7785-057b-4667-8a30-ecc050c3aa7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b262ba-4cd7-4ab4-a077-5b1bf61965e7) {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:06:23.629305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-528e7785-057b-4667-8a30-ecc050c3aa7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c" status: 400 len: 269 microversion: 2.1 time: 119.550800 May 12 07:06:23.629305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 440/1032] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:04:24 2022] DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c => generated 269 bytes in 119552 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 07:06:23.629305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e716ab38-1013-4ab3-82ac-e0e5dc3ee792 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:06:23.629724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e716ab38-1013-4ab3-82ac-e0e5dc3ee792 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:06:23.630859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e716ab38-1013-4ab3-82ac-e0e5dc3ee792 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:23.631320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e716ab38-1013-4ab3-82ac-e0e5dc3ee792 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:23.632129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e716ab38-1013-4ab3-82ac-e0e5dc3ee792 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:23.632568 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e716ab38-1013-4ab3-82ac-e0e5dc3ee792 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:23.661674 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e716ab38-1013-4ab3-82ac-e0e5dc3ee792 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042898 May 12 07:06:23.662226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 441/1033] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:06:23 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:06:23.666812 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-52fdd3cf-745c-4b7a-bc4b-e477bcdc1605 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:06:23.667310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-52fdd3cf-745c-4b7a-bc4b-e477bcdc1605 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:06:23.672709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52fdd3cf-745c-4b7a-bc4b-e477bcdc1605 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:23.673168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52fdd3cf-745c-4b7a-bc4b-e477bcdc1605 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:23.674199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52fdd3cf-745c-4b7a-bc4b-e477bcdc1605 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:23.674627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52fdd3cf-745c-4b7a-bc4b-e477bcdc1605 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:23.699976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-52fdd3cf-745c-4b7a-bc4b-e477bcdc1605 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:06:23.733291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-bd525d97-4bd9-4146-8fc2-1ef42f8edb93 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lazy-loading 'services' on Instance uuid 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:06:23.811111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.compute.api [None req-52fdd3cf-745c-4b7a-bc4b-e477bcdc1605 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Instance is already in deleting state, ignoring this request May 12 07:06:23.816275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-52fdd3cf-745c-4b7a-bc4b-e477bcdc1605 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 204 len: 0 microversion: 2.1 time: 0.148520 May 12 07:06:23.816275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 442/1034] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:06:23 2022] DELETE /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:06:23.817735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a7236882-4ddb-4d6e-9282-7c4ceec86257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:06:23.818241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a7236882-4ddb-4d6e-9282-7c4ceec86257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:06:23.823803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7236882-4ddb-4d6e-9282-7c4ceec86257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:23.824245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7236882-4ddb-4d6e-9282-7c4ceec86257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:23.825028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7236882-4ddb-4d6e-9282-7c4ceec86257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:23.825469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7236882-4ddb-4d6e-9282-7c4ceec86257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:23.914419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-bd525d97-4bd9-4146-8fc2-1ef42f8edb93 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3751d9d-c830-481f-84d1-a56fcc7703b4) May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bd525d97-4bd9-4146-8fc2-1ef42f8edb93 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Request method failure captured: May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa HTTP/1.1 May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK8ujFutJ1CNJanI_0vNR4F3KIHGfL1xiqqQLZq6PdCD0V9d78CPP4g0Hw24R_KABikxq3ALKiG_uHq95uBZ0jMyxtCdzLudEMBcGTfKqoQ6hUiK34PImJnkm5aI6Hujes6d9fZnP_1cKtGKexmoQR95wyXnd318jdOwp8C2sqbHscU May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: ff1faa1fff1642a0b9c78bc88800cbd4 May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:06:23.916706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:06:23.926914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1faa1fff1642a0b9c78bc88800cbd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff1faa1fff1642a0b9c78bc88800cbd4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1faa1fff1642a0b9c78bc88800cbd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff1faa1fff1642a0b9c78bc88800cbd4"}]}] May 12 07:06:23.926914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:06:23.926914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: ff1faa1fff1642a0b9c78bc88800cbd4 May 12 07:06:23.926914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:06:23.926914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-VolumesSnapshotTestJSON-1513271114-project May 12 07:06:23.926914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:06:23.926914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:06:23.926914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: e392ce5fe3514e7996676d8bcd5cceb2 May 12 07:06:23.926914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-VolumesSnapshotTestJSON-1513271114-project May 12 07:06:23.926914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3751d9d-c830-481f-84d1-a56fcc7703b4) May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'server_id': '19ebfe3f-ca98-4256-96c2-2bdb6f5a838f', 'id': 'a2e3b708-5eaf-4e1e-a129-282f8a70bcaa'} May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:06:23.928037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3751d9d-c830-481f-84d1-a56fcc7703b4) May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:06:23.929291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3751d9d-c830-481f-84d1-a56fcc7703b4) May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:23.930683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3751d9d-c830-481f-84d1-a56fcc7703b4) May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:06:23.931915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3751d9d-c830-481f-84d1-a56fcc7703b4) May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3751d9d-c830-481f-84d1-a56fcc7703b4) May 12 07:06:23.933161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:23.934519 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bd525d97-4bd9-4146-8fc2-1ef42f8edb93 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3751d9d-c830-481f-84d1-a56fcc7703b4) {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:06:23.934519 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bd525d97-4bd9-4146-8fc2-1ef42f8edb93 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa" status: 400 len: 269 microversion: 2.1 time: 80.212857 May 12 07:06:23.934519 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 593/1035] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:05:03 2022] DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa => generated 269 bytes in 80214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 07:06:23.934519 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e6c284a3-e5b8-4fcd-a9c3-ee33b71cdef8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:06:23.934911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e6c284a3-e5b8-4fcd-a9c3-ee33b71cdef8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:06:23.934911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6c284a3-e5b8-4fcd-a9c3-ee33b71cdef8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:23.934911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6c284a3-e5b8-4fcd-a9c3-ee33b71cdef8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:23.934911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6c284a3-e5b8-4fcd-a9c3-ee33b71cdef8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:23.935271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6c284a3-e5b8-4fcd-a9c3-ee33b71cdef8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:23.960992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-a7236882-4ddb-4d6e-9282-7c4ceec86257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'services' on Instance uuid d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:06:24.018142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-e6c284a3-e5b8-4fcd-a9c3-ee33b71cdef8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lazy-loading 'services' on Instance uuid 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:06:24.043483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-a7236882-4ddb-4d6e-9282-7c4ceec86257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4017b8d-4be3-41b2-a4dc-2c2c2535252c) May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a7236882-4ddb-4d6e-9282-7c4ceec86257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c HTTP/1.1 May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:06:24.045828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:06:24.047747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 07:06:24.047747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:06:24.047747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:06:24.047747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:06:24.047747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:06:24.047747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:06:24.047747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:06:24.047747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 07:06:24.047747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:06:24.047747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4017b8d-4be3-41b2-a4dc-2c2c2535252c) May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'server_id': 'd1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106', 'id': 'ce7be931-41dc-455d-b15d-fbd24ac0f57c'} May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:06:24.049135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4017b8d-4be3-41b2-a4dc-2c2c2535252c) May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:06:24.050960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4017b8d-4be3-41b2-a4dc-2c2c2535252c) May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:24.052533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4017b8d-4be3-41b2-a4dc-2c2c2535252c) May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:06:24.053869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4017b8d-4be3-41b2-a4dc-2c2c2535252c) May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4017b8d-4be3-41b2-a4dc-2c2c2535252c) May 12 07:06:24.055228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:06:24.056515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a7236882-4ddb-4d6e-9282-7c4ceec86257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4017b8d-4be3-41b2-a4dc-2c2c2535252c) {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:06:24.056515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a7236882-4ddb-4d6e-9282-7c4ceec86257 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c" status: 400 len: 269 microversion: 2.1 time: 0.235600 May 12 07:06:24.056515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 443/1036] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:06:23 2022] DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c => generated 269 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 07:06:24.056515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-64bd4988-7794-489b-8ca8-0d514dc2e521 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:06:24.057478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-64bd4988-7794-489b-8ca8-0d514dc2e521 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:06:24.063443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64bd4988-7794-489b-8ca8-0d514dc2e521 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:24.068992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64bd4988-7794-489b-8ca8-0d514dc2e521 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:24.068992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64bd4988-7794-489b-8ca8-0d514dc2e521 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:24.068992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64bd4988-7794-489b-8ca8-0d514dc2e521 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:24.095080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-64bd4988-7794-489b-8ca8-0d514dc2e521 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042538 May 12 07:06:24.095635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 444/1037] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:06:24 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:06:24.100508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b4efce92-c6b7-4a60-9d0a-3c2583b51ca3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:06:24.101000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b4efce92-c6b7-4a60-9d0a-3c2583b51ca3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:06:24.106374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4efce92-c6b7-4a60-9d0a-3c2583b51ca3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:24.106824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4efce92-c6b7-4a60-9d0a-3c2583b51ca3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:24.107598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4efce92-c6b7-4a60-9d0a-3c2583b51ca3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:24.108744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4efce92-c6b7-4a60-9d0a-3c2583b51ca3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-e6c284a3-e5b8-4fcd-a9c3-ee33b71cdef8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-af842576-0b15-451e-af78-082db26a0649) May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e6c284a3-e5b8-4fcd-a9c3-ee33b71cdef8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Request method failure captured: May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa HTTP/1.1 May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK8ujFutJ1CNJanI_0vNR4F3KIHGfL1xiqqQLZq6PdCD0V9d78CPP4g0Hw24R_KABikxq3ALKiG_uHq95uBZ0jMyxtCdzLudEMBcGTfKqoQ6hUiK34PImJnkm5aI6Hujes6d9fZnP_1cKtGKexmoQR95wyXnd318jdOwp8C2sqbHscU May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: ff1faa1fff1642a0b9c78bc88800cbd4 May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:06:24.126570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:06:24.128287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1faa1fff1642a0b9c78bc88800cbd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff1faa1fff1642a0b9c78bc88800cbd4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1faa1fff1642a0b9c78bc88800cbd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff1faa1fff1642a0b9c78bc88800cbd4"}]}] May 12 07:06:24.128287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:06:24.128287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: ff1faa1fff1642a0b9c78bc88800cbd4 May 12 07:06:24.128287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:06:24.128287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-VolumesSnapshotTestJSON-1513271114-project May 12 07:06:24.128287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:06:24.128287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:06:24.128287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: e392ce5fe3514e7996676d8bcd5cceb2 May 12 07:06:24.128287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-VolumesSnapshotTestJSON-1513271114-project May 12 07:06:24.128287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-af842576-0b15-451e-af78-082db26a0649) May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'server_id': '19ebfe3f-ca98-4256-96c2-2bdb6f5a838f', 'id': 'a2e3b708-5eaf-4e1e-a129-282f8a70bcaa'} May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:06:24.129108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-af842576-0b15-451e-af78-082db26a0649) May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:06:24.130465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-af842576-0b15-451e-af78-082db26a0649) May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:24.131830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-af842576-0b15-451e-af78-082db26a0649) May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:06:24.133051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-af842576-0b15-451e-af78-082db26a0649) May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-af842576-0b15-451e-af78-082db26a0649) May 12 07:06:24.134349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:06:24.135575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e6c284a3-e5b8-4fcd-a9c3-ee33b71cdef8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-af842576-0b15-451e-af78-082db26a0649) {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:06:24.135575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e6c284a3-e5b8-4fcd-a9c3-ee33b71cdef8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa" status: 400 len: 269 microversion: 2.1 time: 0.207865 May 12 07:06:24.135575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 594/1038] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:06:23 2022] DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa => generated 269 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 07:06:24.135575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-54fadac9-f2d8-4ae8-b677-81ce836f0bc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:06:24.136243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-54fadac9-f2d8-4ae8-b677-81ce836f0bc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:06:24.136347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b4efce92-c6b7-4a60-9d0a-3c2583b51ca3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:06:24.139454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54fadac9-f2d8-4ae8-b677-81ce836f0bc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:24.139969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54fadac9-f2d8-4ae8-b677-81ce836f0bc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:24.140754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54fadac9-f2d8-4ae8-b677-81ce836f0bc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:24.141192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54fadac9-f2d8-4ae8-b677-81ce836f0bc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:24.182422 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.compute.api [None req-b4efce92-c6b7-4a60-9d0a-3c2583b51ca3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Instance is already in deleting state, ignoring this request May 12 07:06:24.183346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b4efce92-c6b7-4a60-9d0a-3c2583b51ca3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 204 len: 0 microversion: 2.1 time: 0.086706 May 12 07:06:24.183975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 445/1039] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:06:24 2022] DELETE /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:06:24.188560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9a04cade-b45c-49d2-84a7-1b6fe112e5de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:06:24.189083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9a04cade-b45c-49d2-84a7-1b6fe112e5de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:06:24.194885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a04cade-b45c-49d2-84a7-1b6fe112e5de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:24.195360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a04cade-b45c-49d2-84a7-1b6fe112e5de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:24.196203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a04cade-b45c-49d2-84a7-1b6fe112e5de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:06:24.196649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a04cade-b45c-49d2-84a7-1b6fe112e5de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:06:24.225091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-54fadac9-f2d8-4ae8-b677-81ce836f0bc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'services' on Instance uuid d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:06:24.277897 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-9a04cade-b45c-49d2-84a7-1b6fe112e5de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lazy-loading 'services' on Instance uuid 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:06:41.007640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:06:41.012907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa (ip 10.222.0.25) !!! May 12 07:06:50.018168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:06:50.018646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:06:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c (ip 10.222.0.25) !!! May 12 07:06:56.556997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:06:56.557629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:06:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c (ip 10.222.0.25) !!! May 12 07:07:03.793415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-54fadac9-f2d8-4ae8-b677-81ce836f0bc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e3ddc16-0849-495b-8a1f-94c84043cabd) May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-54fadac9-f2d8-4ae8-b677-81ce836f0bc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c HTTP/1.1 May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:07:03.794002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:07:03.795823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 07:07:03.795823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:07:03.795823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:07:03.795823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:07:03.795823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:07:03.795823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:07:03.795823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:07:03.795823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 07:07:03.795823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:07:03.795823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e3ddc16-0849-495b-8a1f-94c84043cabd) May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'server_id': 'd1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106', 'id': 'ce7be931-41dc-455d-b15d-fbd24ac0f57c'} May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:07:03.796971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e3ddc16-0849-495b-8a1f-94c84043cabd) May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:07:03.798422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e3ddc16-0849-495b-8a1f-94c84043cabd) May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:03.800199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e3ddc16-0849-495b-8a1f-94c84043cabd) May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:07:03.801751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e3ddc16-0849-495b-8a1f-94c84043cabd) May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e3ddc16-0849-495b-8a1f-94c84043cabd) May 12 07:07:03.803424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:03.805034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-54fadac9-f2d8-4ae8-b677-81ce836f0bc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e3ddc16-0849-495b-8a1f-94c84043cabd) {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:07:03.805034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-54fadac9-f2d8-4ae8-b677-81ce836f0bc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c" status: 400 len: 269 microversion: 2.1 time: 39.665752 May 12 07:07:03.805034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 595/1040] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:06:24 2022] DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c => generated 269 bytes in 39667 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 07:07:03.805034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-384d054c-8381-4cb9-9be2-6f2cdf6fffcf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:03.805467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-384d054c-8381-4cb9-9be2-6f2cdf6fffcf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:03.811123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-384d054c-8381-4cb9-9be2-6f2cdf6fffcf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:03.811572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-384d054c-8381-4cb9-9be2-6f2cdf6fffcf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:03.812410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-384d054c-8381-4cb9-9be2-6f2cdf6fffcf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:03.812894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-384d054c-8381-4cb9-9be2-6f2cdf6fffcf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-9a04cade-b45c-49d2-84a7-1b6fe112e5de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a841cf65-39d2-4ca0-96b2-5bc35b317551) May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9a04cade-b45c-49d2-84a7-1b6fe112e5de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Request method failure captured: May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa HTTP/1.1 May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK8ujFutJ1CNJanI_0vNR4F3KIHGfL1xiqqQLZq6PdCD0V9d78CPP4g0Hw24R_KABikxq3ALKiG_uHq95uBZ0jMyxtCdzLudEMBcGTfKqoQ6hUiK34PImJnkm5aI6Hujes6d9fZnP_1cKtGKexmoQR95wyXnd318jdOwp8C2sqbHscU May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: ff1faa1fff1642a0b9c78bc88800cbd4 May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:07:03.835048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:07:03.837669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1faa1fff1642a0b9c78bc88800cbd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff1faa1fff1642a0b9c78bc88800cbd4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1faa1fff1642a0b9c78bc88800cbd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff1faa1fff1642a0b9c78bc88800cbd4"}]}] May 12 07:07:03.837669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:07:03.837669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: ff1faa1fff1642a0b9c78bc88800cbd4 May 12 07:07:03.837669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:07:03.837669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-VolumesSnapshotTestJSON-1513271114-project May 12 07:07:03.837669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:07:03.837669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:07:03.837669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: e392ce5fe3514e7996676d8bcd5cceb2 May 12 07:07:03.837669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-VolumesSnapshotTestJSON-1513271114-project May 12 07:07:03.837669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a841cf65-39d2-4ca0-96b2-5bc35b317551) May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'server_id': '19ebfe3f-ca98-4256-96c2-2bdb6f5a838f', 'id': 'a2e3b708-5eaf-4e1e-a129-282f8a70bcaa'} May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:07:03.838428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a841cf65-39d2-4ca0-96b2-5bc35b317551) May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:07:03.840494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a841cf65-39d2-4ca0-96b2-5bc35b317551) May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:03.842787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a841cf65-39d2-4ca0-96b2-5bc35b317551) May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:07:03.844922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a841cf65-39d2-4ca0-96b2-5bc35b317551) May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a841cf65-39d2-4ca0-96b2-5bc35b317551) May 12 07:07:03.847249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:03.851019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9a04cade-b45c-49d2-84a7-1b6fe112e5de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a841cf65-39d2-4ca0-96b2-5bc35b317551) {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:07:03.851019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9a04cade-b45c-49d2-84a7-1b6fe112e5de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa" status: 400 len: 269 microversion: 2.1 time: 39.648880 May 12 07:07:03.851019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 446/1041] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:06:24 2022] DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa => generated 269 bytes in 39650 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 07:07:03.851407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-384d054c-8381-4cb9-9be2-6f2cdf6fffcf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049972 May 12 07:07:03.851407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 596/1042] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:03 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:03.853156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-333a3215-cccc-4a10-b026-3390925c659e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:03.853309 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cfde9d1b-db0b-4a65-9a5b-04940f1ab8df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:03.853650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-333a3215-cccc-4a10-b026-3390925c659e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:03.854136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cfde9d1b-db0b-4a65-9a5b-04940f1ab8df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:03.859660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-333a3215-cccc-4a10-b026-3390925c659e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:03.860163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-333a3215-cccc-4a10-b026-3390925c659e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:03.860948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-333a3215-cccc-4a10-b026-3390925c659e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:03.861048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfde9d1b-db0b-4a65-9a5b-04940f1ab8df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:03.861385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-333a3215-cccc-4a10-b026-3390925c659e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:03.861499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfde9d1b-db0b-4a65-9a5b-04940f1ab8df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:03.862421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfde9d1b-db0b-4a65-9a5b-04940f1ab8df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:03.862872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfde9d1b-db0b-4a65-9a5b-04940f1ab8df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:03.886466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-333a3215-cccc-4a10-b026-3390925c659e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:07:03.967546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-cfde9d1b-db0b-4a65-9a5b-04940f1ab8df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'services' on Instance uuid d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:07:04.026860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-cfde9d1b-db0b-4a65-9a5b-04940f1ab8df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d44ad24-769c-42e1-a84b-4dc88032e0d0) May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cfde9d1b-db0b-4a65-9a5b-04940f1ab8df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c HTTP/1.1 May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:07:04.029630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:07:04.031077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 07:07:04.031077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:07:04.031077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:07:04.031077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:07:04.031077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:07:04.031077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:07:04.031077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:07:04.031077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 07:07:04.031077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:07:04.031077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d44ad24-769c-42e1-a84b-4dc88032e0d0) May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'server_id': 'd1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106', 'id': 'ce7be931-41dc-455d-b15d-fbd24ac0f57c'} May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:07:04.031875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d44ad24-769c-42e1-a84b-4dc88032e0d0) May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:07:04.033077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d44ad24-769c-42e1-a84b-4dc88032e0d0) May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:04.034431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d44ad24-769c-42e1-a84b-4dc88032e0d0) May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:07:04.036666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d44ad24-769c-42e1-a84b-4dc88032e0d0) May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d44ad24-769c-42e1-a84b-4dc88032e0d0) May 12 07:07:04.039366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:07:04.042046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.compute.api [None req-333a3215-cccc-4a10-b026-3390925c659e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Instance is already in deleting state, ignoring this request May 12 07:07:04.042046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-333a3215-cccc-4a10-b026-3390925c659e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 204 len: 0 microversion: 2.1 time: 0.188032 May 12 07:07:04.042046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 447/1043] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:07:03 2022] DELETE /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:07:04.042046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-55bb183e-793e-4721-b8cb-37d6f5cd82c4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:04.042046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-55bb183e-793e-4721-b8cb-37d6f5cd82c4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:04.042791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cfde9d1b-db0b-4a65-9a5b-04940f1ab8df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d44ad24-769c-42e1-a84b-4dc88032e0d0) {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:07:04.042791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cfde9d1b-db0b-4a65-9a5b-04940f1ab8df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c" status: 400 len: 269 microversion: 2.1 time: 0.193115 May 12 07:07:04.042791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 597/1044] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:07:03 2022] DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments/ce7be931-41dc-455d-b15d-fbd24ac0f57c => generated 269 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 07:07:04.047602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7b4a0a79-9e5b-446d-805b-d1f75ea71e28 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:04.048594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7b4a0a79-9e5b-446d-805b-d1f75ea71e28 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:04.049405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55bb183e-793e-4721-b8cb-37d6f5cd82c4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:04.049868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55bb183e-793e-4721-b8cb-37d6f5cd82c4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:04.050665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55bb183e-793e-4721-b8cb-37d6f5cd82c4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:04.051108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55bb183e-793e-4721-b8cb-37d6f5cd82c4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:04.062404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b4a0a79-9e5b-446d-805b-d1f75ea71e28 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:04.062404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b4a0a79-9e5b-446d-805b-d1f75ea71e28 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:04.062404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b4a0a79-9e5b-446d-805b-d1f75ea71e28 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:04.062404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b4a0a79-9e5b-446d-805b-d1f75ea71e28 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:04.088680 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7b4a0a79-9e5b-446d-805b-d1f75ea71e28 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045053 May 12 07:07:04.089441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 598/1045] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:04 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:04.094111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-efb45976-2987-4b18-a504-84b4678b18a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:04.094718 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-efb45976-2987-4b18-a504-84b4678b18a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:04.100908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efb45976-2987-4b18-a504-84b4678b18a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:04.101373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efb45976-2987-4b18-a504-84b4678b18a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:04.102247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efb45976-2987-4b18-a504-84b4678b18a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:04.102698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efb45976-2987-4b18-a504-84b4678b18a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:04.141684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-55bb183e-793e-4721-b8cb-37d6f5cd82c4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lazy-loading 'services' on Instance uuid 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:07:04.200245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-55bb183e-793e-4721-b8cb-37d6f5cd82c4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbff790a-9d02-4089-8257-fa33a31f1923) May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-55bb183e-793e-4721-b8cb-37d6f5cd82c4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Request method failure captured: May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa HTTP/1.1 May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK8ujFutJ1CNJanI_0vNR4F3KIHGfL1xiqqQLZq6PdCD0V9d78CPP4g0Hw24R_KABikxq3ALKiG_uHq95uBZ0jMyxtCdzLudEMBcGTfKqoQ6hUiK34PImJnkm5aI6Hujes6d9fZnP_1cKtGKexmoQR95wyXnd318jdOwp8C2sqbHscU May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: ff1faa1fff1642a0b9c78bc88800cbd4 May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:07:04.202579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:07:04.203908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1faa1fff1642a0b9c78bc88800cbd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff1faa1fff1642a0b9c78bc88800cbd4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1faa1fff1642a0b9c78bc88800cbd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff1faa1fff1642a0b9c78bc88800cbd4"}]}] May 12 07:07:04.203908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:07:04.203908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: ff1faa1fff1642a0b9c78bc88800cbd4 May 12 07:07:04.203908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1513271114 May 12 07:07:04.203908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-VolumesSnapshotTestJSON-1513271114-project May 12 07:07:04.203908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:07:04.203908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:07:04.203908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: e392ce5fe3514e7996676d8bcd5cceb2 May 12 07:07:04.203908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-VolumesSnapshotTestJSON-1513271114-project May 12 07:07:04.203908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbff790a-9d02-4089-8257-fa33a31f1923) May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'server_id': '19ebfe3f-ca98-4256-96c2-2bdb6f5a838f', 'id': 'a2e3b708-5eaf-4e1e-a129-282f8a70bcaa'} May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:07:04.204521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbff790a-9d02-4089-8257-fa33a31f1923) May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:07:04.206563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbff790a-9d02-4089-8257-fa33a31f1923) May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:04.207735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbff790a-9d02-4089-8257-fa33a31f1923) May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:07:04.209852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbff790a-9d02-4089-8257-fa33a31f1923) May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbff790a-9d02-4089-8257-fa33a31f1923) May 12 07:07:04.213063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:07:04.215061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-55bb183e-793e-4721-b8cb-37d6f5cd82c4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbff790a-9d02-4089-8257-fa33a31f1923) {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:07:04.215061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-55bb183e-793e-4721-b8cb-37d6f5cd82c4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa" status: 400 len: 269 microversion: 2.1 time: 0.168082 May 12 07:07:04.215061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 448/1046] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:07:04 2022] DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f/os-volume_attachments/a2e3b708-5eaf-4e1e-a129-282f8a70bcaa => generated 269 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 07:07:04.215061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ccaefb65-3a1b-4a5a-aec3-2a8b78a5e068 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:04.216901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ccaefb65-3a1b-4a5a-aec3-2a8b78a5e068 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:04.221830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ccaefb65-3a1b-4a5a-aec3-2a8b78a5e068 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:04.222282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ccaefb65-3a1b-4a5a-aec3-2a8b78a5e068 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:04.223145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ccaefb65-3a1b-4a5a-aec3-2a8b78a5e068 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:04.223489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ccaefb65-3a1b-4a5a-aec3-2a8b78a5e068 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:04.249436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-efb45976-2987-4b18-a504-84b4678b18a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:04.257302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-efb45976-2987-4b18-a504-84b4678b18a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1450 microversion: 2.1 time: 0.167022 May 12 07:07:04.267959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ccaefb65-3a1b-4a5a-aec3-2a8b78a5e068 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053966 May 12 07:07:04.267959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 449/1048] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:04.268255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 599/1048] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:04.680109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-7d2ca4e7-3730-49fd-afc5-6a58136d1a2d req-7927303f-eaea-4e97-bf17-2df90061cf9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0fa87a-f20f-489f-b64c-04073a58a792", "name": "network-vif-deleted", "tag": "bbe011a7-6d2c-4588-95a8-e8d354355950"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:07:04.688536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-7d2ca4e7-3730-49fd-afc5-6a58136d1a2d req-7927303f-eaea-4e97-bf17-2df90061cf9c service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:04.688988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-7d2ca4e7-3730-49fd-afc5-6a58136d1a2d req-7927303f-eaea-4e97-bf17-2df90061cf9c service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:04.701483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-7d2ca4e7-3730-49fd-afc5-6a58136d1a2d req-7927303f-eaea-4e97-bf17-2df90061cf9c service nova] Creating event network-vif-deleted:bbe011a7-6d2c-4588-95a8-e8d354355950 for instance 0f0fa87a-f20f-489f-b64c-04073a58a792 on hv-cinder-76606 May 12 07:07:04.706589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-7d2ca4e7-3730-49fd-afc5-6a58136d1a2d req-7927303f-eaea-4e97-bf17-2df90061cf9c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164855 May 12 07:07:04.707177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 450/1049] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:05.101091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7220934c-b86e-433b-bb28-a6074f46c631 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:05.102057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7220934c-b86e-433b-bb28-a6074f46c631 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:05.108401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7220934c-b86e-433b-bb28-a6074f46c631 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:05.108848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7220934c-b86e-433b-bb28-a6074f46c631 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:05.109639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7220934c-b86e-433b-bb28-a6074f46c631 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:05.110072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7220934c-b86e-433b-bb28-a6074f46c631 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:05.138903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7220934c-b86e-433b-bb28-a6074f46c631 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041829 May 12 07:07:05.139441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 600/1050] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:05 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:05.276978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-de5fc373-152b-4e1d-ae6c-88980ce6e5f0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:05.277591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-de5fc373-152b-4e1d-ae6c-88980ce6e5f0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:05.278403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-677daf15-da8d-404f-9b06-88baf90d2033 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:05.279322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-677daf15-da8d-404f-9b06-88baf90d2033 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:05.283783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de5fc373-152b-4e1d-ae6c-88980ce6e5f0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:05.284236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de5fc373-152b-4e1d-ae6c-88980ce6e5f0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:05.285008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de5fc373-152b-4e1d-ae6c-88980ce6e5f0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:05.285176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-677daf15-da8d-404f-9b06-88baf90d2033 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:05.285445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de5fc373-152b-4e1d-ae6c-88980ce6e5f0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:05.285631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-677daf15-da8d-404f-9b06-88baf90d2033 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:05.286396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-677daf15-da8d-404f-9b06-88baf90d2033 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:05.286833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-677daf15-da8d-404f-9b06-88baf90d2033 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:05.316275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-677daf15-da8d-404f-9b06-88baf90d2033 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041687 May 12 07:07:05.316929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 601/1051] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:07:05.347114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de5fc373-152b-4e1d-ae6c-88980ce6e5f0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:05.354438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-de5fc373-152b-4e1d-ae6c-88980ce6e5f0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081850 May 12 07:07:05.354989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 451/1052] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:05 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:06.149879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d927571e-3a69-4316-9c09-3c73abf628cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:06.150786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d927571e-3a69-4316-9c09-3c73abf628cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:06.156994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d927571e-3a69-4316-9c09-3c73abf628cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:06.157443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d927571e-3a69-4316-9c09-3c73abf628cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:06.158205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d927571e-3a69-4316-9c09-3c73abf628cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:06.158639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d927571e-3a69-4316-9c09-3c73abf628cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:06.187526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d927571e-3a69-4316-9c09-3c73abf628cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041715 May 12 07:07:06.188093 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 602/1053] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:06 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:06.328012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0ca46e0d-e64e-40fc-a8a6-6da99ad6800f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:06.328908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0ca46e0d-e64e-40fc-a8a6-6da99ad6800f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:06.335186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0ca46e0d-e64e-40fc-a8a6-6da99ad6800f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:06.335639 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0ca46e0d-e64e-40fc-a8a6-6da99ad6800f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:06.336441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0ca46e0d-e64e-40fc-a8a6-6da99ad6800f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:06.336887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0ca46e0d-e64e-40fc-a8a6-6da99ad6800f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:06.365100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0ca46e0d-e64e-40fc-a8a6-6da99ad6800f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041179 May 12 07:07:06.365645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 452/1054] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:06.371813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e18cff61-7f5c-450a-a712-8ac17c06175b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:06.372433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e18cff61-7f5c-450a-a712-8ac17c06175b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:06.378219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e18cff61-7f5c-450a-a712-8ac17c06175b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:06.378666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e18cff61-7f5c-450a-a712-8ac17c06175b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:06.379434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e18cff61-7f5c-450a-a712-8ac17c06175b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:06.379903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e18cff61-7f5c-450a-a712-8ac17c06175b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:06.438688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e18cff61-7f5c-450a-a712-8ac17c06175b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:06.445965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e18cff61-7f5c-450a-a712-8ac17c06175b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078636 May 12 07:07:06.446525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 603/1055] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:06 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:07.199207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a69b5668-ab93-4099-89b2-8e87043b69db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:07.200072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a69b5668-ab93-4099-89b2-8e87043b69db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:07.205972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a69b5668-ab93-4099-89b2-8e87043b69db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:07.206336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a69b5668-ab93-4099-89b2-8e87043b69db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:07.207098 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a69b5668-ab93-4099-89b2-8e87043b69db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:07.207532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a69b5668-ab93-4099-89b2-8e87043b69db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:07.235327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a69b5668-ab93-4099-89b2-8e87043b69db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040155 May 12 07:07:07.235898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 453/1056] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:07 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:07.377055 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-32676fe0-b7c1-4425-a4c9-4f65a3015826 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:07.377974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-32676fe0-b7c1-4425-a4c9-4f65a3015826 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:07.384345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32676fe0-b7c1-4425-a4c9-4f65a3015826 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:07.384796 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32676fe0-b7c1-4425-a4c9-4f65a3015826 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:07.385555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32676fe0-b7c1-4425-a4c9-4f65a3015826 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:07.385987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32676fe0-b7c1-4425-a4c9-4f65a3015826 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:07.414162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-32676fe0-b7c1-4425-a4c9-4f65a3015826 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041081 May 12 07:07:07.415398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 604/1057] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:07 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:07.462725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d7895713-2ad3-4a61-b018-cb9a56fe2ae7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:07.463275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d7895713-2ad3-4a61-b018-cb9a56fe2ae7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:07.469522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7895713-2ad3-4a61-b018-cb9a56fe2ae7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:07.469971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7895713-2ad3-4a61-b018-cb9a56fe2ae7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:07.470740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7895713-2ad3-4a61-b018-cb9a56fe2ae7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:07.471181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7895713-2ad3-4a61-b018-cb9a56fe2ae7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:07.534732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d7895713-2ad3-4a61-b018-cb9a56fe2ae7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:07.542499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d7895713-2ad3-4a61-b018-cb9a56fe2ae7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084178 May 12 07:07:07.543130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 454/1058] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:07 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:08.247278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e09e7bf0-4791-4876-93b3-005ef604d6e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:08.248169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e09e7bf0-4791-4876-93b3-005ef604d6e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:08.253980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e09e7bf0-4791-4876-93b3-005ef604d6e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:08.254434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e09e7bf0-4791-4876-93b3-005ef604d6e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:08.255206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e09e7bf0-4791-4876-93b3-005ef604d6e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:08.255643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e09e7bf0-4791-4876-93b3-005ef604d6e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:08.284323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e09e7bf0-4791-4876-93b3-005ef604d6e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041732 May 12 07:07:08.284950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 605/1059] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:08 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:08.425719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-58fc256f-6df8-41d7-897b-8c4664b1a557 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:08.426641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-58fc256f-6df8-41d7-897b-8c4664b1a557 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:08.433156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-58fc256f-6df8-41d7-897b-8c4664b1a557 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:08.433608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-58fc256f-6df8-41d7-897b-8c4664b1a557 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:08.434381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-58fc256f-6df8-41d7-897b-8c4664b1a557 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:08.434821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-58fc256f-6df8-41d7-897b-8c4664b1a557 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:08.462301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-58fc256f-6df8-41d7-897b-8c4664b1a557 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040799 May 12 07:07:08.462836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 455/1060] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:08.559086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b75ff497-034b-4a66-a626-872b2da007e4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:08.559620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b75ff497-034b-4a66-a626-872b2da007e4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:08.565989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b75ff497-034b-4a66-a626-872b2da007e4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:08.566437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b75ff497-034b-4a66-a626-872b2da007e4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:08.567197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b75ff497-034b-4a66-a626-872b2da007e4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:08.567627 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b75ff497-034b-4a66-a626-872b2da007e4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:08.629346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b75ff497-034b-4a66-a626-872b2da007e4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:08.636655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b75ff497-034b-4a66-a626-872b2da007e4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082265 May 12 07:07:08.637223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 606/1061] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:08 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:09.296524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-10278bc3-3910-42f7-beb8-60f248fb26c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:09.297442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-10278bc3-3910-42f7-beb8-60f248fb26c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:09.303961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10278bc3-3910-42f7-beb8-60f248fb26c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:09.304421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10278bc3-3910-42f7-beb8-60f248fb26c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:09.305856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10278bc3-3910-42f7-beb8-60f248fb26c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:09.306299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10278bc3-3910-42f7-beb8-60f248fb26c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:09.334466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-10278bc3-3910-42f7-beb8-60f248fb26c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041866 May 12 07:07:09.335019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 456/1062] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:09 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:09.472721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-09c0607f-f960-4a61-9835-cd5f4b9fda61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:09.473571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-09c0607f-f960-4a61-9835-cd5f4b9fda61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:09.480031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09c0607f-f960-4a61-9835-cd5f4b9fda61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:09.480476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09c0607f-f960-4a61-9835-cd5f4b9fda61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:09.481243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09c0607f-f960-4a61-9835-cd5f4b9fda61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:09.481675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09c0607f-f960-4a61-9835-cd5f4b9fda61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:09.510940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-09c0607f-f960-4a61-9835-cd5f4b9fda61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042233 May 12 07:07:09.511483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 607/1063] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:09.653279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6447777b-3265-4af8-a89f-0ddcfb535cfb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:09.653889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6447777b-3265-4af8-a89f-0ddcfb535cfb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:09.659760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6447777b-3265-4af8-a89f-0ddcfb535cfb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:09.660213 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6447777b-3265-4af8-a89f-0ddcfb535cfb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:09.660986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6447777b-3265-4af8-a89f-0ddcfb535cfb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:09.661424 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6447777b-3265-4af8-a89f-0ddcfb535cfb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:09.720656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6447777b-3265-4af8-a89f-0ddcfb535cfb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:09.728537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6447777b-3265-4af8-a89f-0ddcfb535cfb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079567 May 12 07:07:09.729040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 457/1064] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:09 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:10.346173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9e71cf6c-af6c-4703-a67e-8c5a7b3f2b3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:10.347018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9e71cf6c-af6c-4703-a67e-8c5a7b3f2b3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:10.353953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e71cf6c-af6c-4703-a67e-8c5a7b3f2b3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:10.354403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e71cf6c-af6c-4703-a67e-8c5a7b3f2b3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:10.355167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e71cf6c-af6c-4703-a67e-8c5a7b3f2b3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:10.355606 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e71cf6c-af6c-4703-a67e-8c5a7b3f2b3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:10.383599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9e71cf6c-af6c-4703-a67e-8c5a7b3f2b3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041539 May 12 07:07:10.384180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 608/1065] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:10 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:10.522228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-35b772fa-a169-4265-a77c-5dc9306ca28d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:10.523177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-35b772fa-a169-4265-a77c-5dc9306ca28d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:10.529431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35b772fa-a169-4265-a77c-5dc9306ca28d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:10.529881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35b772fa-a169-4265-a77c-5dc9306ca28d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:10.530649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35b772fa-a169-4265-a77c-5dc9306ca28d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:10.531082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35b772fa-a169-4265-a77c-5dc9306ca28d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:10.559357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-35b772fa-a169-4265-a77c-5dc9306ca28d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041038 May 12 07:07:10.559938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 458/1066] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:10.745595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f0532ece-7bc5-4349-a12b-9c8b4a277064 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:10.746218 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f0532ece-7bc5-4349-a12b-9c8b4a277064 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:10.752164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0532ece-7bc5-4349-a12b-9c8b4a277064 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:10.752613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0532ece-7bc5-4349-a12b-9c8b4a277064 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:10.753383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0532ece-7bc5-4349-a12b-9c8b4a277064 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:10.753829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0532ece-7bc5-4349-a12b-9c8b4a277064 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:10.813218 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f0532ece-7bc5-4349-a12b-9c8b4a277064 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:10.821035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f0532ece-7bc5-4349-a12b-9c8b4a277064 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079388 May 12 07:07:10.821613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 609/1067] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:10 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:11.395076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e41ec777-2d3a-4953-a15c-f610d14a72de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:11.395933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e41ec777-2d3a-4953-a15c-f610d14a72de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:11.401846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e41ec777-2d3a-4953-a15c-f610d14a72de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:11.402291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e41ec777-2d3a-4953-a15c-f610d14a72de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:11.403052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e41ec777-2d3a-4953-a15c-f610d14a72de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:11.403487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e41ec777-2d3a-4953-a15c-f610d14a72de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:11.432123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e41ec777-2d3a-4953-a15c-f610d14a72de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041051 May 12 07:07:11.432657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 459/1068] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:11 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:11.570952 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-33649bc8-d291-4a31-bd47-40f6a1fa4de8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:11.571921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-33649bc8-d291-4a31-bd47-40f6a1fa4de8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:11.578256 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33649bc8-d291-4a31-bd47-40f6a1fa4de8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:11.578711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33649bc8-d291-4a31-bd47-40f6a1fa4de8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:11.579492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33649bc8-d291-4a31-bd47-40f6a1fa4de8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:11.579960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33649bc8-d291-4a31-bd47-40f6a1fa4de8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:11.609918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-33649bc8-d291-4a31-bd47-40f6a1fa4de8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042993 May 12 07:07:11.610472 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 610/1069] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:11.837508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8de03103-89c6-436a-87be-1ec0a59247cb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:11.838117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8de03103-89c6-436a-87be-1ec0a59247cb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:11.844428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8de03103-89c6-436a-87be-1ec0a59247cb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:11.844873 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8de03103-89c6-436a-87be-1ec0a59247cb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:11.845629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8de03103-89c6-436a-87be-1ec0a59247cb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:11.846063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8de03103-89c6-436a-87be-1ec0a59247cb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:11.909312 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8de03103-89c6-436a-87be-1ec0a59247cb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:11.916608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8de03103-89c6-436a-87be-1ec0a59247cb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082874 May 12 07:07:11.917173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 460/1070] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:11 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:12.443641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-911429bf-89f0-4952-9b18-0b0211a2294a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:12.444593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-911429bf-89f0-4952-9b18-0b0211a2294a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:12.451069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-911429bf-89f0-4952-9b18-0b0211a2294a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:12.451524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-911429bf-89f0-4952-9b18-0b0211a2294a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:12.452333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-911429bf-89f0-4952-9b18-0b0211a2294a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:12.452772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-911429bf-89f0-4952-9b18-0b0211a2294a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:12.481207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-911429bf-89f0-4952-9b18-0b0211a2294a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041622 May 12 07:07:12.481752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 611/1071] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:12 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:12.621952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-89d5f363-bc24-4104-bbed-e47dc41be626 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:12.622881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-89d5f363-bc24-4104-bbed-e47dc41be626 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:12.628816 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89d5f363-bc24-4104-bbed-e47dc41be626 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:12.629272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89d5f363-bc24-4104-bbed-e47dc41be626 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:12.630047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89d5f363-bc24-4104-bbed-e47dc41be626 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:12.630489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89d5f363-bc24-4104-bbed-e47dc41be626 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:12.659047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-89d5f363-bc24-4104-bbed-e47dc41be626 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041543 May 12 07:07:12.659588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 461/1072] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:12 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:12.934020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d05e1b34-2ee0-4514-9084-0912f011777b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:12.934639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d05e1b34-2ee0-4514-9084-0912f011777b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:12.941045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d05e1b34-2ee0-4514-9084-0912f011777b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:12.941495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d05e1b34-2ee0-4514-9084-0912f011777b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:12.942264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d05e1b34-2ee0-4514-9084-0912f011777b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:12.942702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d05e1b34-2ee0-4514-9084-0912f011777b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:13.003049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d05e1b34-2ee0-4514-9084-0912f011777b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:13.010428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d05e1b34-2ee0-4514-9084-0912f011777b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080839 May 12 07:07:13.010991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 612/1073] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:12 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:13.493195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5dbca24f-60c8-464b-bb7b-c190dc2a5ab1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:13.494145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5dbca24f-60c8-464b-bb7b-c190dc2a5ab1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:13.500353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dbca24f-60c8-464b-bb7b-c190dc2a5ab1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:13.500796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dbca24f-60c8-464b-bb7b-c190dc2a5ab1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:13.501559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dbca24f-60c8-464b-bb7b-c190dc2a5ab1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:13.501989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dbca24f-60c8-464b-bb7b-c190dc2a5ab1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:13.529894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5dbca24f-60c8-464b-bb7b-c190dc2a5ab1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041138 May 12 07:07:13.530438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 462/1074] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:13 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:13.671108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-66654ad3-6007-4285-bb18-b504ac96ba74 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:13.672049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-66654ad3-6007-4285-bb18-b504ac96ba74 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:13.678217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66654ad3-6007-4285-bb18-b504ac96ba74 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:13.678671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66654ad3-6007-4285-bb18-b504ac96ba74 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:13.679441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66654ad3-6007-4285-bb18-b504ac96ba74 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:13.680537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66654ad3-6007-4285-bb18-b504ac96ba74 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:13.708039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-66654ad3-6007-4285-bb18-b504ac96ba74 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040836 May 12 07:07:13.708575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 613/1075] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:14.026877 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b338c378-927c-4e59-b11f-2b6743775f35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:14.027495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b338c378-927c-4e59-b11f-2b6743775f35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:14.033310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b338c378-927c-4e59-b11f-2b6743775f35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:14.033762 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b338c378-927c-4e59-b11f-2b6743775f35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:14.034533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b338c378-927c-4e59-b11f-2b6743775f35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:14.034980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b338c378-927c-4e59-b11f-2b6743775f35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:14.095208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b338c378-927c-4e59-b11f-2b6743775f35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:14.102514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b338c378-927c-4e59-b11f-2b6743775f35 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080020 May 12 07:07:14.103078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 463/1076] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:14 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:14.541528 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-09850f96-c191-4596-a408-c502967795bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:14.542459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-09850f96-c191-4596-a408-c502967795bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:14.548755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09850f96-c191-4596-a408-c502967795bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:14.549469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09850f96-c191-4596-a408-c502967795bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:14.557305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09850f96-c191-4596-a408-c502967795bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:14.557305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09850f96-c191-4596-a408-c502967795bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:14.579117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-09850f96-c191-4596-a408-c502967795bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042094 May 12 07:07:14.579692 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 614/1077] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:14 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:14.719731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5fba9614-2a17-4a57-b10c-05f3a1ae21bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:14.720658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5fba9614-2a17-4a57-b10c-05f3a1ae21bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:14.726952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fba9614-2a17-4a57-b10c-05f3a1ae21bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:14.727931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fba9614-2a17-4a57-b10c-05f3a1ae21bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:14.728709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fba9614-2a17-4a57-b10c-05f3a1ae21bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:14.729150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fba9614-2a17-4a57-b10c-05f3a1ae21bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:14.757797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5fba9614-2a17-4a57-b10c-05f3a1ae21bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042150 May 12 07:07:14.758353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 464/1078] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:15.118408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-895d84a8-d531-4983-949c-74dfb61f2fee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:15.119022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-895d84a8-d531-4983-949c-74dfb61f2fee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:15.125153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-895d84a8-d531-4983-949c-74dfb61f2fee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:15.125632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-895d84a8-d531-4983-949c-74dfb61f2fee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:15.126410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-895d84a8-d531-4983-949c-74dfb61f2fee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:15.126853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-895d84a8-d531-4983-949c-74dfb61f2fee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:15.186272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-895d84a8-d531-4983-949c-74dfb61f2fee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:15.193595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-895d84a8-d531-4983-949c-74dfb61f2fee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079082 May 12 07:07:15.194161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 615/1079] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:15 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:15.590535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a5343e03-62fe-4588-b3d0-45e00292d2e3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:15.591451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a5343e03-62fe-4588-b3d0-45e00292d2e3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:15.597473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5343e03-62fe-4588-b3d0-45e00292d2e3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:15.597930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5343e03-62fe-4588-b3d0-45e00292d2e3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:15.598703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5343e03-62fe-4588-b3d0-45e00292d2e3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:15.599141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5343e03-62fe-4588-b3d0-45e00292d2e3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:15.627209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a5343e03-62fe-4588-b3d0-45e00292d2e3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040707 May 12 07:07:15.627774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 465/1080] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:15 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:15.769354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7aba2b9c-33cc-47c7-a848-b41c0f4dd071 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:15.770273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7aba2b9c-33cc-47c7-a848-b41c0f4dd071 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:15.776587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aba2b9c-33cc-47c7-a848-b41c0f4dd071 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:15.777041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aba2b9c-33cc-47c7-a848-b41c0f4dd071 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:15.777814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aba2b9c-33cc-47c7-a848-b41c0f4dd071 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:15.778250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7aba2b9c-33cc-47c7-a848-b41c0f4dd071 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:15.806729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7aba2b9c-33cc-47c7-a848-b41c0f4dd071 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041422 May 12 07:07:15.807265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 616/1081] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:16.210479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-78e509c9-8999-4729-979f-9f79169dca52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:16.211096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-78e509c9-8999-4729-979f-9f79169dca52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:16.217436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78e509c9-8999-4729-979f-9f79169dca52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:16.217884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78e509c9-8999-4729-979f-9f79169dca52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:16.218653 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78e509c9-8999-4729-979f-9f79169dca52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:16.219090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78e509c9-8999-4729-979f-9f79169dca52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:16.281077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-78e509c9-8999-4729-979f-9f79169dca52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:16.288360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-78e509c9-8999-4729-979f-9f79169dca52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081829 May 12 07:07:16.288926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 466/1082] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:16 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:16.639405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6b8670de-5e20-4d97-856c-ff20cc6c0668 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:16.640283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6b8670de-5e20-4d97-856c-ff20cc6c0668 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:16.646196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b8670de-5e20-4d97-856c-ff20cc6c0668 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:16.646645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b8670de-5e20-4d97-856c-ff20cc6c0668 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:16.647414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b8670de-5e20-4d97-856c-ff20cc6c0668 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:16.647884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b8670de-5e20-4d97-856c-ff20cc6c0668 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:16.676950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6b8670de-5e20-4d97-856c-ff20cc6c0668 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041591 May 12 07:07:16.677498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 617/1083] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:16 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:16.818665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7969343e-6247-4618-b0e6-bd1f9329b2ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:16.819608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7969343e-6247-4618-b0e6-bd1f9329b2ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:16.826042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7969343e-6247-4618-b0e6-bd1f9329b2ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:16.826518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7969343e-6247-4618-b0e6-bd1f9329b2ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:16.827290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7969343e-6247-4618-b0e6-bd1f9329b2ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:16.827747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7969343e-6247-4618-b0e6-bd1f9329b2ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:16.855754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7969343e-6247-4618-b0e6-bd1f9329b2ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040983 May 12 07:07:16.856294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 467/1084] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:17.306197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-aa96b938-2740-4950-9bfd-cf81110dab3d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:17.306815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-aa96b938-2740-4950-9bfd-cf81110dab3d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:17.313187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa96b938-2740-4950-9bfd-cf81110dab3d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:17.313642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa96b938-2740-4950-9bfd-cf81110dab3d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:17.314416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa96b938-2740-4950-9bfd-cf81110dab3d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:17.314856 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa96b938-2740-4950-9bfd-cf81110dab3d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:17.375452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aa96b938-2740-4950-9bfd-cf81110dab3d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:17.384565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-aa96b938-2740-4950-9bfd-cf81110dab3d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081862 May 12 07:07:17.385488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 618/1085] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:17 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:17.692381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cf912390-ebb1-46b2-9188-ac03d8190178 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:17.692381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cf912390-ebb1-46b2-9188-ac03d8190178 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:17.696787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf912390-ebb1-46b2-9188-ac03d8190178 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:17.697240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf912390-ebb1-46b2-9188-ac03d8190178 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:17.698012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf912390-ebb1-46b2-9188-ac03d8190178 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:17.698449 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf912390-ebb1-46b2-9188-ac03d8190178 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:17.726917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cf912390-ebb1-46b2-9188-ac03d8190178 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041608 May 12 07:07:17.728082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 468/1086] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:17 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:17.867165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3f585680-496c-449c-a22a-78c7dc2b5c53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:17.868125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3f585680-496c-449c-a22a-78c7dc2b5c53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:17.873962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3f585680-496c-449c-a22a-78c7dc2b5c53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:17.874407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3f585680-496c-449c-a22a-78c7dc2b5c53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:17.875166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3f585680-496c-449c-a22a-78c7dc2b5c53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:17.875598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3f585680-496c-449c-a22a-78c7dc2b5c53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:17.903183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3f585680-496c-449c-a22a-78c7dc2b5c53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039958 May 12 07:07:17.903739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 619/1087] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:17 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:18.402149 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9702c7fe-888d-4b67-ae57-25daa975cf1f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:18.402741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9702c7fe-888d-4b67-ae57-25daa975cf1f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:18.408660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9702c7fe-888d-4b67-ae57-25daa975cf1f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:18.409103 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9702c7fe-888d-4b67-ae57-25daa975cf1f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:18.409868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9702c7fe-888d-4b67-ae57-25daa975cf1f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:18.410303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9702c7fe-888d-4b67-ae57-25daa975cf1f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:18.469976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9702c7fe-888d-4b67-ae57-25daa975cf1f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:18.477247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9702c7fe-888d-4b67-ae57-25daa975cf1f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079632 May 12 07:07:18.477819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 469/1088] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:18 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:18.738632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7d353fd6-30f0-48cf-8f14-e91104eca1f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:18.739478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7d353fd6-30f0-48cf-8f14-e91104eca1f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:18.746359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d353fd6-30f0-48cf-8f14-e91104eca1f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:18.746810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d353fd6-30f0-48cf-8f14-e91104eca1f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:18.747583 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d353fd6-30f0-48cf-8f14-e91104eca1f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:18.748047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d353fd6-30f0-48cf-8f14-e91104eca1f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:18.776803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7d353fd6-30f0-48cf-8f14-e91104eca1f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042275 May 12 07:07:18.777353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 620/1089] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:18 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:18.915230 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2cf866ce-5e98-4e44-9820-bc498151a60e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:18.916167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2cf866ce-5e98-4e44-9820-bc498151a60e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:18.922378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2cf866ce-5e98-4e44-9820-bc498151a60e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:18.922824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2cf866ce-5e98-4e44-9820-bc498151a60e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:18.923646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2cf866ce-5e98-4e44-9820-bc498151a60e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:18.924357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2cf866ce-5e98-4e44-9820-bc498151a60e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:18.953449 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2cf866ce-5e98-4e44-9820-bc498151a60e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042749 May 12 07:07:18.954003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 470/1090] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:19.494227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4bcfc305-f13a-4d61-b86b-4e1693437207 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:19.494840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4bcfc305-f13a-4d61-b86b-4e1693437207 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:19.500770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bcfc305-f13a-4d61-b86b-4e1693437207 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:19.501214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bcfc305-f13a-4d61-b86b-4e1693437207 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:19.501973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bcfc305-f13a-4d61-b86b-4e1693437207 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:19.502406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4bcfc305-f13a-4d61-b86b-4e1693437207 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:19.561422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4bcfc305-f13a-4d61-b86b-4e1693437207 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:19.568660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4bcfc305-f13a-4d61-b86b-4e1693437207 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078777 May 12 07:07:19.569216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 621/1091] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:19 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:19.788399 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-346e9bc9-a6d4-455d-bfef-19a4fb2ad791 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:19.789229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-346e9bc9-a6d4-455d-bfef-19a4fb2ad791 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:19.795600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-346e9bc9-a6d4-455d-bfef-19a4fb2ad791 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:19.796078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-346e9bc9-a6d4-455d-bfef-19a4fb2ad791 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:19.796838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-346e9bc9-a6d4-455d-bfef-19a4fb2ad791 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:19.797272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-346e9bc9-a6d4-455d-bfef-19a4fb2ad791 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:19.826720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-346e9bc9-a6d4-455d-bfef-19a4fb2ad791 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 May 12 07:07:19.827261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 471/1092] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:19 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:19.965002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4847a34f-9f42-4e9a-8f4c-4d8f621b224b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:19.965920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4847a34f-9f42-4e9a-8f4c-4d8f621b224b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:19.972298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4847a34f-9f42-4e9a-8f4c-4d8f621b224b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:19.972744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4847a34f-9f42-4e9a-8f4c-4d8f621b224b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:19.973507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4847a34f-9f42-4e9a-8f4c-4d8f621b224b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:19.973940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4847a34f-9f42-4e9a-8f4c-4d8f621b224b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:20.003450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4847a34f-9f42-4e9a-8f4c-4d8f621b224b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042396 May 12 07:07:20.004133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 622/1093] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:20.585844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2df33bd4-6213-46f7-a67a-7588a056a708 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:20.587116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2df33bd4-6213-46f7-a67a-7588a056a708 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:20.593462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2df33bd4-6213-46f7-a67a-7588a056a708 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:20.593908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2df33bd4-6213-46f7-a67a-7588a056a708 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:20.594870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2df33bd4-6213-46f7-a67a-7588a056a708 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:20.595309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2df33bd4-6213-46f7-a67a-7588a056a708 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:20.656920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2df33bd4-6213-46f7-a67a-7588a056a708 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:20.664656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2df33bd4-6213-46f7-a67a-7588a056a708 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082494 May 12 07:07:20.665225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 472/1094] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:20 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:20.838230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-64bf5af7-dfec-483b-b9f6-2b5b31c6b42a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:20.839075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-64bf5af7-dfec-483b-b9f6-2b5b31c6b42a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:20.844900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64bf5af7-dfec-483b-b9f6-2b5b31c6b42a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:20.845332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64bf5af7-dfec-483b-b9f6-2b5b31c6b42a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:20.846111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64bf5af7-dfec-483b-b9f6-2b5b31c6b42a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:20.846548 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64bf5af7-dfec-483b-b9f6-2b5b31c6b42a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:20.874559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-64bf5af7-dfec-483b-b9f6-2b5b31c6b42a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040329 May 12 07:07:20.875113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 623/1095] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:20 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:21.015201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d5104b95-dd81-4fc6-a886-eeddafaa3a29 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:21.016174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d5104b95-dd81-4fc6-a886-eeddafaa3a29 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:21.022066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5104b95-dd81-4fc6-a886-eeddafaa3a29 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:21.022512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5104b95-dd81-4fc6-a886-eeddafaa3a29 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:21.023275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5104b95-dd81-4fc6-a886-eeddafaa3a29 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:21.023730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5104b95-dd81-4fc6-a886-eeddafaa3a29 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:21.051788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d5104b95-dd81-4fc6-a886-eeddafaa3a29 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040544 May 12 07:07:21.052347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 473/1096] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:21 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:21.681160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4333cc03-d0f6-4a8e-b861-c273a78509d9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:21.681786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4333cc03-d0f6-4a8e-b861-c273a78509d9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:21.688154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4333cc03-d0f6-4a8e-b861-c273a78509d9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:21.688608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4333cc03-d0f6-4a8e-b861-c273a78509d9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:21.689385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4333cc03-d0f6-4a8e-b861-c273a78509d9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:21.689828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4333cc03-d0f6-4a8e-b861-c273a78509d9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:21.749749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4333cc03-d0f6-4a8e-b861-c273a78509d9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:21.757229 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4333cc03-d0f6-4a8e-b861-c273a78509d9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079955 May 12 07:07:21.757803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 624/1097] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:21 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:21.886348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1c0abe99-303c-4c32-9caf-9b7e3f30376b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:21.887261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1c0abe99-303c-4c32-9caf-9b7e3f30376b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:21.893252 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c0abe99-303c-4c32-9caf-9b7e3f30376b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:21.893694 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c0abe99-303c-4c32-9caf-9b7e3f30376b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:21.894454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c0abe99-303c-4c32-9caf-9b7e3f30376b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:21.894882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c0abe99-303c-4c32-9caf-9b7e3f30376b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:21.922775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1c0abe99-303c-4c32-9caf-9b7e3f30376b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040826 May 12 07:07:21.923309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 474/1098] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:21 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:22.063643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-436ec660-db55-4909-9887-2d4895464cb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:22.064614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-436ec660-db55-4909-9887-2d4895464cb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:22.070557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-436ec660-db55-4909-9887-2d4895464cb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:22.071536 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-436ec660-db55-4909-9887-2d4895464cb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:22.072329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-436ec660-db55-4909-9887-2d4895464cb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:22.072773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-436ec660-db55-4909-9887-2d4895464cb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:22.100819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-436ec660-db55-4909-9887-2d4895464cb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041097 May 12 07:07:22.101359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 625/1099] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:22.774868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b37e57ff-f441-4540-926b-bdabcc019fff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:22.775473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b37e57ff-f441-4540-926b-bdabcc019fff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:22.781388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b37e57ff-f441-4540-926b-bdabcc019fff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:22.781839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b37e57ff-f441-4540-926b-bdabcc019fff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:22.782622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b37e57ff-f441-4540-926b-bdabcc019fff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:22.783050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b37e57ff-f441-4540-926b-bdabcc019fff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:22.981702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b37e57ff-f441-4540-926b-bdabcc019fff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:22.989130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b37e57ff-f441-4540-926b-bdabcc019fff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.218771 May 12 07:07:22.990334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 475/1100] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:22 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:23.046082 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7b902f80-d887-428a-babf-e86946439eb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:23.047009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7b902f80-d887-428a-babf-e86946439eb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:23.053167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b902f80-d887-428a-babf-e86946439eb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:23.053625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b902f80-d887-428a-babf-e86946439eb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:23.054438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b902f80-d887-428a-babf-e86946439eb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:23.054883 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b902f80-d887-428a-babf-e86946439eb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:23.084374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7b902f80-d887-428a-babf-e86946439eb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154346 May 12 07:07:23.084957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 626/1101] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:22 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:07:23.112135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2f4e3d9c-db0e-4a6c-a483-7233961bfca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:23.113065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2f4e3d9c-db0e-4a6c-a483-7233961bfca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:23.119324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f4e3d9c-db0e-4a6c-a483-7233961bfca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:23.119811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f4e3d9c-db0e-4a6c-a483-7233961bfca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:23.120590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f4e3d9c-db0e-4a6c-a483-7233961bfca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:23.121032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f4e3d9c-db0e-4a6c-a483-7233961bfca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:23.149556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2f4e3d9c-db0e-4a6c-a483-7233961bfca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 May 12 07:07:23.150097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 476/1102] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:24.006318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e837882b-20ac-4931-b887-365286ab1c69 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:24.006939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e837882b-20ac-4931-b887-365286ab1c69 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:24.013949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e837882b-20ac-4931-b887-365286ab1c69 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:24.014400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e837882b-20ac-4931-b887-365286ab1c69 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:24.015172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e837882b-20ac-4931-b887-365286ab1c69 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:24.015611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e837882b-20ac-4931-b887-365286ab1c69 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:24.095077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-11d20256-848e-4a3d-835c-91b0fea5b79d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:24.096023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-11d20256-848e-4a3d-835c-91b0fea5b79d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:24.102336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11d20256-848e-4a3d-835c-91b0fea5b79d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:24.102785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11d20256-848e-4a3d-835c-91b0fea5b79d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:24.103558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11d20256-848e-4a3d-835c-91b0fea5b79d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:24.104027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11d20256-848e-4a3d-835c-91b0fea5b79d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:24.124171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e837882b-20ac-4931-b887-365286ab1c69 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:24.131662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e837882b-20ac-4931-b887-365286ab1c69 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.129227 May 12 07:07:24.132326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 627/1103] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:24 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:24.132706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-11d20256-848e-4a3d-835c-91b0fea5b79d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041326 May 12 07:07:24.133837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 477/1104] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:24 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:07:24.160617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a3a5a3a2-478f-44e3-86d9-fb2fba190916 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:24.161531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a3a5a3a2-478f-44e3-86d9-fb2fba190916 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:24.167848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a3a5a3a2-478f-44e3-86d9-fb2fba190916 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:24.168322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a3a5a3a2-478f-44e3-86d9-fb2fba190916 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:24.169090 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a3a5a3a2-478f-44e3-86d9-fb2fba190916 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:24.169527 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a3a5a3a2-478f-44e3-86d9-fb2fba190916 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:24.198051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a3a5a3a2-478f-44e3-86d9-fb2fba190916 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041191 May 12 07:07:24.198793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 628/1105] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:07:25.144925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e6cd434d-7ce9-43d0-a690-6fde9045036c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:25.145844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e6cd434d-7ce9-43d0-a690-6fde9045036c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:25.147955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d4637218-cd11-4592-accb-1cf8dd5835e5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:25.148576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d4637218-cd11-4592-accb-1cf8dd5835e5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:25.152148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6cd434d-7ce9-43d0-a690-6fde9045036c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:25.152594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6cd434d-7ce9-43d0-a690-6fde9045036c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:25.153364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6cd434d-7ce9-43d0-a690-6fde9045036c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:25.153799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6cd434d-7ce9-43d0-a690-6fde9045036c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:25.154784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4637218-cd11-4592-accb-1cf8dd5835e5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:25.155238 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4637218-cd11-4592-accb-1cf8dd5835e5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:25.156113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4637218-cd11-4592-accb-1cf8dd5835e5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:25.156553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d4637218-cd11-4592-accb-1cf8dd5835e5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:25.183036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e6cd434d-7ce9-43d0-a690-6fde9045036c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042182 May 12 07:07:25.183522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 478/1106] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:25 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:25.209458 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bafe9e42-1aac-42eb-ac98-767bc4102683 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:25.210373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bafe9e42-1aac-42eb-ac98-767bc4102683 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:25.216356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bafe9e42-1aac-42eb-ac98-767bc4102683 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:25.216808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bafe9e42-1aac-42eb-ac98-767bc4102683 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:25.217683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bafe9e42-1aac-42eb-ac98-767bc4102683 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:25.218003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bafe9e42-1aac-42eb-ac98-767bc4102683 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:25.219671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d4637218-cd11-4592-accb-1cf8dd5835e5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:25.227521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d4637218-cd11-4592-accb-1cf8dd5835e5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082799 May 12 07:07:25.228121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 629/1107] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:25 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:07:25.247012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bafe9e42-1aac-42eb-ac98-767bc4102683 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041475 May 12 07:07:25.247561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 479/1108] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:07:26.194609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e800d498-43c8-4d60-aec9-b5fcc923bd14 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:26.195540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e800d498-43c8-4d60-aec9-b5fcc923bd14 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:26.202022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e800d498-43c8-4d60-aec9-b5fcc923bd14 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:26.202475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e800d498-43c8-4d60-aec9-b5fcc923bd14 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:26.203247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e800d498-43c8-4d60-aec9-b5fcc923bd14 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:26.203705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e800d498-43c8-4d60-aec9-b5fcc923bd14 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:26.232739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e800d498-43c8-4d60-aec9-b5fcc923bd14 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042267 May 12 07:07:26.233283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 630/1109] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:26 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:26.244587 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-13f92662-ea98-4080-bae7-1c1abc18ce23 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:26.245143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-13f92662-ea98-4080-bae7-1c1abc18ce23 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:26.251387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13f92662-ea98-4080-bae7-1c1abc18ce23 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:26.251887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13f92662-ea98-4080-bae7-1c1abc18ce23 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:26.252670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13f92662-ea98-4080-bae7-1c1abc18ce23 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:26.253109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13f92662-ea98-4080-bae7-1c1abc18ce23 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:26.258856 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-15c5044f-8394-487a-a66e-9b4304405805 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:26.259979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-15c5044f-8394-487a-a66e-9b4304405805 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:26.265965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15c5044f-8394-487a-a66e-9b4304405805 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:26.266425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15c5044f-8394-487a-a66e-9b4304405805 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:26.267210 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15c5044f-8394-487a-a66e-9b4304405805 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:26.267656 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15c5044f-8394-487a-a66e-9b4304405805 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:26.296326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-15c5044f-8394-487a-a66e-9b4304405805 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041849 May 12 07:07:26.296911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 631/1110] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:07:26.313748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-13f92662-ea98-4080-bae7-1c1abc18ce23 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:26.321694 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-13f92662-ea98-4080-bae7-1c1abc18ce23 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081493 May 12 07:07:26.322251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 480/1111] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:26 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:27.245382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9830f5a9-1103-44b8-813d-eeb3f3839ea9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:27.246312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9830f5a9-1103-44b8-813d-eeb3f3839ea9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:27.252612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9830f5a9-1103-44b8-813d-eeb3f3839ea9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:27.253071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9830f5a9-1103-44b8-813d-eeb3f3839ea9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:27.253839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9830f5a9-1103-44b8-813d-eeb3f3839ea9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:27.254281 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9830f5a9-1103-44b8-813d-eeb3f3839ea9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:27.281954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9830f5a9-1103-44b8-813d-eeb3f3839ea9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041243 May 12 07:07:27.282498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 632/1112] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:27 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:27.308652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-855384bf-15ad-4877-b0f5-e786c30a5977 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:27.309589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-855384bf-15ad-4877-b0f5-e786c30a5977 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:27.316136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-855384bf-15ad-4877-b0f5-e786c30a5977 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:27.316586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-855384bf-15ad-4877-b0f5-e786c30a5977 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:27.317358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-855384bf-15ad-4877-b0f5-e786c30a5977 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:27.317800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-855384bf-15ad-4877-b0f5-e786c30a5977 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:27.337231 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2bac09ee-bc58-4302-a24a-f35627969724 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:27.337849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2bac09ee-bc58-4302-a24a-f35627969724 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:27.343619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2bac09ee-bc58-4302-a24a-f35627969724 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:27.344102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2bac09ee-bc58-4302-a24a-f35627969724 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:27.344875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2bac09ee-bc58-4302-a24a-f35627969724 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:27.345312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2bac09ee-bc58-4302-a24a-f35627969724 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:27.347059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-855384bf-15ad-4877-b0f5-e786c30a5977 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042967 May 12 07:07:27.347636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 481/1113] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:27.404185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2bac09ee-bc58-4302-a24a-f35627969724 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:27.411436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2bac09ee-bc58-4302-a24a-f35627969724 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078002 May 12 07:07:27.412033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 633/1114] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:27 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:07:28.293533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c5387c7c-ac62-4d2e-a8b7-128d5e7a490d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:28.294437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c5387c7c-ac62-4d2e-a8b7-128d5e7a490d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:28.300684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5387c7c-ac62-4d2e-a8b7-128d5e7a490d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:28.301142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5387c7c-ac62-4d2e-a8b7-128d5e7a490d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:28.301953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5387c7c-ac62-4d2e-a8b7-128d5e7a490d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:28.302398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5387c7c-ac62-4d2e-a8b7-128d5e7a490d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:28.331376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c5387c7c-ac62-4d2e-a8b7-128d5e7a490d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041953 May 12 07:07:28.332007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 482/1115] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:28 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:28.358373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-01139eb9-f179-4c3a-bb44-71c4cb7fb68e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:28.359322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-01139eb9-f179-4c3a-bb44-71c4cb7fb68e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:28.365532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-01139eb9-f179-4c3a-bb44-71c4cb7fb68e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:28.365981 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-01139eb9-f179-4c3a-bb44-71c4cb7fb68e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:28.366738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-01139eb9-f179-4c3a-bb44-71c4cb7fb68e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:28.367169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-01139eb9-f179-4c3a-bb44-71c4cb7fb68e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:28.396485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-01139eb9-f179-4c3a-bb44-71c4cb7fb68e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042001 May 12 07:07:28.397042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 634/1116] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:28.428589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-318967a9-90a6-4ef0-8ff1-f7bd160c53bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:28.429212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-318967a9-90a6-4ef0-8ff1-f7bd160c53bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:28.435704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-318967a9-90a6-4ef0-8ff1-f7bd160c53bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:28.436208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-318967a9-90a6-4ef0-8ff1-f7bd160c53bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:28.437009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-318967a9-90a6-4ef0-8ff1-f7bd160c53bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:28.437880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-318967a9-90a6-4ef0-8ff1-f7bd160c53bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:28.497034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-318967a9-90a6-4ef0-8ff1-f7bd160c53bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:28.504288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-318967a9-90a6-4ef0-8ff1-f7bd160c53bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079564 May 12 07:07:28.504856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 483/1117] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:28 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:29.342003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d35bd58a-034d-47db-8176-eb18b8f910a4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:29.342930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d35bd58a-034d-47db-8176-eb18b8f910a4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:29.349015 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d35bd58a-034d-47db-8176-eb18b8f910a4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:29.349464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d35bd58a-034d-47db-8176-eb18b8f910a4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:29.350232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d35bd58a-034d-47db-8176-eb18b8f910a4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:29.350669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d35bd58a-034d-47db-8176-eb18b8f910a4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:29.379578 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d35bd58a-034d-47db-8176-eb18b8f910a4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041563 May 12 07:07:29.380292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 635/1118] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:29 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:29.407876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c548ee42-2208-41ed-a34f-ab8e04b9d1e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:29.408795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c548ee42-2208-41ed-a34f-ab8e04b9d1e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:29.415450 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c548ee42-2208-41ed-a34f-ab8e04b9d1e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:29.415918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c548ee42-2208-41ed-a34f-ab8e04b9d1e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:29.416676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c548ee42-2208-41ed-a34f-ab8e04b9d1e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:29.417110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c548ee42-2208-41ed-a34f-ab8e04b9d1e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:29.445554 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c548ee42-2208-41ed-a34f-ab8e04b9d1e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041568 May 12 07:07:29.446142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 484/1119] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:29.521416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-70f7b495-2cec-45e9-a65c-9d55dfd578f9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:29.522038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-70f7b495-2cec-45e9-a65c-9d55dfd578f9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:29.527903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70f7b495-2cec-45e9-a65c-9d55dfd578f9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:29.528352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70f7b495-2cec-45e9-a65c-9d55dfd578f9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:29.529117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70f7b495-2cec-45e9-a65c-9d55dfd578f9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:29.529551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70f7b495-2cec-45e9-a65c-9d55dfd578f9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:29.591505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-70f7b495-2cec-45e9-a65c-9d55dfd578f9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:29.598876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-70f7b495-2cec-45e9-a65c-9d55dfd578f9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081206 May 12 07:07:29.599379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 636/1120] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:29 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:30.391248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b2e42933-888c-4262-a23b-52c20216e016 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:30.392124 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b2e42933-888c-4262-a23b-52c20216e016 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:30.397967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b2e42933-888c-4262-a23b-52c20216e016 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:30.398416 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b2e42933-888c-4262-a23b-52c20216e016 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:30.399828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b2e42933-888c-4262-a23b-52c20216e016 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:30.400265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b2e42933-888c-4262-a23b-52c20216e016 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:30.428149 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b2e42933-888c-4262-a23b-52c20216e016 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040896 May 12 07:07:30.428804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 485/1121] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:30 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:30.457200 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-15eee371-d3b3-4f5a-ac54-42b636a28ea5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:30.458186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-15eee371-d3b3-4f5a-ac54-42b636a28ea5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:30.465324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15eee371-d3b3-4f5a-ac54-42b636a28ea5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:30.465771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15eee371-d3b3-4f5a-ac54-42b636a28ea5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:30.466529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15eee371-d3b3-4f5a-ac54-42b636a28ea5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:30.467081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15eee371-d3b3-4f5a-ac54-42b636a28ea5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:30.496824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-15eee371-d3b3-4f5a-ac54-42b636a28ea5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043629 May 12 07:07:30.497611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 637/1122] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:30.615943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1db50576-dc42-4678-852e-ab10f7a96572 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:30.616659 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1db50576-dc42-4678-852e-ab10f7a96572 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:30.623320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1db50576-dc42-4678-852e-ab10f7a96572 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:30.623886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1db50576-dc42-4678-852e-ab10f7a96572 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:30.624741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1db50576-dc42-4678-852e-ab10f7a96572 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:30.625244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1db50576-dc42-4678-852e-ab10f7a96572 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:30.686371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1db50576-dc42-4678-852e-ab10f7a96572 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:30.694248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1db50576-dc42-4678-852e-ab10f7a96572 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081691 May 12 07:07:30.694248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 486/1123] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:30 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:31.440011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bf1e1d10-69cf-4944-801e-d5405da90564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:31.440860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bf1e1d10-69cf-4944-801e-d5405da90564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:31.446761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1e1d10-69cf-4944-801e-d5405da90564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:31.447216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1e1d10-69cf-4944-801e-d5405da90564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:31.448021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1e1d10-69cf-4944-801e-d5405da90564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:31.448465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1e1d10-69cf-4944-801e-d5405da90564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:31.478490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bf1e1d10-69cf-4944-801e-d5405da90564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042794 May 12 07:07:31.479215 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 638/1124] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:31 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:31.508397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-99839a04-c787-41d2-88af-27dc47e0ff88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:31.509337 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-99839a04-c787-41d2-88af-27dc47e0ff88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:31.515579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99839a04-c787-41d2-88af-27dc47e0ff88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:31.516067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99839a04-c787-41d2-88af-27dc47e0ff88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:31.516842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99839a04-c787-41d2-88af-27dc47e0ff88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:31.517285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99839a04-c787-41d2-88af-27dc47e0ff88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:31.546147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-99839a04-c787-41d2-88af-27dc47e0ff88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041653 May 12 07:07:31.546690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 487/1125] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:31.710264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9c3b5096-f649-40b2-b0f3-e0d47cb9bf47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:31.710801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9c3b5096-f649-40b2-b0f3-e0d47cb9bf47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:31.717316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c3b5096-f649-40b2-b0f3-e0d47cb9bf47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:31.717774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c3b5096-f649-40b2-b0f3-e0d47cb9bf47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:31.718551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c3b5096-f649-40b2-b0f3-e0d47cb9bf47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:31.718995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c3b5096-f649-40b2-b0f3-e0d47cb9bf47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:31.779202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c3b5096-f649-40b2-b0f3-e0d47cb9bf47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:31.786599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9c3b5096-f649-40b2-b0f3-e0d47cb9bf47 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080232 May 12 07:07:31.787165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 639/1126] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:31 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:07:32.490082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c19caec8-b62e-4967-82c2-2d08fce4eb2e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:32.490922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c19caec8-b62e-4967-82c2-2d08fce4eb2e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:32.497438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c19caec8-b62e-4967-82c2-2d08fce4eb2e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:32.497922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c19caec8-b62e-4967-82c2-2d08fce4eb2e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:32.498695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c19caec8-b62e-4967-82c2-2d08fce4eb2e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:32.499130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c19caec8-b62e-4967-82c2-2d08fce4eb2e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:32.526772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c19caec8-b62e-4967-82c2-2d08fce4eb2e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040802 May 12 07:07:32.527359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 488/1127] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:32 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:32.558395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-45e44d37-61d1-4b2f-ad89-777bf22a920a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:32.559345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-45e44d37-61d1-4b2f-ad89-777bf22a920a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:32.565607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45e44d37-61d1-4b2f-ad89-777bf22a920a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:32.566055 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45e44d37-61d1-4b2f-ad89-777bf22a920a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:32.566815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45e44d37-61d1-4b2f-ad89-777bf22a920a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:32.567249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45e44d37-61d1-4b2f-ad89-777bf22a920a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:32.595014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-45e44d37-61d1-4b2f-ad89-777bf22a920a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041229 May 12 07:07:32.595545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 640/1128] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:32.803321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-529fd1d3-d089-49d1-bb03-0cca1d305df0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:32.804026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-529fd1d3-d089-49d1-bb03-0cca1d305df0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:32.809876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529fd1d3-d089-49d1-bb03-0cca1d305df0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:32.810333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529fd1d3-d089-49d1-bb03-0cca1d305df0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:32.811105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529fd1d3-d089-49d1-bb03-0cca1d305df0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:32.811550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529fd1d3-d089-49d1-bb03-0cca1d305df0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:32.869988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-529fd1d3-d089-49d1-bb03-0cca1d305df0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:32.877151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-529fd1d3-d089-49d1-bb03-0cca1d305df0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.077984 May 12 07:07:32.877717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 489/1129] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:32 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:33.537657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1e94b7d8-28f6-4099-8077-a21c784e08ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:33.538598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1e94b7d8-28f6-4099-8077-a21c784e08ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:33.544856 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e94b7d8-28f6-4099-8077-a21c784e08ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:33.545305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e94b7d8-28f6-4099-8077-a21c784e08ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:33.546081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e94b7d8-28f6-4099-8077-a21c784e08ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:33.546517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e94b7d8-28f6-4099-8077-a21c784e08ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:33.576146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1e94b7d8-28f6-4099-8077-a21c784e08ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042464 May 12 07:07:33.576752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 641/1130] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:33 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:33.606519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d92b8cd5-ce9b-41eb-b347-dc30721a0a5a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:33.615580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d92b8cd5-ce9b-41eb-b347-dc30721a0a5a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:33.615580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d92b8cd5-ce9b-41eb-b347-dc30721a0a5a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:33.615580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d92b8cd5-ce9b-41eb-b347-dc30721a0a5a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:33.615580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d92b8cd5-ce9b-41eb-b347-dc30721a0a5a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:33.616030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d92b8cd5-ce9b-41eb-b347-dc30721a0a5a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:33.644764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d92b8cd5-ce9b-41eb-b347-dc30721a0a5a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042170 May 12 07:07:33.645319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 490/1131] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:33 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:33.892869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-99c9882e-0b45-4c46-9398-c96b2def12b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:33.893403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-99c9882e-0b45-4c46-9398-c96b2def12b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:33.899355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99c9882e-0b45-4c46-9398-c96b2def12b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:33.899840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99c9882e-0b45-4c46-9398-c96b2def12b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:33.900618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99c9882e-0b45-4c46-9398-c96b2def12b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:33.901059 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99c9882e-0b45-4c46-9398-c96b2def12b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:33.963556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-99c9882e-0b45-4c46-9398-c96b2def12b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:33.971008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-99c9882e-0b45-4c46-9398-c96b2def12b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082104 May 12 07:07:33.971600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 642/1132] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:33 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:34.587422 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b876a113-fe7c-46ae-89fe-696a24b11f0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:34.588399 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b876a113-fe7c-46ae-89fe-696a24b11f0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:34.594212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b876a113-fe7c-46ae-89fe-696a24b11f0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:34.594665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b876a113-fe7c-46ae-89fe-696a24b11f0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:34.595428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b876a113-fe7c-46ae-89fe-696a24b11f0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:34.595901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b876a113-fe7c-46ae-89fe-696a24b11f0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:34.625628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b876a113-fe7c-46ae-89fe-696a24b11f0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042072 May 12 07:07:34.626314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 491/1133] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:34 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:34.655886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cb50a9fc-b274-471b-997f-874b3126ad7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:34.656818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cb50a9fc-b274-471b-997f-874b3126ad7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:34.663149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cb50a9fc-b274-471b-997f-874b3126ad7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:34.663606 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cb50a9fc-b274-471b-997f-874b3126ad7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:34.664410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cb50a9fc-b274-471b-997f-874b3126ad7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:34.665343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cb50a9fc-b274-471b-997f-874b3126ad7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:34.694698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cb50a9fc-b274-471b-997f-874b3126ad7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042849 May 12 07:07:34.697626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 643/1134] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:34.987932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9e7d9e4b-6c24-4a67-b62e-5498a1da2f28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:34.988548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9e7d9e4b-6c24-4a67-b62e-5498a1da2f28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:34.994997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e7d9e4b-6c24-4a67-b62e-5498a1da2f28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:34.995444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e7d9e4b-6c24-4a67-b62e-5498a1da2f28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:34.996242 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e7d9e4b-6c24-4a67-b62e-5498a1da2f28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:34.996671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e7d9e4b-6c24-4a67-b62e-5498a1da2f28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:35.056103 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9e7d9e4b-6c24-4a67-b62e-5498a1da2f28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:35.063323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9e7d9e4b-6c24-4a67-b62e-5498a1da2f28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079515 May 12 07:07:35.064069 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 492/1135] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:34 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:35.637868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dcf1c8ef-b18a-4546-a106-e5e3eb4bccfa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:35.638793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dcf1c8ef-b18a-4546-a106-e5e3eb4bccfa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:35.644929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dcf1c8ef-b18a-4546-a106-e5e3eb4bccfa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:35.645377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dcf1c8ef-b18a-4546-a106-e5e3eb4bccfa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:35.646139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dcf1c8ef-b18a-4546-a106-e5e3eb4bccfa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:35.646571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dcf1c8ef-b18a-4546-a106-e5e3eb4bccfa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:35.675352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dcf1c8ef-b18a-4546-a106-e5e3eb4bccfa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042061 May 12 07:07:35.676000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 644/1136] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:35 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:35.705963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2516b9a5-0c5b-422e-9f65-7ab35af65347 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:35.706878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2516b9a5-0c5b-422e-9f65-7ab35af65347 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:35.713852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2516b9a5-0c5b-422e-9f65-7ab35af65347 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:35.714300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2516b9a5-0c5b-422e-9f65-7ab35af65347 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:35.715069 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2516b9a5-0c5b-422e-9f65-7ab35af65347 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:35.715499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2516b9a5-0c5b-422e-9f65-7ab35af65347 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:35.743904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2516b9a5-0c5b-422e-9f65-7ab35af65347 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041760 May 12 07:07:35.744448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 493/1137] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:35 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:36.080164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0ea62f35-c131-4f8c-a801-f6296a00a1dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:36.080781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0ea62f35-c131-4f8c-a801-f6296a00a1dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:36.086668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ea62f35-c131-4f8c-a801-f6296a00a1dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:36.087115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ea62f35-c131-4f8c-a801-f6296a00a1dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:36.087916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ea62f35-c131-4f8c-a801-f6296a00a1dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:36.088353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ea62f35-c131-4f8c-a801-f6296a00a1dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:36.147965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0ea62f35-c131-4f8c-a801-f6296a00a1dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:36.155385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0ea62f35-c131-4f8c-a801-f6296a00a1dc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079050 May 12 07:07:36.155977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 645/1138] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:36 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:36.687140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-43b4be19-e145-4c0b-93ea-faf76d36f024 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:36.688080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-43b4be19-e145-4c0b-93ea-faf76d36f024 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:36.693941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43b4be19-e145-4c0b-93ea-faf76d36f024 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:36.694388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43b4be19-e145-4c0b-93ea-faf76d36f024 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:36.695146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43b4be19-e145-4c0b-93ea-faf76d36f024 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:36.695577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43b4be19-e145-4c0b-93ea-faf76d36f024 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:36.723870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-43b4be19-e145-4c0b-93ea-faf76d36f024 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040634 May 12 07:07:36.724475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 494/1139] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:36 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:36.754951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a22c7dca-58d9-44d9-aac4-0768529f5b6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:36.755974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a22c7dca-58d9-44d9-aac4-0768529f5b6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:36.762867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a22c7dca-58d9-44d9-aac4-0768529f5b6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:36.763314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a22c7dca-58d9-44d9-aac4-0768529f5b6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:36.764122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a22c7dca-58d9-44d9-aac4-0768529f5b6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:36.764556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a22c7dca-58d9-44d9-aac4-0768529f5b6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:36.792063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a22c7dca-58d9-44d9-aac4-0768529f5b6e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041013 May 12 07:07:36.792600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 646/1140] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:37.172526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ee34cb29-9a94-4964-b64c-5785f24a3662 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:37.173140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ee34cb29-9a94-4964-b64c-5785f24a3662 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:37.179514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee34cb29-9a94-4964-b64c-5785f24a3662 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:37.180584 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee34cb29-9a94-4964-b64c-5785f24a3662 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:37.181393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee34cb29-9a94-4964-b64c-5785f24a3662 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:37.181836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee34cb29-9a94-4964-b64c-5785f24a3662 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:37.244371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ee34cb29-9a94-4964-b64c-5785f24a3662 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:37.251604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ee34cb29-9a94-4964-b64c-5785f24a3662 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082965 May 12 07:07:37.252201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 495/1141] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:37 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:37.735119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c7a3419a-6e33-4ad0-badc-a44fe76580c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:37.736001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c7a3419a-6e33-4ad0-badc-a44fe76580c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:37.741858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7a3419a-6e33-4ad0-badc-a44fe76580c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:37.742313 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7a3419a-6e33-4ad0-badc-a44fe76580c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:37.743084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7a3419a-6e33-4ad0-badc-a44fe76580c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:37.743526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7a3419a-6e33-4ad0-badc-a44fe76580c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:37.772078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c7a3419a-6e33-4ad0-badc-a44fe76580c1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041108 May 12 07:07:37.772690 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 647/1142] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:37 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:37.803277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7f7b6973-7f53-4d27-91f0-d54c63b92bde tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:37.804235 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7f7b6973-7f53-4d27-91f0-d54c63b92bde tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:37.810552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f7b6973-7f53-4d27-91f0-d54c63b92bde tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:37.811116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f7b6973-7f53-4d27-91f0-d54c63b92bde tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:37.811923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f7b6973-7f53-4d27-91f0-d54c63b92bde tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:37.812360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f7b6973-7f53-4d27-91f0-d54c63b92bde tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:37.841699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7f7b6973-7f53-4d27-91f0-d54c63b92bde tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042567 May 12 07:07:37.845531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 496/1143] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:38.268489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a312694e-f43a-43df-a0da-94ed0cab2895 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:38.268489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a312694e-f43a-43df-a0da-94ed0cab2895 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:38.274285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a312694e-f43a-43df-a0da-94ed0cab2895 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:38.274736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a312694e-f43a-43df-a0da-94ed0cab2895 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:38.275514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a312694e-f43a-43df-a0da-94ed0cab2895 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:38.275986 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a312694e-f43a-43df-a0da-94ed0cab2895 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:38.338661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a312694e-f43a-43df-a0da-94ed0cab2895 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:38.346446 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a312694e-f43a-43df-a0da-94ed0cab2895 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082521 May 12 07:07:38.347111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 648/1144] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:38 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:38.784447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b8c2fcf6-972d-4254-8ef9-a54c484475de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:38.785367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b8c2fcf6-972d-4254-8ef9-a54c484475de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:38.792057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8c2fcf6-972d-4254-8ef9-a54c484475de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:38.792580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8c2fcf6-972d-4254-8ef9-a54c484475de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:38.793344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8c2fcf6-972d-4254-8ef9-a54c484475de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:38.793777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8c2fcf6-972d-4254-8ef9-a54c484475de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:38.822094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b8c2fcf6-972d-4254-8ef9-a54c484475de tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041787 May 12 07:07:38.822732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 497/1145] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:38 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:38.854120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1b96e5ed-4821-4198-8c38-c0896f5f9203 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:38.855034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1b96e5ed-4821-4198-8c38-c0896f5f9203 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:38.861325 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b96e5ed-4821-4198-8c38-c0896f5f9203 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:38.861787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b96e5ed-4821-4198-8c38-c0896f5f9203 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:38.862562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b96e5ed-4821-4198-8c38-c0896f5f9203 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:38.863002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b96e5ed-4821-4198-8c38-c0896f5f9203 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:38.890779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1b96e5ed-4821-4198-8c38-c0896f5f9203 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041269 May 12 07:07:38.891320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 649/1146] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:38 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:39.363622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bdb191ec-1ff9-428c-abd0-f639c498cebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:39.364275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bdb191ec-1ff9-428c-abd0-f639c498cebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:39.370372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bdb191ec-1ff9-428c-abd0-f639c498cebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:39.370822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bdb191ec-1ff9-428c-abd0-f639c498cebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:39.371591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bdb191ec-1ff9-428c-abd0-f639c498cebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:39.372051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bdb191ec-1ff9-428c-abd0-f639c498cebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:39.431232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bdb191ec-1ff9-428c-abd0-f639c498cebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:39.438472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bdb191ec-1ff9-428c-abd0-f639c498cebf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078688 May 12 07:07:39.439029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 498/1147] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:39 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:39.834611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-86631e5b-eb0a-4f55-9eb2-b7d137688ca8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:39.835540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-86631e5b-eb0a-4f55-9eb2-b7d137688ca8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:39.841523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86631e5b-eb0a-4f55-9eb2-b7d137688ca8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:39.841967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86631e5b-eb0a-4f55-9eb2-b7d137688ca8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:39.842774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86631e5b-eb0a-4f55-9eb2-b7d137688ca8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:39.843211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86631e5b-eb0a-4f55-9eb2-b7d137688ca8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:39.874034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-86631e5b-eb0a-4f55-9eb2-b7d137688ca8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 May 12 07:07:39.874690 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 650/1148] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:39 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:39.902176 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3ba2fc72-6265-4afd-8d9b-bbfd8204d8ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:39.903138 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3ba2fc72-6265-4afd-8d9b-bbfd8204d8ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:39.909467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ba2fc72-6265-4afd-8d9b-bbfd8204d8ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:39.909926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ba2fc72-6265-4afd-8d9b-bbfd8204d8ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:39.910708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ba2fc72-6265-4afd-8d9b-bbfd8204d8ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:39.911152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ba2fc72-6265-4afd-8d9b-bbfd8204d8ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:39.940883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3ba2fc72-6265-4afd-8d9b-bbfd8204d8ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042691 May 12 07:07:39.941467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 499/1149] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:40.454729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0cd30afc-7664-40fd-9dc7-7e203134d7d1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:40.455376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0cd30afc-7664-40fd-9dc7-7e203134d7d1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:40.461685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cd30afc-7664-40fd-9dc7-7e203134d7d1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:40.462149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cd30afc-7664-40fd-9dc7-7e203134d7d1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:40.462911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cd30afc-7664-40fd-9dc7-7e203134d7d1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:40.463343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cd30afc-7664-40fd-9dc7-7e203134d7d1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:40.521922 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0cd30afc-7664-40fd-9dc7-7e203134d7d1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:40.529620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0cd30afc-7664-40fd-9dc7-7e203134d7d1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078821 May 12 07:07:40.530174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 651/1150] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:40 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:40.885624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-56ac5860-b21b-4249-98a8-01e3bcf3c7ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:40.886544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-56ac5860-b21b-4249-98a8-01e3bcf3c7ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:40.892408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56ac5860-b21b-4249-98a8-01e3bcf3c7ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:40.892859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56ac5860-b21b-4249-98a8-01e3bcf3c7ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:40.893628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56ac5860-b21b-4249-98a8-01e3bcf3c7ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:40.894066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56ac5860-b21b-4249-98a8-01e3bcf3c7ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:40.922480 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-56ac5860-b21b-4249-98a8-01e3bcf3c7ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040791 May 12 07:07:40.923041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 500/1151] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:40 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:40.952372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-69d97c1b-f583-43a5-b9ca-10713d834564 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:40.953307 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-69d97c1b-f583-43a5-b9ca-10713d834564 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:40.959611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69d97c1b-f583-43a5-b9ca-10713d834564 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:40.960101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69d97c1b-f583-43a5-b9ca-10713d834564 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:40.960887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69d97c1b-f583-43a5-b9ca-10713d834564 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:40.961361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69d97c1b-f583-43a5-b9ca-10713d834564 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:40.990801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-69d97c1b-f583-43a5-b9ca-10713d834564 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042420 May 12 07:07:40.991403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 652/1152] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:40 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:41.547978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-37e1791b-1412-411c-b6b0-05297bd3bfca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:41.548595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-37e1791b-1412-411c-b6b0-05297bd3bfca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:41.554705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37e1791b-1412-411c-b6b0-05297bd3bfca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:41.555153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37e1791b-1412-411c-b6b0-05297bd3bfca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:41.555956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37e1791b-1412-411c-b6b0-05297bd3bfca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:41.556394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37e1791b-1412-411c-b6b0-05297bd3bfca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:41.615130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-37e1791b-1412-411c-b6b0-05297bd3bfca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:41.622398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-37e1791b-1412-411c-b6b0-05297bd3bfca tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078297 May 12 07:07:41.622958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 501/1153] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:41 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:41.934865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b8ebe286-1385-4c71-ba00-cf2f39c02aac tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:41.935721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b8ebe286-1385-4c71-ba00-cf2f39c02aac tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:41.941653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8ebe286-1385-4c71-ba00-cf2f39c02aac tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:41.942293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8ebe286-1385-4c71-ba00-cf2f39c02aac tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:41.943178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8ebe286-1385-4c71-ba00-cf2f39c02aac tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:41.943612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8ebe286-1385-4c71-ba00-cf2f39c02aac tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:41.973227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b8ebe286-1385-4c71-ba00-cf2f39c02aac tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042343 May 12 07:07:41.973864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 653/1154] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:41 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:42.002329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-157ed547-7fdc-4d50-84b3-e8539c551828 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:42.003257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-157ed547-7fdc-4d50-84b3-e8539c551828 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:42.010216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-157ed547-7fdc-4d50-84b3-e8539c551828 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:42.010667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-157ed547-7fdc-4d50-84b3-e8539c551828 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:42.011437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-157ed547-7fdc-4d50-84b3-e8539c551828 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:42.011919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-157ed547-7fdc-4d50-84b3-e8539c551828 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:42.040628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-157ed547-7fdc-4d50-84b3-e8539c551828 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042236 May 12 07:07:42.041171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 502/1155] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:41 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:42.639165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-eab0ae4e-a963-43e9-8645-fe5e9d9a1f43 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:42.639805 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-eab0ae4e-a963-43e9-8645-fe5e9d9a1f43 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:42.645709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab0ae4e-a963-43e9-8645-fe5e9d9a1f43 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:42.646159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab0ae4e-a963-43e9-8645-fe5e9d9a1f43 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:42.646927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab0ae4e-a963-43e9-8645-fe5e9d9a1f43 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:42.647368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab0ae4e-a963-43e9-8645-fe5e9d9a1f43 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:42.709372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eab0ae4e-a963-43e9-8645-fe5e9d9a1f43 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:42.717185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-eab0ae4e-a963-43e9-8645-fe5e9d9a1f43 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081982 May 12 07:07:42.717751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 654/1156] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:42 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:42.984908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ab2b34c6-fd61-47ab-9bfa-6d8f1cbdc241 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:42.985838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ab2b34c6-fd61-47ab-9bfa-6d8f1cbdc241 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:42.991896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab2b34c6-fd61-47ab-9bfa-6d8f1cbdc241 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:42.992370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab2b34c6-fd61-47ab-9bfa-6d8f1cbdc241 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:42.993137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab2b34c6-fd61-47ab-9bfa-6d8f1cbdc241 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:42.993580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab2b34c6-fd61-47ab-9bfa-6d8f1cbdc241 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:43.022614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ab2b34c6-fd61-47ab-9bfa-6d8f1cbdc241 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041813 May 12 07:07:43.023183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 503/1157] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:42 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:43.052225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5224ccde-ff77-4c15-a299-f2a713a1ffa1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:43.053197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5224ccde-ff77-4c15-a299-f2a713a1ffa1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:43.059432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5224ccde-ff77-4c15-a299-f2a713a1ffa1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:43.059930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5224ccde-ff77-4c15-a299-f2a713a1ffa1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:43.060710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5224ccde-ff77-4c15-a299-f2a713a1ffa1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:43.061152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5224ccde-ff77-4c15-a299-f2a713a1ffa1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:43.090946 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5224ccde-ff77-4c15-a299-f2a713a1ffa1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042904 May 12 07:07:43.091512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 655/1158] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:43.733647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6fd85432-0c97-42dd-bc01-e1ba14ecf20c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:43.734265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6fd85432-0c97-42dd-bc01-e1ba14ecf20c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:43.740207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6fd85432-0c97-42dd-bc01-e1ba14ecf20c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:43.740661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6fd85432-0c97-42dd-bc01-e1ba14ecf20c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:43.741461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6fd85432-0c97-42dd-bc01-e1ba14ecf20c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:43.741882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6fd85432-0c97-42dd-bc01-e1ba14ecf20c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:43.801432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6fd85432-0c97-42dd-bc01-e1ba14ecf20c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:43.809367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6fd85432-0c97-42dd-bc01-e1ba14ecf20c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079587 May 12 07:07:43.809934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 504/1159] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:43 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:44.035494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b5667fd7-1b3f-4034-89c8-80494216648b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:44.036729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b5667fd7-1b3f-4034-89c8-80494216648b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:44.043567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5667fd7-1b3f-4034-89c8-80494216648b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:44.044065 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5667fd7-1b3f-4034-89c8-80494216648b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:44.044834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5667fd7-1b3f-4034-89c8-80494216648b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:44.045271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5667fd7-1b3f-4034-89c8-80494216648b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:44.073916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b5667fd7-1b3f-4034-89c8-80494216648b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043119 May 12 07:07:44.074522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 656/1160] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:44 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:44.103066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-140a89df-3879-4133-9cce-431c56e7f5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:44.104014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-140a89df-3879-4133-9cce-431c56e7f5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:44.110277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-140a89df-3879-4133-9cce-431c56e7f5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:44.110725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-140a89df-3879-4133-9cce-431c56e7f5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:44.111484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-140a89df-3879-4133-9cce-431c56e7f5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:44.111945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-140a89df-3879-4133-9cce-431c56e7f5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:44.139815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-140a89df-3879-4133-9cce-431c56e7f5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041404 May 12 07:07:44.140363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 505/1161] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:44.826489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ca788b16-9849-415e-9b64-41f5535b99a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:44.827096 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ca788b16-9849-415e-9b64-41f5535b99a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:44.833153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca788b16-9849-415e-9b64-41f5535b99a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:44.833597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca788b16-9849-415e-9b64-41f5535b99a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:44.834362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca788b16-9849-415e-9b64-41f5535b99a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:44.834796 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca788b16-9849-415e-9b64-41f5535b99a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:44.893752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ca788b16-9849-415e-9b64-41f5535b99a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:44.901091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ca788b16-9849-415e-9b64-41f5535b99a9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078716 May 12 07:07:44.901653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 657/1162] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:44 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:45.085419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5a178a03-b7a8-48dc-a74b-f75076244fd5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:45.086462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5a178a03-b7a8-48dc-a74b-f75076244fd5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:45.092352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a178a03-b7a8-48dc-a74b-f75076244fd5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:45.092807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a178a03-b7a8-48dc-a74b-f75076244fd5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:45.093575 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a178a03-b7a8-48dc-a74b-f75076244fd5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:45.094013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a178a03-b7a8-48dc-a74b-f75076244fd5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:45.123373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5a178a03-b7a8-48dc-a74b-f75076244fd5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041948 May 12 07:07:45.124082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 506/1163] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:45 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:45.150484 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-84fd091f-d4fa-4f9b-a5df-a2a71c3842a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:45.151440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-84fd091f-d4fa-4f9b-a5df-a2a71c3842a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:45.157787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84fd091f-d4fa-4f9b-a5df-a2a71c3842a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:45.158244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84fd091f-d4fa-4f9b-a5df-a2a71c3842a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:45.159019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84fd091f-d4fa-4f9b-a5df-a2a71c3842a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:45.159458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84fd091f-d4fa-4f9b-a5df-a2a71c3842a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:45.189149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-84fd091f-d4fa-4f9b-a5df-a2a71c3842a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 May 12 07:07:45.189702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 658/1164] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:45 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:45.917803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-50bec107-1ddd-4eb1-b049-421961423269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:45.918536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-50bec107-1ddd-4eb1-b049-421961423269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:45.924757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50bec107-1ddd-4eb1-b049-421961423269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:45.925211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50bec107-1ddd-4eb1-b049-421961423269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:45.925985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50bec107-1ddd-4eb1-b049-421961423269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:45.926423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50bec107-1ddd-4eb1-b049-421961423269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:45.987219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-50bec107-1ddd-4eb1-b049-421961423269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:45.994729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-50bec107-1ddd-4eb1-b049-421961423269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080736 May 12 07:07:45.995298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 507/1165] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:45 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:46.134986 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-419e2d59-d4f7-4a56-b529-5466faa73bca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:46.135927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-419e2d59-d4f7-4a56-b529-5466faa73bca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:46.141800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-419e2d59-d4f7-4a56-b529-5466faa73bca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:46.142250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-419e2d59-d4f7-4a56-b529-5466faa73bca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:46.143007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-419e2d59-d4f7-4a56-b529-5466faa73bca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:46.143441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-419e2d59-d4f7-4a56-b529-5466faa73bca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:46.171896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-419e2d59-d4f7-4a56-b529-5466faa73bca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041321 May 12 07:07:46.172508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 659/1166] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:46 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:46.201005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-83f340c7-a707-4c15-a89a-61d6ad00debf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:46.201930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-83f340c7-a707-4c15-a89a-61d6ad00debf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:46.208185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83f340c7-a707-4c15-a89a-61d6ad00debf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:46.208638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83f340c7-a707-4c15-a89a-61d6ad00debf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:46.209410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83f340c7-a707-4c15-a89a-61d6ad00debf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:46.209848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83f340c7-a707-4c15-a89a-61d6ad00debf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:46.238385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-83f340c7-a707-4c15-a89a-61d6ad00debf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041314 May 12 07:07:46.238931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 508/1167] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:46 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:47.011225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f1893691-6b51-474b-8ae0-2057a44fbbe8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:47.011858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f1893691-6b51-474b-8ae0-2057a44fbbe8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:47.017794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1893691-6b51-474b-8ae0-2057a44fbbe8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:47.018239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1893691-6b51-474b-8ae0-2057a44fbbe8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:47.018998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1893691-6b51-474b-8ae0-2057a44fbbe8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:47.019429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1893691-6b51-474b-8ae0-2057a44fbbe8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:47.080837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f1893691-6b51-474b-8ae0-2057a44fbbe8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:47.088601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f1893691-6b51-474b-8ae0-2057a44fbbe8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081251 May 12 07:07:47.089166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 660/1168] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:47 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:47.183608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-70f8ea80-f4f6-424c-a3bd-267939969de2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:47.184478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-70f8ea80-f4f6-424c-a3bd-267939969de2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:47.190392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70f8ea80-f4f6-424c-a3bd-267939969de2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:47.190841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70f8ea80-f4f6-424c-a3bd-267939969de2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:47.191637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70f8ea80-f4f6-424c-a3bd-267939969de2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:47.192099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70f8ea80-f4f6-424c-a3bd-267939969de2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:47.220627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-70f8ea80-f4f6-424c-a3bd-267939969de2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041012 May 12 07:07:47.221228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 509/1169] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:47 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:47.249908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4828a695-3d2c-4a3f-b2a7-a86da878641b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:47.250838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4828a695-3d2c-4a3f-b2a7-a86da878641b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:47.257135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4828a695-3d2c-4a3f-b2a7-a86da878641b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:47.257591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4828a695-3d2c-4a3f-b2a7-a86da878641b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:47.258366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4828a695-3d2c-4a3f-b2a7-a86da878641b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:47.258806 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4828a695-3d2c-4a3f-b2a7-a86da878641b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:47.287209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4828a695-3d2c-4a3f-b2a7-a86da878641b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041383 May 12 07:07:47.287773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 661/1170] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:48.105662 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8737f24f-2264-4f04-90df-76b730a562f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:48.106267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8737f24f-2264-4f04-90df-76b730a562f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:48.112155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8737f24f-2264-4f04-90df-76b730a562f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:48.112602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8737f24f-2264-4f04-90df-76b730a562f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:48.113363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8737f24f-2264-4f04-90df-76b730a562f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:48.113796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8737f24f-2264-4f04-90df-76b730a562f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:48.173613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8737f24f-2264-4f04-90df-76b730a562f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:48.181848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8737f24f-2264-4f04-90df-76b730a562f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080519 May 12 07:07:48.182402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 510/1171] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:48 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:48.232552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0ee9ce6a-f724-4127-a132-4a4c7faf4657 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:48.233475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0ee9ce6a-f724-4127-a132-4a4c7faf4657 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:48.239336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ee9ce6a-f724-4127-a132-4a4c7faf4657 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:48.239825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ee9ce6a-f724-4127-a132-4a4c7faf4657 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:48.240599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ee9ce6a-f724-4127-a132-4a4c7faf4657 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:48.241045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ee9ce6a-f724-4127-a132-4a4c7faf4657 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:48.270305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0ee9ce6a-f724-4127-a132-4a4c7faf4657 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041623 May 12 07:07:48.270925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 662/1172] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:48 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:48.298226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0a964c7c-3b7c-4152-9350-1c10753b2d91 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:48.299392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0a964c7c-3b7c-4152-9350-1c10753b2d91 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:48.306365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a964c7c-3b7c-4152-9350-1c10753b2d91 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:48.306809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a964c7c-3b7c-4152-9350-1c10753b2d91 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:48.307567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a964c7c-3b7c-4152-9350-1c10753b2d91 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:48.308018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a964c7c-3b7c-4152-9350-1c10753b2d91 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:48.335240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0a964c7c-3b7c-4152-9350-1c10753b2d91 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040869 May 12 07:07:48.335808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 511/1173] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:48 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:49.198443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-27b786f0-bf05-4439-86a9-3c1e7c557351 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:49.199189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-27b786f0-bf05-4439-86a9-3c1e7c557351 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:49.205034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-27b786f0-bf05-4439-86a9-3c1e7c557351 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:49.205480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-27b786f0-bf05-4439-86a9-3c1e7c557351 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:49.206251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-27b786f0-bf05-4439-86a9-3c1e7c557351 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:49.206691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-27b786f0-bf05-4439-86a9-3c1e7c557351 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:49.266661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-27b786f0-bf05-4439-86a9-3c1e7c557351 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:49.274017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-27b786f0-bf05-4439-86a9-3c1e7c557351 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079618 May 12 07:07:49.276830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 663/1174] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:49 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:49.281605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c0cc77a9-3f5c-4af3-b9b0-2a2f8728712d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:49.282524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c0cc77a9-3f5c-4af3-b9b0-2a2f8728712d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:49.288555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0cc77a9-3f5c-4af3-b9b0-2a2f8728712d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:49.289114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0cc77a9-3f5c-4af3-b9b0-2a2f8728712d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:49.289960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0cc77a9-3f5c-4af3-b9b0-2a2f8728712d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:49.291030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0cc77a9-3f5c-4af3-b9b0-2a2f8728712d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:49.320495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c0cc77a9-3f5c-4af3-b9b0-2a2f8728712d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 May 12 07:07:49.321165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 512/1175] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:49 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:07:49.346420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4f8a03ec-244c-49a2-ac7d-95723f628a4b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:49.347352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4f8a03ec-244c-49a2-ac7d-95723f628a4b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:49.354098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f8a03ec-244c-49a2-ac7d-95723f628a4b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:49.354551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f8a03ec-244c-49a2-ac7d-95723f628a4b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:49.355325 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f8a03ec-244c-49a2-ac7d-95723f628a4b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:49.355794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4f8a03ec-244c-49a2-ac7d-95723f628a4b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:49.384114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4f8a03ec-244c-49a2-ac7d-95723f628a4b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041640 May 12 07:07:49.384659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 664/1176] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:49 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:50.290937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-76091cc3-79ac-444a-9c37-4d83e83a886f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:50.291516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-76091cc3-79ac-444a-9c37-4d83e83a886f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:50.297262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76091cc3-79ac-444a-9c37-4d83e83a886f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:50.297704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76091cc3-79ac-444a-9c37-4d83e83a886f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:50.298460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76091cc3-79ac-444a-9c37-4d83e83a886f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:50.299144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76091cc3-79ac-444a-9c37-4d83e83a886f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:50.332032 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-29c16fc9-420e-4dfc-9c78-a5a041e6a839 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:50.333020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-29c16fc9-420e-4dfc-9c78-a5a041e6a839 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:50.339397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29c16fc9-420e-4dfc-9c78-a5a041e6a839 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:50.339889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29c16fc9-420e-4dfc-9c78-a5a041e6a839 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:50.340794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29c16fc9-420e-4dfc-9c78-a5a041e6a839 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:50.341228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29c16fc9-420e-4dfc-9c78-a5a041e6a839 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:50.361410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-76091cc3-79ac-444a-9c37-4d83e83a886f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:50.369317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-76091cc3-79ac-444a-9c37-4d83e83a886f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081707 May 12 07:07:50.370016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 513/1177] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:50 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:50.371464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-29c16fc9-420e-4dfc-9c78-a5a041e6a839 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043368 May 12 07:07:50.372054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 665/1178] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:50 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:07:50.395317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1085a2b2-160c-418e-9738-d05aff499b20 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:50.396315 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1085a2b2-160c-418e-9738-d05aff499b20 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:50.402064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1085a2b2-160c-418e-9738-d05aff499b20 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:50.402537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1085a2b2-160c-418e-9738-d05aff499b20 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:50.403306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1085a2b2-160c-418e-9738-d05aff499b20 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:50.403785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1085a2b2-160c-418e-9738-d05aff499b20 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:50.432707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1085a2b2-160c-418e-9738-d05aff499b20 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041219 May 12 07:07:50.433250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 514/1179] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:07:51.382707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bf1b1ce4-a62c-4c0d-a701-ca93c5130226 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:51.383637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bf1b1ce4-a62c-4c0d-a701-ca93c5130226 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:51.385953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-16cd63ed-d65f-4b6c-b02d-c140b9af6e1e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:51.386573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-16cd63ed-d65f-4b6c-b02d-c140b9af6e1e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:51.389972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1b1ce4-a62c-4c0d-a701-ca93c5130226 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:51.390425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1b1ce4-a62c-4c0d-a701-ca93c5130226 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:51.391198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1b1ce4-a62c-4c0d-a701-ca93c5130226 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:51.391637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1b1ce4-a62c-4c0d-a701-ca93c5130226 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:51.392646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16cd63ed-d65f-4b6c-b02d-c140b9af6e1e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:51.393097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16cd63ed-d65f-4b6c-b02d-c140b9af6e1e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:51.393870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16cd63ed-d65f-4b6c-b02d-c140b9af6e1e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:51.394334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16cd63ed-d65f-4b6c-b02d-c140b9af6e1e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:51.420406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bf1b1ce4-a62c-4c0d-a701-ca93c5130226 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041721 May 12 07:07:51.420980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 666/1180] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:51 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:51.444112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bdf0dc25-ae82-4d47-9a0c-6ee2749a9d53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:51.445153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bdf0dc25-ae82-4d47-9a0c-6ee2749a9d53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:51.451016 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdf0dc25-ae82-4d47-9a0c-6ee2749a9d53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:51.451469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdf0dc25-ae82-4d47-9a0c-6ee2749a9d53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:51.452275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdf0dc25-ae82-4d47-9a0c-6ee2749a9d53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:51.452719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdf0dc25-ae82-4d47-9a0c-6ee2749a9d53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:51.457214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-16cd63ed-d65f-4b6c-b02d-c140b9af6e1e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:51.465192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-16cd63ed-d65f-4b6c-b02d-c140b9af6e1e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083077 May 12 07:07:51.465837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 515/1181] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:51 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:07:51.482546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bdf0dc25-ae82-4d47-9a0c-6ee2749a9d53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042293 May 12 07:07:51.483097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 667/1182] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:07:52.432469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-84b0e7e2-6c1e-4340-9fbc-eba9c7cd2768 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:52.433309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-84b0e7e2-6c1e-4340-9fbc-eba9c7cd2768 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:52.439556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84b0e7e2-6c1e-4340-9fbc-eba9c7cd2768 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:52.440034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84b0e7e2-6c1e-4340-9fbc-eba9c7cd2768 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:52.440805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84b0e7e2-6c1e-4340-9fbc-eba9c7cd2768 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:52.441242 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84b0e7e2-6c1e-4340-9fbc-eba9c7cd2768 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:52.469984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-84b0e7e2-6c1e-4340-9fbc-eba9c7cd2768 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 May 12 07:07:52.470524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 516/1183] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:52 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:52.482190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bf1ed40d-5450-444b-9ece-525e71a4d95a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:52.482811 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bf1ed40d-5450-444b-9ece-525e71a4d95a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:52.489189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1ed40d-5450-444b-9ece-525e71a4d95a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:52.489638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1ed40d-5450-444b-9ece-525e71a4d95a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:52.490409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1ed40d-5450-444b-9ece-525e71a4d95a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:52.490850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf1ed40d-5450-444b-9ece-525e71a4d95a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:52.493753 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8832b5be-0e3c-409d-b804-c8687a8e5770 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:52.494663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8832b5be-0e3c-409d-b804-c8687a8e5770 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:52.500648 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8832b5be-0e3c-409d-b804-c8687a8e5770 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:52.501105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8832b5be-0e3c-409d-b804-c8687a8e5770 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:52.501879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8832b5be-0e3c-409d-b804-c8687a8e5770 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:52.502320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8832b5be-0e3c-409d-b804-c8687a8e5770 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:52.531147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8832b5be-0e3c-409d-b804-c8687a8e5770 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041188 May 12 07:07:52.531736 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 517/1184] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:07:52.551524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bf1ed40d-5450-444b-9ece-525e71a4d95a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:52.558853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bf1ed40d-5450-444b-9ece-525e71a4d95a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081083 May 12 07:07:52.559418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 668/1185] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:52 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:53.481518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7026740c-6fd2-4e0c-9142-d2b526999c21 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:53.482429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7026740c-6fd2-4e0c-9142-d2b526999c21 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:53.488650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7026740c-6fd2-4e0c-9142-d2b526999c21 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:53.489101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7026740c-6fd2-4e0c-9142-d2b526999c21 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:53.489865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7026740c-6fd2-4e0c-9142-d2b526999c21 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:53.490299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7026740c-6fd2-4e0c-9142-d2b526999c21 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:53.518274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7026740c-6fd2-4e0c-9142-d2b526999c21 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040679 May 12 07:07:53.518819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 518/1186] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:53 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:53.542264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-23c00de9-f7ea-4bbc-bff6-967a57c92d14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:53.543196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-23c00de9-f7ea-4bbc-bff6-967a57c92d14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:53.549786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23c00de9-f7ea-4bbc-bff6-967a57c92d14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:53.550235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23c00de9-f7ea-4bbc-bff6-967a57c92d14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:53.550999 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23c00de9-f7ea-4bbc-bff6-967a57c92d14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:53.551439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23c00de9-f7ea-4bbc-bff6-967a57c92d14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:53.575163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-000d9fed-3190-4ea1-9a1e-869b1b62d03a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:53.575902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-000d9fed-3190-4ea1-9a1e-869b1b62d03a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:53.579656 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-23c00de9-f7ea-4bbc-bff6-967a57c92d14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041279 May 12 07:07:53.580528 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 669/1187] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:53.581683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-000d9fed-3190-4ea1-9a1e-869b1b62d03a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:53.582132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-000d9fed-3190-4ea1-9a1e-869b1b62d03a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:53.582896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-000d9fed-3190-4ea1-9a1e-869b1b62d03a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:53.583329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-000d9fed-3190-4ea1-9a1e-869b1b62d03a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:53.642969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-000d9fed-3190-4ea1-9a1e-869b1b62d03a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:53.650804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-000d9fed-3190-4ea1-9a1e-869b1b62d03a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079937 May 12 07:07:53.651358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 519/1188] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:53 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:07:54.530343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c0329ce8-478d-452f-9e69-51cc8e2aa799 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:54.531323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c0329ce8-478d-452f-9e69-51cc8e2aa799 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:54.537197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c0329ce8-478d-452f-9e69-51cc8e2aa799 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:54.537647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c0329ce8-478d-452f-9e69-51cc8e2aa799 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:54.538414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c0329ce8-478d-452f-9e69-51cc8e2aa799 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:54.538848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c0329ce8-478d-452f-9e69-51cc8e2aa799 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:54.567407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c0329ce8-478d-452f-9e69-51cc8e2aa799 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041035 May 12 07:07:54.568039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 670/1189] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:54 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:54.591193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1d42d91f-46c5-4e9c-80f8-5b0522533a53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:54.592141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1d42d91f-46c5-4e9c-80f8-5b0522533a53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:54.598345 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d42d91f-46c5-4e9c-80f8-5b0522533a53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:54.598793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d42d91f-46c5-4e9c-80f8-5b0522533a53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:54.599562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d42d91f-46c5-4e9c-80f8-5b0522533a53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:54.600026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d42d91f-46c5-4e9c-80f8-5b0522533a53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:54.630000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1d42d91f-46c5-4e9c-80f8-5b0522533a53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043213 May 12 07:07:54.630561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 520/1190] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:54.667643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-deac23eb-fd54-4f2e-8865-24a82abbb81e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:54.668299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-deac23eb-fd54-4f2e-8865-24a82abbb81e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:54.674584 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-deac23eb-fd54-4f2e-8865-24a82abbb81e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:54.675035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-deac23eb-fd54-4f2e-8865-24a82abbb81e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:54.675844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-deac23eb-fd54-4f2e-8865-24a82abbb81e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:54.676280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-deac23eb-fd54-4f2e-8865-24a82abbb81e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:54.740843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-deac23eb-fd54-4f2e-8865-24a82abbb81e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:54.748839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-deac23eb-fd54-4f2e-8865-24a82abbb81e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.085599 May 12 07:07:54.749410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 671/1191] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:54 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:55.578903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-481cbbf0-57f6-40b4-bde7-14f124a6b3e1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:55.579851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-481cbbf0-57f6-40b4-bde7-14f124a6b3e1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:55.585903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-481cbbf0-57f6-40b4-bde7-14f124a6b3e1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:55.586355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-481cbbf0-57f6-40b4-bde7-14f124a6b3e1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:55.587201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-481cbbf0-57f6-40b4-bde7-14f124a6b3e1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:55.587631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-481cbbf0-57f6-40b4-bde7-14f124a6b3e1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:55.615560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-481cbbf0-57f6-40b4-bde7-14f124a6b3e1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040666 May 12 07:07:55.616202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 521/1192] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:55 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:55.641456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-87baec54-ad39-4df7-9483-080453a37d7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:55.642864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-87baec54-ad39-4df7-9483-080453a37d7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:55.649118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87baec54-ad39-4df7-9483-080453a37d7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:55.649562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87baec54-ad39-4df7-9483-080453a37d7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:55.650321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87baec54-ad39-4df7-9483-080453a37d7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:55.650755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87baec54-ad39-4df7-9483-080453a37d7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:55.679908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-87baec54-ad39-4df7-9483-080453a37d7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042348 May 12 07:07:55.680443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 672/1193] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:55 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:55.765438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7b5003c5-1e48-44ce-a6fa-80f4106615e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:55.766048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7b5003c5-1e48-44ce-a6fa-80f4106615e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:55.771912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b5003c5-1e48-44ce-a6fa-80f4106615e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:55.772360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b5003c5-1e48-44ce-a6fa-80f4106615e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:55.773125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b5003c5-1e48-44ce-a6fa-80f4106615e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:55.773558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b5003c5-1e48-44ce-a6fa-80f4106615e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:55.835074 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7b5003c5-1e48-44ce-a6fa-80f4106615e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:55.842427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7b5003c5-1e48-44ce-a6fa-80f4106615e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080786 May 12 07:07:55.842983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 522/1194] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:55 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:56.627715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-feb14b3d-3bb8-4e08-9c1c-491339a59231 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:56.628651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-feb14b3d-3bb8-4e08-9c1c-491339a59231 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:56.634639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-feb14b3d-3bb8-4e08-9c1c-491339a59231 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:56.635094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-feb14b3d-3bb8-4e08-9c1c-491339a59231 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:56.635909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-feb14b3d-3bb8-4e08-9c1c-491339a59231 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:56.636354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-feb14b3d-3bb8-4e08-9c1c-491339a59231 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:56.665602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-feb14b3d-3bb8-4e08-9c1c-491339a59231 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041359 May 12 07:07:56.666164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 673/1195] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:56 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:56.691427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-293e3839-e49c-4929-9601-bd557b47d68d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:56.692372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-293e3839-e49c-4929-9601-bd557b47d68d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:56.698621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-293e3839-e49c-4929-9601-bd557b47d68d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:56.699072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-293e3839-e49c-4929-9601-bd557b47d68d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:56.699862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-293e3839-e49c-4929-9601-bd557b47d68d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:56.700302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-293e3839-e49c-4929-9601-bd557b47d68d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:56.728898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-293e3839-e49c-4929-9601-bd557b47d68d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041393 May 12 07:07:56.729430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 523/1196] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:56.858786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-44dfb957-c0db-41fc-bd9c-168e28941547 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:56.859402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-44dfb957-c0db-41fc-bd9c-168e28941547 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:56.865494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44dfb957-c0db-41fc-bd9c-168e28941547 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:56.865940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44dfb957-c0db-41fc-bd9c-168e28941547 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:56.866705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44dfb957-c0db-41fc-bd9c-168e28941547 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:56.867137 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44dfb957-c0db-41fc-bd9c-168e28941547 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:56.926311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-44dfb957-c0db-41fc-bd9c-168e28941547 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:56.933545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-44dfb957-c0db-41fc-bd9c-168e28941547 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078542 May 12 07:07:56.934101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 674/1197] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:56 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:57.678167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-536d5fd9-4151-4c3c-982e-3ba3b56addb1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:57.679007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-536d5fd9-4151-4c3c-982e-3ba3b56addb1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:57.685587 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-536d5fd9-4151-4c3c-982e-3ba3b56addb1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:57.686053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-536d5fd9-4151-4c3c-982e-3ba3b56addb1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:57.686834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-536d5fd9-4151-4c3c-982e-3ba3b56addb1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:57.687268 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-536d5fd9-4151-4c3c-982e-3ba3b56addb1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:57.716989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-536d5fd9-4151-4c3c-982e-3ba3b56addb1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043328 May 12 07:07:57.717663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 524/1198] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:57 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:57.740538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5ea4028f-69a1-418a-a4f4-86923e8d1126 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:57.741530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5ea4028f-69a1-418a-a4f4-86923e8d1126 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:57.748643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ea4028f-69a1-418a-a4f4-86923e8d1126 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:57.752992 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ea4028f-69a1-418a-a4f4-86923e8d1126 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:57.752992 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ea4028f-69a1-418a-a4f4-86923e8d1126 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:57.752992 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5ea4028f-69a1-418a-a4f4-86923e8d1126 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:57.780913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5ea4028f-69a1-418a-a4f4-86923e8d1126 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044345 May 12 07:07:57.781480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 675/1199] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:57.950304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-faea63d2-45ef-45e6-a13f-dffbfd05800c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:57.950879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-faea63d2-45ef-45e6-a13f-dffbfd05800c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:57.956673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-faea63d2-45ef-45e6-a13f-dffbfd05800c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:57.957134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-faea63d2-45ef-45e6-a13f-dffbfd05800c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:57.957913 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-faea63d2-45ef-45e6-a13f-dffbfd05800c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:57.958356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-faea63d2-45ef-45e6-a13f-dffbfd05800c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:58.018618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-faea63d2-45ef-45e6-a13f-dffbfd05800c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:58.027038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-faea63d2-45ef-45e6-a13f-dffbfd05800c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081161 May 12 07:07:58.027617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 525/1200] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:57 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:58.728845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-31e33158-6a87-4509-91ae-c2275b34cb09 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:58.729804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-31e33158-6a87-4509-91ae-c2275b34cb09 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:58.735603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31e33158-6a87-4509-91ae-c2275b34cb09 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:58.736093 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31e33158-6a87-4509-91ae-c2275b34cb09 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:58.736867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31e33158-6a87-4509-91ae-c2275b34cb09 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:58.737334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31e33158-6a87-4509-91ae-c2275b34cb09 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:58.766755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-31e33158-6a87-4509-91ae-c2275b34cb09 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042130 May 12 07:07:58.767393 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 676/1201] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:58 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:58.792444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-429dfd60-e63d-482c-a15f-27979fced8b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:58.793370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-429dfd60-e63d-482c-a15f-27979fced8b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:58.799960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-429dfd60-e63d-482c-a15f-27979fced8b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:58.800420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-429dfd60-e63d-482c-a15f-27979fced8b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:58.801189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-429dfd60-e63d-482c-a15f-27979fced8b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:58.801626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-429dfd60-e63d-482c-a15f-27979fced8b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:58.830036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-429dfd60-e63d-482c-a15f-27979fced8b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041601 May 12 07:07:58.830606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 526/1202] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:59.044477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7dc4f6eb-584c-4b9e-9b7e-b5516ff65fd3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:59.045128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7dc4f6eb-584c-4b9e-9b7e-b5516ff65fd3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:59.051306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dc4f6eb-584c-4b9e-9b7e-b5516ff65fd3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:59.051795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dc4f6eb-584c-4b9e-9b7e-b5516ff65fd3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:59.052568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dc4f6eb-584c-4b9e-9b7e-b5516ff65fd3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:59.053014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dc4f6eb-584c-4b9e-9b7e-b5516ff65fd3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:59.116201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7dc4f6eb-584c-4b9e-9b7e-b5516ff65fd3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:07:59.123553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7dc4f6eb-584c-4b9e-9b7e-b5516ff65fd3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083777 May 12 07:07:59.124161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 677/1203] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:07:59 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:07:59.778336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bfa813ae-a2ab-4ed5-9ac4-a8f3c1105507 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:59.779267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bfa813ae-a2ab-4ed5-9ac4-a8f3c1105507 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:59.785330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfa813ae-a2ab-4ed5-9ac4-a8f3c1105507 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:59.785816 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfa813ae-a2ab-4ed5-9ac4-a8f3c1105507 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:59.786594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfa813ae-a2ab-4ed5-9ac4-a8f3c1105507 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:59.787041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfa813ae-a2ab-4ed5-9ac4-a8f3c1105507 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:59.815800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bfa813ae-a2ab-4ed5-9ac4-a8f3c1105507 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041431 May 12 07:07:59.816366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 527/1204] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:59 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:07:59.841613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0d3edf3f-3d5e-42ee-8861-f9a99170c53e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:07:59.842539 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0d3edf3f-3d5e-42ee-8861-f9a99170c53e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:07:59.848841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d3edf3f-3d5e-42ee-8861-f9a99170c53e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:59.849292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d3edf3f-3d5e-42ee-8861-f9a99170c53e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:59.850057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d3edf3f-3d5e-42ee-8861-f9a99170c53e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:07:59.850494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d3edf3f-3d5e-42ee-8861-f9a99170c53e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:07:59.878834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0d3edf3f-3d5e-42ee-8861-f9a99170c53e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041192 May 12 07:07:59.879368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 678/1205] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:07:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:00.139760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a7d2b6df-e526-4d77-b585-7e3e8b157f5e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:00.140321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a7d2b6df-e526-4d77-b585-7e3e8b157f5e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:00.146202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7d2b6df-e526-4d77-b585-7e3e8b157f5e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:00.146631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7d2b6df-e526-4d77-b585-7e3e8b157f5e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:00.147395 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7d2b6df-e526-4d77-b585-7e3e8b157f5e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:00.147869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7d2b6df-e526-4d77-b585-7e3e8b157f5e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:00.209701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a7d2b6df-e526-4d77-b585-7e3e8b157f5e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:00.216980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a7d2b6df-e526-4d77-b585-7e3e8b157f5e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081152 May 12 07:08:00.217539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 528/1206] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:00 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:00.827357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d5e4ce4b-3796-4d92-b142-36686fc70ca9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:00.828309 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d5e4ce4b-3796-4d92-b142-36686fc70ca9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:00.834281 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5e4ce4b-3796-4d92-b142-36686fc70ca9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:00.834731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5e4ce4b-3796-4d92-b142-36686fc70ca9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:00.835498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5e4ce4b-3796-4d92-b142-36686fc70ca9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:00.835964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5e4ce4b-3796-4d92-b142-36686fc70ca9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:00.864422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d5e4ce4b-3796-4d92-b142-36686fc70ca9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041039 May 12 07:08:00.865020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 679/1207] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:00 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:00.891566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-13423f9a-6764-41e6-a128-20ab695fdb9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:00.892463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-13423f9a-6764-41e6-a128-20ab695fdb9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:00.898607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13423f9a-6764-41e6-a128-20ab695fdb9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:00.903939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13423f9a-6764-41e6-a128-20ab695fdb9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:00.903939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13423f9a-6764-41e6-a128-20ab695fdb9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:00.903939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13423f9a-6764-41e6-a128-20ab695fdb9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:01.085533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-13423f9a-6764-41e6-a128-20ab695fdb9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197840 May 12 07:08:01.085995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 529/1208] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:01.234552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-80a59a96-dc90-467a-b956-619f9c870edf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:01.235115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-80a59a96-dc90-467a-b956-619f9c870edf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:01.243131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80a59a96-dc90-467a-b956-619f9c870edf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:01.244210 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80a59a96-dc90-467a-b956-619f9c870edf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:01.245486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80a59a96-dc90-467a-b956-619f9c870edf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:01.245804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80a59a96-dc90-467a-b956-619f9c870edf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:01.308453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-80a59a96-dc90-467a-b956-619f9c870edf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:01.315755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-80a59a96-dc90-467a-b956-619f9c870edf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.085561 May 12 07:08:01.316356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 680/1209] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:01 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:01.875877 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-68f433da-0ff8-465a-8ece-44d4963a0f4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:01.876788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-68f433da-0ff8-465a-8ece-44d4963a0f4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:01.882566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68f433da-0ff8-465a-8ece-44d4963a0f4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:01.883009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68f433da-0ff8-465a-8ece-44d4963a0f4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:01.883805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68f433da-0ff8-465a-8ece-44d4963a0f4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:01.884735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68f433da-0ff8-465a-8ece-44d4963a0f4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:01.912849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-68f433da-0ff8-465a-8ece-44d4963a0f4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040972 May 12 07:08:01.913458 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 530/1210] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:01 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:02.097729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-25aa8898-e213-46e6-a136-50c6e9f5bda3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:02.098647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-25aa8898-e213-46e6-a136-50c6e9f5bda3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:02.104821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-25aa8898-e213-46e6-a136-50c6e9f5bda3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:02.105278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-25aa8898-e213-46e6-a136-50c6e9f5bda3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:02.106058 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-25aa8898-e213-46e6-a136-50c6e9f5bda3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:02.106525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-25aa8898-e213-46e6-a136-50c6e9f5bda3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:02.136011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-25aa8898-e213-46e6-a136-50c6e9f5bda3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042134 May 12 07:08:02.136491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 681/1211] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:02.332024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-55a12d22-bd8a-4e9a-9733-13ce84a036d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:02.332640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-55a12d22-bd8a-4e9a-9733-13ce84a036d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:02.338536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55a12d22-bd8a-4e9a-9733-13ce84a036d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:02.338986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55a12d22-bd8a-4e9a-9733-13ce84a036d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:02.339785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55a12d22-bd8a-4e9a-9733-13ce84a036d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:02.340227 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55a12d22-bd8a-4e9a-9733-13ce84a036d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:02.398896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-55a12d22-bd8a-4e9a-9733-13ce84a036d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:02.406181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-55a12d22-bd8a-4e9a-9733-13ce84a036d3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.077982 May 12 07:08:02.406732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 531/1212] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:02 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:02.924657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f2207815-0e03-44cd-a32d-a15d77fc2676 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:02.925577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f2207815-0e03-44cd-a32d-a15d77fc2676 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:02.931914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2207815-0e03-44cd-a32d-a15d77fc2676 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:02.932359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2207815-0e03-44cd-a32d-a15d77fc2676 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:02.933116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2207815-0e03-44cd-a32d-a15d77fc2676 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:02.933551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2207815-0e03-44cd-a32d-a15d77fc2676 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:02.961540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f2207815-0e03-44cd-a32d-a15d77fc2676 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041100 May 12 07:08:02.962239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 682/1213] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:02 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:03.146610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1dd9d7c3-1cfb-4df2-9d6f-4a703e9c68bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:03.147540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1dd9d7c3-1cfb-4df2-9d6f-4a703e9c68bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:03.154460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dd9d7c3-1cfb-4df2-9d6f-4a703e9c68bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:03.154924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dd9d7c3-1cfb-4df2-9d6f-4a703e9c68bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:03.155707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dd9d7c3-1cfb-4df2-9d6f-4a703e9c68bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:03.156142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1dd9d7c3-1cfb-4df2-9d6f-4a703e9c68bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:03.184071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1dd9d7c3-1cfb-4df2-9d6f-4a703e9c68bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041355 May 12 07:08:03.184546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 532/1214] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:03.422346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0d19c99f-44c4-437c-94a3-ba0417092c42 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:03.422957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0d19c99f-44c4-437c-94a3-ba0417092c42 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:03.429156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d19c99f-44c4-437c-94a3-ba0417092c42 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:03.429610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d19c99f-44c4-437c-94a3-ba0417092c42 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:03.430366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d19c99f-44c4-437c-94a3-ba0417092c42 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:03.430797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d19c99f-44c4-437c-94a3-ba0417092c42 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:03.492515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0d19c99f-44c4-437c-94a3-ba0417092c42 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:03.500004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0d19c99f-44c4-437c-94a3-ba0417092c42 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081522 May 12 07:08:03.500577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 683/1215] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:03 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:03.973886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-af864047-dbe2-42c5-9276-1bc4cf2179a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:03.974727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-af864047-dbe2-42c5-9276-1bc4cf2179a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:03.981381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af864047-dbe2-42c5-9276-1bc4cf2179a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:03.981832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af864047-dbe2-42c5-9276-1bc4cf2179a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:03.982600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af864047-dbe2-42c5-9276-1bc4cf2179a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:03.983062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af864047-dbe2-42c5-9276-1bc4cf2179a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:04.012862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-af864047-dbe2-42c5-9276-1bc4cf2179a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043065 May 12 07:08:04.013419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 533/1216] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:03 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:04.195453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-69b721ce-b721-4bff-a9f0-6e7bf9c94a12 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:04.196483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-69b721ce-b721-4bff-a9f0-6e7bf9c94a12 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:04.202820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69b721ce-b721-4bff-a9f0-6e7bf9c94a12 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:04.203275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69b721ce-b721-4bff-a9f0-6e7bf9c94a12 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:04.204079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69b721ce-b721-4bff-a9f0-6e7bf9c94a12 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:04.204523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69b721ce-b721-4bff-a9f0-6e7bf9c94a12 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:04.233628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-69b721ce-b721-4bff-a9f0-6e7bf9c94a12 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042076 May 12 07:08:04.234111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 684/1217] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:04.516312 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6046160b-e5e1-4bc8-8dee-b3eb5feabd3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:04.516925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6046160b-e5e1-4bc8-8dee-b3eb5feabd3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:04.523351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6046160b-e5e1-4bc8-8dee-b3eb5feabd3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:04.523826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6046160b-e5e1-4bc8-8dee-b3eb5feabd3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:04.524628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6046160b-e5e1-4bc8-8dee-b3eb5feabd3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:04.525578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6046160b-e5e1-4bc8-8dee-b3eb5feabd3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:04.589282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6046160b-e5e1-4bc8-8dee-b3eb5feabd3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:04.596543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6046160b-e5e1-4bc8-8dee-b3eb5feabd3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084193 May 12 07:08:04.597099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 534/1218] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:05.024254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b262d234-3c02-43e5-9037-fc65de64af3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:05.025697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b262d234-3c02-43e5-9037-fc65de64af3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:05.031870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b262d234-3c02-43e5-9037-fc65de64af3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:05.032326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b262d234-3c02-43e5-9037-fc65de64af3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:05.033100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b262d234-3c02-43e5-9037-fc65de64af3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:05.033540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b262d234-3c02-43e5-9037-fc65de64af3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:05.062852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b262d234-3c02-43e5-9037-fc65de64af3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042559 May 12 07:08:05.063401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 685/1219] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:05 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:05.245004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4f87e566-d6e9-444f-b070-2d31d683e369 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:05.245942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4f87e566-d6e9-444f-b070-2d31d683e369 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:05.251841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f87e566-d6e9-444f-b070-2d31d683e369 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:05.252285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f87e566-d6e9-444f-b070-2d31d683e369 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:05.253051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f87e566-d6e9-444f-b070-2d31d683e369 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:05.253483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f87e566-d6e9-444f-b070-2d31d683e369 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:05.282590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4f87e566-d6e9-444f-b070-2d31d683e369 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041585 May 12 07:08:05.283121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 535/1220] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:05.613065 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-65a05fce-6b6c-434d-9740-8cf43c61dd3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:05.613683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-65a05fce-6b6c-434d-9740-8cf43c61dd3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:05.620117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65a05fce-6b6c-434d-9740-8cf43c61dd3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:05.620569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65a05fce-6b6c-434d-9740-8cf43c61dd3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:05.621339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65a05fce-6b6c-434d-9740-8cf43c61dd3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:05.621772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65a05fce-6b6c-434d-9740-8cf43c61dd3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:05.681759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-65a05fce-6b6c-434d-9740-8cf43c61dd3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:05.689119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-65a05fce-6b6c-434d-9740-8cf43c61dd3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079975 May 12 07:08:05.689677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 686/1221] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:05 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:06.073930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-091233e0-6fe8-40b8-ac09-ea4aa048c8c7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:06.074850 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-091233e0-6fe8-40b8-ac09-ea4aa048c8c7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:06.081109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-091233e0-6fe8-40b8-ac09-ea4aa048c8c7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:06.081560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-091233e0-6fe8-40b8-ac09-ea4aa048c8c7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:06.082326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-091233e0-6fe8-40b8-ac09-ea4aa048c8c7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:06.082764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-091233e0-6fe8-40b8-ac09-ea4aa048c8c7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:06.113802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-091233e0-6fe8-40b8-ac09-ea4aa048c8c7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 May 12 07:08:06.114338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 536/1222] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:06 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:06.294339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d060f417-e6b2-4706-bf0c-26e0b6af43cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:06.295224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d060f417-e6b2-4706-bf0c-26e0b6af43cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:06.301404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d060f417-e6b2-4706-bf0c-26e0b6af43cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:06.301853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d060f417-e6b2-4706-bf0c-26e0b6af43cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:06.302615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d060f417-e6b2-4706-bf0c-26e0b6af43cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:06.303050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d060f417-e6b2-4706-bf0c-26e0b6af43cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:06.331445 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d060f417-e6b2-4706-bf0c-26e0b6af43cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041593 May 12 07:08:06.332017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 687/1223] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:06.706241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4a59235e-1644-4631-b9eb-b59ab4190d53 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:06.706771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4a59235e-1644-4631-b9eb-b59ab4190d53 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:06.712673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a59235e-1644-4631-b9eb-b59ab4190d53 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:06.713122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a59235e-1644-4631-b9eb-b59ab4190d53 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:06.713889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a59235e-1644-4631-b9eb-b59ab4190d53 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:06.714327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a59235e-1644-4631-b9eb-b59ab4190d53 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:06.772784 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4a59235e-1644-4631-b9eb-b59ab4190d53 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:06.779994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4a59235e-1644-4631-b9eb-b59ab4190d53 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.077678 May 12 07:08:06.780549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 537/1224] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:06 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:07.125398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d6cb2ae5-614c-43ff-aa93-06c0309e7e69 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:07.126313 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d6cb2ae5-614c-43ff-aa93-06c0309e7e69 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:07.132606 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6cb2ae5-614c-43ff-aa93-06c0309e7e69 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:07.133128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6cb2ae5-614c-43ff-aa93-06c0309e7e69 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:07.133891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6cb2ae5-614c-43ff-aa93-06c0309e7e69 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:07.134370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6cb2ae5-614c-43ff-aa93-06c0309e7e69 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:07.161889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d6cb2ae5-614c-43ff-aa93-06c0309e7e69 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040493 May 12 07:08:07.162425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 688/1225] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:07 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:07.343012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-46407d0e-39bc-4b43-8f4b-812f042d5113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:07.343899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-46407d0e-39bc-4b43-8f4b-812f042d5113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:07.350171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46407d0e-39bc-4b43-8f4b-812f042d5113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:07.350624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46407d0e-39bc-4b43-8f4b-812f042d5113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:07.351395 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46407d0e-39bc-4b43-8f4b-812f042d5113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:07.351868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46407d0e-39bc-4b43-8f4b-812f042d5113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:07.380028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-46407d0e-39bc-4b43-8f4b-812f042d5113 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041101 May 12 07:08:07.380565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 538/1226] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:07 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:07.796762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cbeb57c3-4c00-43ae-bcb8-b2df8dc67e3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:07.797385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cbeb57c3-4c00-43ae-bcb8-b2df8dc67e3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:07.803565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cbeb57c3-4c00-43ae-bcb8-b2df8dc67e3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:07.804046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cbeb57c3-4c00-43ae-bcb8-b2df8dc67e3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:07.804816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cbeb57c3-4c00-43ae-bcb8-b2df8dc67e3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:07.805252 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cbeb57c3-4c00-43ae-bcb8-b2df8dc67e3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:07.864478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cbeb57c3-4c00-43ae-bcb8-b2df8dc67e3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:07.871997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cbeb57c3-4c00-43ae-bcb8-b2df8dc67e3f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079181 May 12 07:08:07.872560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 689/1227] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:07 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:08.174201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-65e55fa5-2609-421d-82d6-78b016291d17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:08.175054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-65e55fa5-2609-421d-82d6-78b016291d17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:08.181528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65e55fa5-2609-421d-82d6-78b016291d17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:08.181975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65e55fa5-2609-421d-82d6-78b016291d17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:08.182733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65e55fa5-2609-421d-82d6-78b016291d17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:08.183165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65e55fa5-2609-421d-82d6-78b016291d17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:08.210984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-65e55fa5-2609-421d-82d6-78b016291d17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041091 May 12 07:08:08.211509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 539/1228] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:08 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:08.391694 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ca1b27b0-a6c9-43b6-b351-56af40c1b232 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:08.392650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ca1b27b0-a6c9-43b6-b351-56af40c1b232 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:08.398993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca1b27b0-a6c9-43b6-b351-56af40c1b232 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:08.399453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca1b27b0-a6c9-43b6-b351-56af40c1b232 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:08.400286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca1b27b0-a6c9-43b6-b351-56af40c1b232 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:08.400733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca1b27b0-a6c9-43b6-b351-56af40c1b232 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:08.429539 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ca1b27b0-a6c9-43b6-b351-56af40c1b232 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041822 May 12 07:08:08.430035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 690/1229] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:08.888743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bf594003-5cad-49f7-972b-6d3774701a17 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:08.889354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bf594003-5cad-49f7-972b-6d3774701a17 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:08.895610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf594003-5cad-49f7-972b-6d3774701a17 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:08.896093 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf594003-5cad-49f7-972b-6d3774701a17 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:08.896861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf594003-5cad-49f7-972b-6d3774701a17 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:08.897297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf594003-5cad-49f7-972b-6d3774701a17 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:08.959379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bf594003-5cad-49f7-972b-6d3774701a17 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:08.967527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bf594003-5cad-49f7-972b-6d3774701a17 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082606 May 12 07:08:08.968128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 540/1230] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:08 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:09.222778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-342585d4-4ddb-4946-a1d8-bfbf8f9ab585 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:09.223617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-342585d4-4ddb-4946-a1d8-bfbf8f9ab585 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:09.229555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-342585d4-4ddb-4946-a1d8-bfbf8f9ab585 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:09.230004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-342585d4-4ddb-4946-a1d8-bfbf8f9ab585 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:09.230809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-342585d4-4ddb-4946-a1d8-bfbf8f9ab585 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:09.231243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-342585d4-4ddb-4946-a1d8-bfbf8f9ab585 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:09.258960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-342585d4-4ddb-4946-a1d8-bfbf8f9ab585 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040318 May 12 07:08:09.259502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 691/1231] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:09 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:09.441607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e73d604b-1f24-450e-a34d-20abcd533185 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:09.442555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e73d604b-1f24-450e-a34d-20abcd533185 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:09.449267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e73d604b-1f24-450e-a34d-20abcd533185 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:09.449720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e73d604b-1f24-450e-a34d-20abcd533185 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:09.450487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e73d604b-1f24-450e-a34d-20abcd533185 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:09.450928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e73d604b-1f24-450e-a34d-20abcd533185 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:09.478967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e73d604b-1f24-450e-a34d-20abcd533185 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041289 May 12 07:08:09.479502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 541/1232] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:09.984398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5705304f-c692-4d47-aebc-aa969e87d4cd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:09.985020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5705304f-c692-4d47-aebc-aa969e87d4cd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:09.991632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5705304f-c692-4d47-aebc-aa969e87d4cd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:09.992184 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5705304f-c692-4d47-aebc-aa969e87d4cd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:09.993002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5705304f-c692-4d47-aebc-aa969e87d4cd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:09.993373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5705304f-c692-4d47-aebc-aa969e87d4cd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:10.053691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5705304f-c692-4d47-aebc-aa969e87d4cd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:10.061659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5705304f-c692-4d47-aebc-aa969e87d4cd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081117 May 12 07:08:10.062225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 692/1233] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:09 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:10.270666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a70cd57e-2cbc-44e1-9e8e-ef03fe326fec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:10.271589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a70cd57e-2cbc-44e1-9e8e-ef03fe326fec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:10.278493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70cd57e-2cbc-44e1-9e8e-ef03fe326fec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:10.278941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70cd57e-2cbc-44e1-9e8e-ef03fe326fec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:10.279731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70cd57e-2cbc-44e1-9e8e-ef03fe326fec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:10.280180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70cd57e-2cbc-44e1-9e8e-ef03fe326fec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:10.308985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a70cd57e-2cbc-44e1-9e8e-ef03fe326fec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042440 May 12 07:08:10.309542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 542/1234] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:10 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:10.490489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-43f3337a-da2a-404f-9419-2148f1d7ef13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:10.491397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-43f3337a-da2a-404f-9419-2148f1d7ef13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:10.498260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43f3337a-da2a-404f-9419-2148f1d7ef13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:10.498705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43f3337a-da2a-404f-9419-2148f1d7ef13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:10.499477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43f3337a-da2a-404f-9419-2148f1d7ef13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:10.499949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43f3337a-da2a-404f-9419-2148f1d7ef13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:10.527917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-43f3337a-da2a-404f-9419-2148f1d7ef13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041383 May 12 07:08:10.528401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 693/1235] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:11.078883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7f73499d-9a4d-4e72-9b54-383f0fcb09eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:11.079492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7f73499d-9a4d-4e72-9b54-383f0fcb09eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:11.085325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f73499d-9a4d-4e72-9b54-383f0fcb09eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:11.085772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f73499d-9a4d-4e72-9b54-383f0fcb09eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:11.086531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f73499d-9a4d-4e72-9b54-383f0fcb09eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:11.086965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f73499d-9a4d-4e72-9b54-383f0fcb09eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:11.145443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7f73499d-9a4d-4e72-9b54-383f0fcb09eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:11.152636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7f73499d-9a4d-4e72-9b54-383f0fcb09eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.077750 May 12 07:08:11.153196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 543/1236] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:11 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:11.320877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e531b4d6-7238-402b-afa7-10a2170cd47a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:11.321796 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e531b4d6-7238-402b-afa7-10a2170cd47a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:11.328151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e531b4d6-7238-402b-afa7-10a2170cd47a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:11.328602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e531b4d6-7238-402b-afa7-10a2170cd47a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:11.329395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e531b4d6-7238-402b-afa7-10a2170cd47a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:11.329833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e531b4d6-7238-402b-afa7-10a2170cd47a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:11.357858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e531b4d6-7238-402b-afa7-10a2170cd47a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040893 May 12 07:08:11.358405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 694/1237] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:11 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:11.539359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9bbcc72a-ff51-4611-b6a6-154118230d4a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:11.540314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9bbcc72a-ff51-4611-b6a6-154118230d4a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:11.547159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9bbcc72a-ff51-4611-b6a6-154118230d4a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:11.547614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9bbcc72a-ff51-4611-b6a6-154118230d4a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:11.548432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9bbcc72a-ff51-4611-b6a6-154118230d4a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:11.549140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9bbcc72a-ff51-4611-b6a6-154118230d4a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:11.577525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9bbcc72a-ff51-4611-b6a6-154118230d4a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042082 May 12 07:08:11.578012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 544/1238] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:12.169260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3225f269-2cd7-4e12-8382-1c64a8a45183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:12.169879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3225f269-2cd7-4e12-8382-1c64a8a45183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:12.176071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3225f269-2cd7-4e12-8382-1c64a8a45183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:12.176524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3225f269-2cd7-4e12-8382-1c64a8a45183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:12.177291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3225f269-2cd7-4e12-8382-1c64a8a45183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:12.177727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3225f269-2cd7-4e12-8382-1c64a8a45183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:12.237632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3225f269-2cd7-4e12-8382-1c64a8a45183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:12.245111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3225f269-2cd7-4e12-8382-1c64a8a45183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079736 May 12 07:08:12.245609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 695/1239] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:12 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:12.369550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4151834b-a11a-498f-a1b5-7d478cadda55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:12.370471 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4151834b-a11a-498f-a1b5-7d478cadda55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:12.376375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4151834b-a11a-498f-a1b5-7d478cadda55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:12.376826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4151834b-a11a-498f-a1b5-7d478cadda55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:12.377591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4151834b-a11a-498f-a1b5-7d478cadda55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:12.378026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4151834b-a11a-498f-a1b5-7d478cadda55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:12.407183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4151834b-a11a-498f-a1b5-7d478cadda55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041890 May 12 07:08:12.407779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 545/1240] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:12 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:12.589439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6d1314ac-58d7-4358-af67-81ce371dad1d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:12.590292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6d1314ac-58d7-4358-af67-81ce371dad1d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:12.596624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6d1314ac-58d7-4358-af67-81ce371dad1d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:12.597074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6d1314ac-58d7-4358-af67-81ce371dad1d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:12.597840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6d1314ac-58d7-4358-af67-81ce371dad1d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:12.598280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6d1314ac-58d7-4358-af67-81ce371dad1d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:12.626682 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6d1314ac-58d7-4358-af67-81ce371dad1d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041825 May 12 07:08:12.627212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 696/1241] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:12 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:13.262128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9ac6ed81-79ca-491e-8b34-a5a2c418c061 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:13.262784 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9ac6ed81-79ca-491e-8b34-a5a2c418c061 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:13.269057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ac6ed81-79ca-491e-8b34-a5a2c418c061 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:13.269543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ac6ed81-79ca-491e-8b34-a5a2c418c061 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:13.270308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ac6ed81-79ca-491e-8b34-a5a2c418c061 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:13.270739 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ac6ed81-79ca-491e-8b34-a5a2c418c061 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:13.334343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9ac6ed81-79ca-491e-8b34-a5a2c418c061 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:13.341629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9ac6ed81-79ca-491e-8b34-a5a2c418c061 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083959 May 12 07:08:13.342196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 546/1242] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:13 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:13.418406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9d66d29c-0ada-4759-8f6e-6cc44dbc5c3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:13.419321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9d66d29c-0ada-4759-8f6e-6cc44dbc5c3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:13.425436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d66d29c-0ada-4759-8f6e-6cc44dbc5c3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:13.425880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d66d29c-0ada-4759-8f6e-6cc44dbc5c3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:13.426682 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d66d29c-0ada-4759-8f6e-6cc44dbc5c3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:13.427113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9d66d29c-0ada-4759-8f6e-6cc44dbc5c3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:13.455668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9d66d29c-0ada-4759-8f6e-6cc44dbc5c3f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041139 May 12 07:08:13.456224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 697/1243] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:13 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:13.638519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cd474bec-298b-48b0-a43f-baeb8b401cd7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:13.639366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cd474bec-298b-48b0-a43f-baeb8b401cd7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:13.645317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd474bec-298b-48b0-a43f-baeb8b401cd7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:13.645771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd474bec-298b-48b0-a43f-baeb8b401cd7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:13.646545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd474bec-298b-48b0-a43f-baeb8b401cd7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:13.646990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd474bec-298b-48b0-a43f-baeb8b401cd7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:13.675309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cd474bec-298b-48b0-a43f-baeb8b401cd7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040979 May 12 07:08:13.675883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 547/1244] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:14.357529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-26f39175-405f-4289-89f8-cf40abb36ed3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:14.358066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-26f39175-405f-4289-89f8-cf40abb36ed3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:14.365784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26f39175-405f-4289-89f8-cf40abb36ed3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:14.366237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26f39175-405f-4289-89f8-cf40abb36ed3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:14.367009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26f39175-405f-4289-89f8-cf40abb36ed3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:14.367449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26f39175-405f-4289-89f8-cf40abb36ed3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:14.427586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-26f39175-405f-4289-89f8-cf40abb36ed3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:14.435102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-26f39175-405f-4289-89f8-cf40abb36ed3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081572 May 12 07:08:14.435740 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 698/1245] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:14 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:14.467510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-48d62380-29c9-48e7-b3a3-a5db18db2384 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:14.468457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-48d62380-29c9-48e7-b3a3-a5db18db2384 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:14.474592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48d62380-29c9-48e7-b3a3-a5db18db2384 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:14.475066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48d62380-29c9-48e7-b3a3-a5db18db2384 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:14.475872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48d62380-29c9-48e7-b3a3-a5db18db2384 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:14.476305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48d62380-29c9-48e7-b3a3-a5db18db2384 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:14.506289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-48d62380-29c9-48e7-b3a3-a5db18db2384 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 May 12 07:08:14.506838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 548/1246] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:14 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:14.687323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-112da73d-9451-40a5-b002-5d41aaf20ab6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:14.688241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-112da73d-9451-40a5-b002-5d41aaf20ab6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:14.694207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-112da73d-9451-40a5-b002-5d41aaf20ab6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:14.694705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-112da73d-9451-40a5-b002-5d41aaf20ab6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:14.695474 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-112da73d-9451-40a5-b002-5d41aaf20ab6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:14.695946 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-112da73d-9451-40a5-b002-5d41aaf20ab6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:14.724026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-112da73d-9451-40a5-b002-5d41aaf20ab6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040907 May 12 07:08:14.724578 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 699/1247] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:15.452028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-21c6f5e5-835e-49af-a34a-ede743c12268 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:15.452650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-21c6f5e5-835e-49af-a34a-ede743c12268 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:15.458586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21c6f5e5-835e-49af-a34a-ede743c12268 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:15.459040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21c6f5e5-835e-49af-a34a-ede743c12268 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:15.459854 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21c6f5e5-835e-49af-a34a-ede743c12268 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:15.460328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21c6f5e5-835e-49af-a34a-ede743c12268 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:15.518209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-49fb0568-f6b0-46ef-ad74-50d98df30c55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:15.519206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-49fb0568-f6b0-46ef-ad74-50d98df30c55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:15.519577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-21c6f5e5-835e-49af-a34a-ede743c12268 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:15.526386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49fb0568-f6b0-46ef-ad74-50d98df30c55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:15.526837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49fb0568-f6b0-46ef-ad74-50d98df30c55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:15.527613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-21c6f5e5-835e-49af-a34a-ede743c12268 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079480 May 12 07:08:15.527745 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49fb0568-f6b0-46ef-ad74-50d98df30c55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:15.528086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49fb0568-f6b0-46ef-ad74-50d98df30c55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:15.528501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 549/1248] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:15 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:15.557185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-49fb0568-f6b0-46ef-ad74-50d98df30c55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043153 May 12 07:08:15.557738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 700/1249] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:15 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:15.735589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-35d492a1-6d3e-4f67-8d12-5edb1977e6d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:15.736519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-35d492a1-6d3e-4f67-8d12-5edb1977e6d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:15.742352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35d492a1-6d3e-4f67-8d12-5edb1977e6d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:15.742800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35d492a1-6d3e-4f67-8d12-5edb1977e6d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:15.743611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35d492a1-6d3e-4f67-8d12-5edb1977e6d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:15.744073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35d492a1-6d3e-4f67-8d12-5edb1977e6d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:15.771478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-35d492a1-6d3e-4f67-8d12-5edb1977e6d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039900 May 12 07:08:15.772043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 550/1250] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:16.544850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-82bb204c-cdaf-4d21-bf0a-f04f3df2b2a2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:16.545464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-82bb204c-cdaf-4d21-bf0a-f04f3df2b2a2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:16.551997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-82bb204c-cdaf-4d21-bf0a-f04f3df2b2a2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:16.552444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-82bb204c-cdaf-4d21-bf0a-f04f3df2b2a2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:16.553205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-82bb204c-cdaf-4d21-bf0a-f04f3df2b2a2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:16.553639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-82bb204c-cdaf-4d21-bf0a-f04f3df2b2a2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:16.568415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-56d1eb84-4a8e-414c-8582-8547df905555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:16.569342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-56d1eb84-4a8e-414c-8582-8547df905555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:16.575547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56d1eb84-4a8e-414c-8582-8547df905555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:16.576038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56d1eb84-4a8e-414c-8582-8547df905555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:16.576811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56d1eb84-4a8e-414c-8582-8547df905555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:16.577246 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56d1eb84-4a8e-414c-8582-8547df905555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:16.607524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-56d1eb84-4a8e-414c-8582-8547df905555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042934 May 12 07:08:16.608114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 551/1251] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:16 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:16.614444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-82bb204c-cdaf-4d21-bf0a-f04f3df2b2a2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:16.622466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-82bb204c-cdaf-4d21-bf0a-f04f3df2b2a2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082022 May 12 07:08:16.623021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 701/1252] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:16 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:16.782988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3a03e4f6-9949-4e59-b7af-dfca3f256229 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:16.789985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3a03e4f6-9949-4e59-b7af-dfca3f256229 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:16.789985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a03e4f6-9949-4e59-b7af-dfca3f256229 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:16.790310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a03e4f6-9949-4e59-b7af-dfca3f256229 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:16.791131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a03e4f6-9949-4e59-b7af-dfca3f256229 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:16.791564 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a03e4f6-9949-4e59-b7af-dfca3f256229 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:16.819885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3a03e4f6-9949-4e59-b7af-dfca3f256229 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040644 May 12 07:08:16.820362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 552/1253] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:17.619188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b39d98f3-6953-4d4b-b673-c4e03555c427 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:17.620134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b39d98f3-6953-4d4b-b673-c4e03555c427 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:17.626424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b39d98f3-6953-4d4b-b673-c4e03555c427 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:17.626877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b39d98f3-6953-4d4b-b673-c4e03555c427 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:17.627645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b39d98f3-6953-4d4b-b673-c4e03555c427 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:17.628101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b39d98f3-6953-4d4b-b673-c4e03555c427 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:17.638709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-54a3a1b1-c0a4-4e7b-8265-27cee3794034 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:17.639321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-54a3a1b1-c0a4-4e7b-8265-27cee3794034 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:17.645473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54a3a1b1-c0a4-4e7b-8265-27cee3794034 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:17.645916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54a3a1b1-c0a4-4e7b-8265-27cee3794034 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:17.646678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54a3a1b1-c0a4-4e7b-8265-27cee3794034 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:17.647116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54a3a1b1-c0a4-4e7b-8265-27cee3794034 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:17.657504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b39d98f3-6953-4d4b-b673-c4e03555c427 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042315 May 12 07:08:17.658064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 702/1254] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:17 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:17.709879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-54a3a1b1-c0a4-4e7b-8265-27cee3794034 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:17.717081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-54a3a1b1-c0a4-4e7b-8265-27cee3794034 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082701 May 12 07:08:17.717642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 553/1255] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:17 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:17.831888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-05b08478-1d0e-4a86-9ca9-fd5f87f2efd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:17.832834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-05b08478-1d0e-4a86-9ca9-fd5f87f2efd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:17.838660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-05b08478-1d0e-4a86-9ca9-fd5f87f2efd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:17.839106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-05b08478-1d0e-4a86-9ca9-fd5f87f2efd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:17.839901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-05b08478-1d0e-4a86-9ca9-fd5f87f2efd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:17.840335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-05b08478-1d0e-4a86-9ca9-fd5f87f2efd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:17.867913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-05b08478-1d0e-4a86-9ca9-fd5f87f2efd9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039976 May 12 07:08:17.868454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 703/1256] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:17 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:18.669818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dada6a49-9185-4c3d-9d74-dee40fea7186 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:18.670748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dada6a49-9185-4c3d-9d74-dee40fea7186 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:18.677386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dada6a49-9185-4c3d-9d74-dee40fea7186 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:18.677844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dada6a49-9185-4c3d-9d74-dee40fea7186 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:18.678623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dada6a49-9185-4c3d-9d74-dee40fea7186 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:18.679068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dada6a49-9185-4c3d-9d74-dee40fea7186 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:18.706792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dada6a49-9185-4c3d-9d74-dee40fea7186 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041641 May 12 07:08:18.707336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 554/1257] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:18 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:18.734034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3ed77647-4284-4b9e-be9a-d14822849f4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:18.734646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3ed77647-4284-4b9e-be9a-d14822849f4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:18.741003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ed77647-4284-4b9e-be9a-d14822849f4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:18.741449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ed77647-4284-4b9e-be9a-d14822849f4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:18.742224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ed77647-4284-4b9e-be9a-d14822849f4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:18.742655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ed77647-4284-4b9e-be9a-d14822849f4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:18.804157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3ed77647-4284-4b9e-be9a-d14822849f4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:18.811428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3ed77647-4284-4b9e-be9a-d14822849f4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081192 May 12 07:08:18.812019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 704/1258] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:18 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:18.879967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1459a27e-7555-46b2-bdea-cf5b5dd453bb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:18.880893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1459a27e-7555-46b2-bdea-cf5b5dd453bb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:18.887456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1459a27e-7555-46b2-bdea-cf5b5dd453bb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:18.887933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1459a27e-7555-46b2-bdea-cf5b5dd453bb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:18.888708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1459a27e-7555-46b2-bdea-cf5b5dd453bb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:18.889155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1459a27e-7555-46b2-bdea-cf5b5dd453bb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:18.918281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1459a27e-7555-46b2-bdea-cf5b5dd453bb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042398 May 12 07:08:18.919039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 555/1259] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:19.717943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2ea2262a-e1b6-48c6-8a3b-41c8da9bcff1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:19.718862 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2ea2262a-e1b6-48c6-8a3b-41c8da9bcff1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:19.724817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ea2262a-e1b6-48c6-8a3b-41c8da9bcff1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:19.725295 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ea2262a-e1b6-48c6-8a3b-41c8da9bcff1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:19.726066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ea2262a-e1b6-48c6-8a3b-41c8da9bcff1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:19.726507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2ea2262a-e1b6-48c6-8a3b-41c8da9bcff1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:19.755779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2ea2262a-e1b6-48c6-8a3b-41c8da9bcff1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041858 May 12 07:08:19.756367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 705/1260] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:19 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:19.827828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c1e967cc-3e1e-4e7d-a779-3a0b1e655775 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:19.828455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c1e967cc-3e1e-4e7d-a779-3a0b1e655775 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:19.834693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c1e967cc-3e1e-4e7d-a779-3a0b1e655775 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:19.835145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c1e967cc-3e1e-4e7d-a779-3a0b1e655775 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:19.835947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c1e967cc-3e1e-4e7d-a779-3a0b1e655775 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:19.836385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c1e967cc-3e1e-4e7d-a779-3a0b1e655775 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:19.895924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c1e967cc-3e1e-4e7d-a779-3a0b1e655775 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:19.903761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c1e967cc-3e1e-4e7d-a779-3a0b1e655775 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079722 May 12 07:08:19.904322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 556/1261] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:19 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:19.929961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fe701ead-6d2e-4fff-8007-e8ae5ec3ee9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:19.930893 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fe701ead-6d2e-4fff-8007-e8ae5ec3ee9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:19.937382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe701ead-6d2e-4fff-8007-e8ae5ec3ee9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:19.937839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe701ead-6d2e-4fff-8007-e8ae5ec3ee9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:19.938613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe701ead-6d2e-4fff-8007-e8ae5ec3ee9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:19.939076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fe701ead-6d2e-4fff-8007-e8ae5ec3ee9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:19.969204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fe701ead-6d2e-4fff-8007-e8ae5ec3ee9f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 May 12 07:08:19.969716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 706/1262] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:20.766448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0af98fd0-7dd5-4bf6-9bb7-11a0db81d483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:20.767368 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0af98fd0-7dd5-4bf6-9bb7-11a0db81d483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:20.773224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0af98fd0-7dd5-4bf6-9bb7-11a0db81d483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:20.773671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0af98fd0-7dd5-4bf6-9bb7-11a0db81d483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:20.774434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0af98fd0-7dd5-4bf6-9bb7-11a0db81d483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:20.775387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0af98fd0-7dd5-4bf6-9bb7-11a0db81d483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:20.803407 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0af98fd0-7dd5-4bf6-9bb7-11a0db81d483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040916 May 12 07:08:20.803975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 557/1263] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:20 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:20.920736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fc08be58-96a0-45a5-ac26-b93932ae9f34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:20.921356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fc08be58-96a0-45a5-ac26-b93932ae9f34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:20.927898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc08be58-96a0-45a5-ac26-b93932ae9f34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:20.928348 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc08be58-96a0-45a5-ac26-b93932ae9f34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:20.929120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc08be58-96a0-45a5-ac26-b93932ae9f34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:20.929559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc08be58-96a0-45a5-ac26-b93932ae9f34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:20.981576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9c7b720a-7def-4646-8ced-307bd2dbd701 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:20.982494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9c7b720a-7def-4646-8ced-307bd2dbd701 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:20.990291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fc08be58-96a0-45a5-ac26-b93932ae9f34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:20.993097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c7b720a-7def-4646-8ced-307bd2dbd701 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:20.993406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c7b720a-7def-4646-8ced-307bd2dbd701 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:20.994169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c7b720a-7def-4646-8ced-307bd2dbd701 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:20.994607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c7b720a-7def-4646-8ced-307bd2dbd701 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:20.998000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fc08be58-96a0-45a5-ac26-b93932ae9f34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081118 May 12 07:08:20.998739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 707/1264] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:20 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:21.024196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9c7b720a-7def-4646-8ced-307bd2dbd701 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047099 May 12 07:08:21.025201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 558/1265] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:20 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:21.814468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-788ab14f-4a45-4cf2-b014-245f9269e5b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:21.815400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-788ab14f-4a45-4cf2-b014-245f9269e5b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:21.821373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-788ab14f-4a45-4cf2-b014-245f9269e5b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:21.821827 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-788ab14f-4a45-4cf2-b014-245f9269e5b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:21.822603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-788ab14f-4a45-4cf2-b014-245f9269e5b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:21.823044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-788ab14f-4a45-4cf2-b014-245f9269e5b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:21.850562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-788ab14f-4a45-4cf2-b014-245f9269e5b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040136 May 12 07:08:21.851106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 708/1266] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:21 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:22.015208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3f37c75b-e1b5-4e59-8c59-da403efc722d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:22.015883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3f37c75b-e1b5-4e59-8c59-da403efc722d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:22.021720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f37c75b-e1b5-4e59-8c59-da403efc722d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:22.022165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f37c75b-e1b5-4e59-8c59-da403efc722d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:22.022932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f37c75b-e1b5-4e59-8c59-da403efc722d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:22.023364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f37c75b-e1b5-4e59-8c59-da403efc722d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:22.036335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-aade8d5f-4db5-4a07-b83c-335e61f34634 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:22.037356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-aade8d5f-4db5-4a07-b83c-335e61f34634 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:22.044330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aade8d5f-4db5-4a07-b83c-335e61f34634 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:22.044724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aade8d5f-4db5-4a07-b83c-335e61f34634 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:22.045500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aade8d5f-4db5-4a07-b83c-335e61f34634 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:22.045971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aade8d5f-4db5-4a07-b83c-335e61f34634 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:22.075711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-aade8d5f-4db5-4a07-b83c-335e61f34634 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043269 May 12 07:08:22.076274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 709/1267] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:22.085988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3f37c75b-e1b5-4e59-8c59-da403efc722d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:22.093499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3f37c75b-e1b5-4e59-8c59-da403efc722d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082278 May 12 07:08:22.094055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 559/1268] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:22 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:22.862527 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1f30b7d2-e8b5-4631-8af0-7d20c9aff076 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:22.863447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1f30b7d2-e8b5-4631-8af0-7d20c9aff076 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:22.869382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f30b7d2-e8b5-4631-8af0-7d20c9aff076 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:22.869831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f30b7d2-e8b5-4631-8af0-7d20c9aff076 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:22.870595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f30b7d2-e8b5-4631-8af0-7d20c9aff076 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:22.871031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f30b7d2-e8b5-4631-8af0-7d20c9aff076 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:22.899226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1f30b7d2-e8b5-4631-8af0-7d20c9aff076 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040764 May 12 07:08:22.900417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 710/1269] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:22 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:23.087591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5fa175d8-5655-40d0-bf53-16f1e4d9e300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:23.088506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5fa175d8-5655-40d0-bf53-16f1e4d9e300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:23.094774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fa175d8-5655-40d0-bf53-16f1e4d9e300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:23.095291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fa175d8-5655-40d0-bf53-16f1e4d9e300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:23.096037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fa175d8-5655-40d0-bf53-16f1e4d9e300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:23.096483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fa175d8-5655-40d0-bf53-16f1e4d9e300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:23.110043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6278b888-544d-49ce-b43a-132ee2af64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:23.110654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6278b888-544d-49ce-b43a-132ee2af64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:23.116804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6278b888-544d-49ce-b43a-132ee2af64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:23.117252 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6278b888-544d-49ce-b43a-132ee2af64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:23.118021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6278b888-544d-49ce-b43a-132ee2af64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:23.118955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6278b888-544d-49ce-b43a-132ee2af64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:23.125462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5fa175d8-5655-40d0-bf53-16f1e4d9e300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041882 May 12 07:08:23.126025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 560/1270] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:23.178119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6278b888-544d-49ce-b43a-132ee2af64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:23.185860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6278b888-544d-49ce-b43a-132ee2af64c6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079720 May 12 07:08:23.186422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 711/1271] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:23 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:23.910456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a21fa146-4166-4ac2-b18c-7f04e72f61b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:23.911382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a21fa146-4166-4ac2-b18c-7f04e72f61b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:23.917912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a21fa146-4166-4ac2-b18c-7f04e72f61b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:23.918367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a21fa146-4166-4ac2-b18c-7f04e72f61b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:23.919137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a21fa146-4166-4ac2-b18c-7f04e72f61b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:23.919580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a21fa146-4166-4ac2-b18c-7f04e72f61b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:23.947588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a21fa146-4166-4ac2-b18c-7f04e72f61b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 May 12 07:08:23.948170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 561/1272] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:23 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:24.137250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-326f3f3f-e5b4-4571-afd5-719309e7c52a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:24.138160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-326f3f3f-e5b4-4571-afd5-719309e7c52a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:24.144483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-326f3f3f-e5b4-4571-afd5-719309e7c52a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:24.144937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-326f3f3f-e5b4-4571-afd5-719309e7c52a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:24.145703 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-326f3f3f-e5b4-4571-afd5-719309e7c52a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:24.146142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-326f3f3f-e5b4-4571-afd5-719309e7c52a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:24.175880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-326f3f3f-e5b4-4571-afd5-719309e7c52a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042983 May 12 07:08:24.176361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 712/1273] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:24.202669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-feb90fc3-3910-4cf0-95a2-1fd604f1eb5f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:24.203286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-feb90fc3-3910-4cf0-95a2-1fd604f1eb5f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:24.209528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feb90fc3-3910-4cf0-95a2-1fd604f1eb5f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:24.209971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feb90fc3-3910-4cf0-95a2-1fd604f1eb5f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:24.210735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feb90fc3-3910-4cf0-95a2-1fd604f1eb5f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:24.211172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feb90fc3-3910-4cf0-95a2-1fd604f1eb5f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:24.269981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-feb90fc3-3910-4cf0-95a2-1fd604f1eb5f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:24.277778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-feb90fc3-3910-4cf0-95a2-1fd604f1eb5f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078914 May 12 07:08:24.278329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 562/1274] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:24 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:24.616304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5f8d7556-f2d0-4bff-9bc1-9dd10c76f5ba tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:24.616880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5f8d7556-f2d0-4bff-9bc1-9dd10c76f5ba tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:24.623467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f8d7556-f2d0-4bff-9bc1-9dd10c76f5ba tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:24.624030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f8d7556-f2d0-4bff-9bc1-9dd10c76f5ba tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:24.624867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f8d7556-f2d0-4bff-9bc1-9dd10c76f5ba tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:24.625385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f8d7556-f2d0-4bff-9bc1-9dd10c76f5ba tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:24.639318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-5f8d7556-f2d0-4bff-9bc1-9dd10c76f5ba tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5f8d7556-f2d0-4bff-9bc1-9dd10c76f5ba tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 HTTP/1.1 May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:08:24.640919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 07:08:24.642438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '0baa16c3-ab5a-4e93-a65d-1e038d4af279'} May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:08:24.643427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 07:08:24.644804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:08:24.646142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5f8d7556-f2d0-4bff-9bc1-9dd10c76f5ba tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:08:24.646142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5f8d7556-f2d0-4bff-9bc1-9dd10c76f5ba tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 404 len: 111 microversion: 2.1 time: 0.029811 May 12 07:08:24.646142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 713/1275] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:08:24 2022] DELETE /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:08:24.651917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-70d8bfb5-968a-4717-b974-10d46d837028 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:24.656792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-70d8bfb5-968a-4717-b974-10d46d837028 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] [instance: 0baa16c3-ab5a-4e93-a65d-1e038d4af279] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:24.658844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70d8bfb5-968a-4717-b974-10d46d837028 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:24.659302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70d8bfb5-968a-4717-b974-10d46d837028 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:24.660129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70d8bfb5-968a-4717-b974-10d46d837028 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:24.660572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70d8bfb5-968a-4717-b974-10d46d837028 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:24.674047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-70d8bfb5-968a-4717-b974-10d46d837028 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] HTTP exception thrown: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-70d8bfb5-968a-4717-b974-10d46d837028 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Request method failure captured: May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 HTTP/1.1 May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK6Fhl8nWYQgpLsrsNhQJ7av6ke7p7o5wDU7VvJvp3gACWUrPGDDbwkjuKWqldOthUyM9WTF1lC-aiHbGGejWInjqdRJLQuw2x2Lr_317XHYA9Hd0Yn5V7h8vnvaClZtmZj4yB8sMxkgTuPBziu7oBU3j-K5KyYDnDBUk-DuR2HVQyc May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:08:24.675697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ef9efe106ae4485a4d137377f1890e3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ef9efe106ae4485a4d137377f1890e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ef9efe106ae4485a4d137377f1890e3"}]}] May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: 6ef9efe106ae4485a4d137377f1890e3 May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984039998 May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: d77bf80654c24c8c8336ce395f789ccb May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-AttachVolumeNegativeTest-1984039998-project May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 07:08:24.677331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': '0baa16c3-ab5a-4e93-a65d-1e038d4af279'} May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:08:24.678159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. May 12 07:08:24.679434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:08:24.682297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-70d8bfb5-968a-4717-b974-10d46d837028 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] Returning 404 to user: Instance 0baa16c3-ab5a-4e93-a65d-1e038d4af279 could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:08:24.682297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-70d8bfb5-968a-4717-b974-10d46d837028 tempest-AttachVolumeNegativeTest-1984039998 tempest-AttachVolumeNegativeTest-1984039998-project] 10.222.0.25 "GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279" status: 404 len: 111 microversion: 2.1 time: 0.029201 May 12 07:08:24.682297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 563/1276] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:24 2022] GET /compute/v2.1/servers/0baa16c3-ab5a-4e93-a65d-1e038d4af279 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:08:24.958469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8d3196b2-0564-4113-9d8d-5aaed8d5093f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:24.959409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8d3196b2-0564-4113-9d8d-5aaed8d5093f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:24.965768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d3196b2-0564-4113-9d8d-5aaed8d5093f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:24.966312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d3196b2-0564-4113-9d8d-5aaed8d5093f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:24.967159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d3196b2-0564-4113-9d8d-5aaed8d5093f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:24.967601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d3196b2-0564-4113-9d8d-5aaed8d5093f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:24.998388 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8d3196b2-0564-4113-9d8d-5aaed8d5093f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043843 May 12 07:08:24.998954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 714/1277] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:24 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:25.187770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b67353dc-c33b-4970-8247-03522034a6dc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:25.188865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b67353dc-c33b-4970-8247-03522034a6dc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:25.194642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b67353dc-c33b-4970-8247-03522034a6dc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:25.195093 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b67353dc-c33b-4970-8247-03522034a6dc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:25.195896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b67353dc-c33b-4970-8247-03522034a6dc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:25.196334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b67353dc-c33b-4970-8247-03522034a6dc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:25.226526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b67353dc-c33b-4970-8247-03522034a6dc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043139 May 12 07:08:25.227139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 564/1278] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:25.294886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-434bf216-4541-4a63-9945-7ab24da9d156 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:25.295502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-434bf216-4541-4a63-9945-7ab24da9d156 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:25.301972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434bf216-4541-4a63-9945-7ab24da9d156 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:25.302419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434bf216-4541-4a63-9945-7ab24da9d156 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:25.303183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434bf216-4541-4a63-9945-7ab24da9d156 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:25.303616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434bf216-4541-4a63-9945-7ab24da9d156 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:25.400631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-434bf216-4541-4a63-9945-7ab24da9d156 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:25.407890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-434bf216-4541-4a63-9945-7ab24da9d156 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.117541 May 12 07:08:25.408464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 715/1279] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:25 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:26.010708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1e05a30d-c196-4cfd-bff7-5a40391ed10a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:26.011854 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1e05a30d-c196-4cfd-bff7-5a40391ed10a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:26.018926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e05a30d-c196-4cfd-bff7-5a40391ed10a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:26.019597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e05a30d-c196-4cfd-bff7-5a40391ed10a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:26.020788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e05a30d-c196-4cfd-bff7-5a40391ed10a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:26.021322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e05a30d-c196-4cfd-bff7-5a40391ed10a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:26.052427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1e05a30d-c196-4cfd-bff7-5a40391ed10a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046295 May 12 07:08:26.053172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 565/1280] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:26 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:26.238888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fac087e1-b6d3-49ef-a5ee-8f6bf7206beb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:26.239822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fac087e1-b6d3-49ef-a5ee-8f6bf7206beb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:26.246150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fac087e1-b6d3-49ef-a5ee-8f6bf7206beb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:26.246597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fac087e1-b6d3-49ef-a5ee-8f6bf7206beb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:26.247360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fac087e1-b6d3-49ef-a5ee-8f6bf7206beb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:26.247820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fac087e1-b6d3-49ef-a5ee-8f6bf7206beb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:26.277102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fac087e1-b6d3-49ef-a5ee-8f6bf7206beb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042267 May 12 07:08:26.277673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 716/1281] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:26.425264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-12307684-b735-4454-82ae-596348d8274f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:26.425880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-12307684-b735-4454-82ae-596348d8274f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:26.432769 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12307684-b735-4454-82ae-596348d8274f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:26.433221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12307684-b735-4454-82ae-596348d8274f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:26.433998 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12307684-b735-4454-82ae-596348d8274f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:26.434442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12307684-b735-4454-82ae-596348d8274f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:26.500216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-12307684-b735-4454-82ae-596348d8274f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:26.507423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-12307684-b735-4454-82ae-596348d8274f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.086295 May 12 07:08:26.508351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 566/1282] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:26 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:27.064819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6f85dad0-eac4-4bfd-9bd9-2db19a2bdff9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:27.066134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6f85dad0-eac4-4bfd-9bd9-2db19a2bdff9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:27.073024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f85dad0-eac4-4bfd-9bd9-2db19a2bdff9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:27.073483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f85dad0-eac4-4bfd-9bd9-2db19a2bdff9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:27.074273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f85dad0-eac4-4bfd-9bd9-2db19a2bdff9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:27.074769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f85dad0-eac4-4bfd-9bd9-2db19a2bdff9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:27.104953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6f85dad0-eac4-4bfd-9bd9-2db19a2bdff9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044238 May 12 07:08:27.105514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 717/1283] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:27 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:27.288581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c50d60a3-b493-4b1a-b540-d33f4adbcf18 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:27.290122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c50d60a3-b493-4b1a-b540-d33f4adbcf18 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:27.295977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c50d60a3-b493-4b1a-b540-d33f4adbcf18 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:27.302591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c50d60a3-b493-4b1a-b540-d33f4adbcf18 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:27.302591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c50d60a3-b493-4b1a-b540-d33f4adbcf18 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:27.302591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c50d60a3-b493-4b1a-b540-d33f4adbcf18 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:27.327028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c50d60a3-b493-4b1a-b540-d33f4adbcf18 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042389 May 12 07:08:27.327505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 567/1284] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:27.523587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-177e84a2-660f-4748-9e78-afd2cd14e512 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:27.524161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-177e84a2-660f-4748-9e78-afd2cd14e512 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:27.530035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-177e84a2-660f-4748-9e78-afd2cd14e512 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:27.530484 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-177e84a2-660f-4748-9e78-afd2cd14e512 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:27.531254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-177e84a2-660f-4748-9e78-afd2cd14e512 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:27.531703 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-177e84a2-660f-4748-9e78-afd2cd14e512 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:27.594111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-177e84a2-660f-4748-9e78-afd2cd14e512 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:27.610021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-177e84a2-660f-4748-9e78-afd2cd14e512 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.090303 May 12 07:08:27.610961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 718/1285] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:27 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:28.118004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e677e567-9b48-4374-8a99-bd1390bf4d6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:28.118954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e677e567-9b48-4374-8a99-bd1390bf4d6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:28.127467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e677e567-9b48-4374-8a99-bd1390bf4d6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:28.127957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e677e567-9b48-4374-8a99-bd1390bf4d6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:28.128743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e677e567-9b48-4374-8a99-bd1390bf4d6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:28.129192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e677e567-9b48-4374-8a99-bd1390bf4d6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:28.160312 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e677e567-9b48-4374-8a99-bd1390bf4d6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047633 May 12 07:08:28.160936 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 568/1286] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:28 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:28.338405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ae63f592-e306-4fa3-a5b4-87f0fb726558 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:28.340031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ae63f592-e306-4fa3-a5b4-87f0fb726558 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:28.346733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae63f592-e306-4fa3-a5b4-87f0fb726558 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:28.347403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae63f592-e306-4fa3-a5b4-87f0fb726558 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:28.348226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae63f592-e306-4fa3-a5b4-87f0fb726558 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:28.348657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae63f592-e306-4fa3-a5b4-87f0fb726558 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:28.379971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ae63f592-e306-4fa3-a5b4-87f0fb726558 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045958 May 12 07:08:28.381125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 719/1287] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:28.627085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fe9959fd-835c-4e45-b038-27988c423070 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:28.627712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fe9959fd-835c-4e45-b038-27988c423070 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:28.633583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe9959fd-835c-4e45-b038-27988c423070 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:28.634514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe9959fd-835c-4e45-b038-27988c423070 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:28.635297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe9959fd-835c-4e45-b038-27988c423070 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:28.635745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe9959fd-835c-4e45-b038-27988c423070 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:28.695635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fe9959fd-835c-4e45-b038-27988c423070 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:28.703452 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fe9959fd-835c-4e45-b038-27988c423070 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080235 May 12 07:08:28.704593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 569/1288] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:28 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:29.173338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9a08addb-ee95-46b7-b064-fbf4b277fe52 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:29.174618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9a08addb-ee95-46b7-b064-fbf4b277fe52 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:29.180628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9a08addb-ee95-46b7-b064-fbf4b277fe52 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:29.181083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9a08addb-ee95-46b7-b064-fbf4b277fe52 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:29.181895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9a08addb-ee95-46b7-b064-fbf4b277fe52 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:29.182337 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9a08addb-ee95-46b7-b064-fbf4b277fe52 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:29.211205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9a08addb-ee95-46b7-b064-fbf4b277fe52 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043195 May 12 07:08:29.211786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 720/1289] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:29 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:29.391926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-13b4d4ae-bd55-415d-bc75-d40bff9d53a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:29.392865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-13b4d4ae-bd55-415d-bc75-d40bff9d53a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:29.400034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13b4d4ae-bd55-415d-bc75-d40bff9d53a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:29.400520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13b4d4ae-bd55-415d-bc75-d40bff9d53a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:29.401308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13b4d4ae-bd55-415d-bc75-d40bff9d53a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:29.401744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13b4d4ae-bd55-415d-bc75-d40bff9d53a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:29.431548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-13b4d4ae-bd55-415d-bc75-d40bff9d53a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043516 May 12 07:08:29.432327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 570/1290] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:29.720815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8c44bfe6-63ea-4bc3-bc90-03e5da474c73 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:29.721366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8c44bfe6-63ea-4bc3-bc90-03e5da474c73 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:29.727723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c44bfe6-63ea-4bc3-bc90-03e5da474c73 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:29.730458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c44bfe6-63ea-4bc3-bc90-03e5da474c73 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:29.730458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c44bfe6-63ea-4bc3-bc90-03e5da474c73 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:29.730458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c44bfe6-63ea-4bc3-bc90-03e5da474c73 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:29.790301 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8c44bfe6-63ea-4bc3-bc90-03e5da474c73 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:29.798030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8c44bfe6-63ea-4bc3-bc90-03e5da474c73 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081122 May 12 07:08:29.798610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 721/1291] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:29 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:08:30.222497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-77985f2a-7cf9-4a9a-bcc5-c8374ec4afbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:30.223486 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-77985f2a-7cf9-4a9a-bcc5-c8374ec4afbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:30.229719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-77985f2a-7cf9-4a9a-bcc5-c8374ec4afbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:30.230178 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-77985f2a-7cf9-4a9a-bcc5-c8374ec4afbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:30.230928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-77985f2a-7cf9-4a9a-bcc5-c8374ec4afbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:30.232294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-77985f2a-7cf9-4a9a-bcc5-c8374ec4afbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:30.261572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-77985f2a-7cf9-4a9a-bcc5-c8374ec4afbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043030 May 12 07:08:30.262122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 571/1292] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:30 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:30.351043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-68f17b80-62c4-4053-b37f-9a5bcd6c9daa tempest-VolumesSnapshotsTestJSON-1098122012 tempest-VolumesSnapshotsTestJSON-1098122012-project] Action: 'create', calling method: .version_select at 0x7f89da5e1ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-296141486"}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:08:30.442281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c231dab7-e315-4261-b47f-20dc6050e024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:30.443200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c231dab7-e315-4261-b47f-20dc6050e024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:30.450088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c231dab7-e315-4261-b47f-20dc6050e024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:30.450537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c231dab7-e315-4261-b47f-20dc6050e024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:30.451307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c231dab7-e315-4261-b47f-20dc6050e024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:30.451782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c231dab7-e315-4261-b47f-20dc6050e024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:30.480175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c231dab7-e315-4261-b47f-20dc6050e024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 May 12 07:08:30.480645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 572/1293] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:30.815527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2daabc16-804c-4e3e-b4bb-73e66a87eecc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:30.816182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2daabc16-804c-4e3e-b4bb-73e66a87eecc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:30.822246 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2daabc16-804c-4e3e-b4bb-73e66a87eecc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:30.822697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2daabc16-804c-4e3e-b4bb-73e66a87eecc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:30.823469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2daabc16-804c-4e3e-b4bb-73e66a87eecc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:30.823942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2daabc16-804c-4e3e-b4bb-73e66a87eecc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:30.888173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2daabc16-804c-4e3e-b4bb-73e66a87eecc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:30.895837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2daabc16-804c-4e3e-b4bb-73e66a87eecc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084054 May 12 07:08:30.896405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 573/1294] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:30 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:31.273120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a9465c0b-7322-491b-8378-aa26bccab396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:31.274039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a9465c0b-7322-491b-8378-aa26bccab396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:31.280489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9465c0b-7322-491b-8378-aa26bccab396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:31.280936 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9465c0b-7322-491b-8378-aa26bccab396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:31.281697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9465c0b-7322-491b-8378-aa26bccab396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:31.282128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9465c0b-7322-491b-8378-aa26bccab396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:31.310592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a9465c0b-7322-491b-8378-aa26bccab396 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041446 May 12 07:08:31.311126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 574/1295] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:31 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:31.491335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-983008ba-560f-4764-936b-06355f6536c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:31.492322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-983008ba-560f-4764-936b-06355f6536c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:31.498997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-983008ba-560f-4764-936b-06355f6536c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:31.499440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-983008ba-560f-4764-936b-06355f6536c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:31.500232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-983008ba-560f-4764-936b-06355f6536c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:31.500668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-983008ba-560f-4764-936b-06355f6536c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:31.529236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-983008ba-560f-4764-936b-06355f6536c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 May 12 07:08:31.529765 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 575/1296] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:31.912579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f5bec19d-0d10-4078-971b-d986bd19226a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:31.913112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f5bec19d-0d10-4078-971b-d986bd19226a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:31.919571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5bec19d-0d10-4078-971b-d986bd19226a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:31.920041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5bec19d-0d10-4078-971b-d986bd19226a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:31.920803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5bec19d-0d10-4078-971b-d986bd19226a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:31.921233 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5bec19d-0d10-4078-971b-d986bd19226a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:31.985833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f5bec19d-0d10-4078-971b-d986bd19226a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:31.994935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f5bec19d-0d10-4078-971b-d986bd19226a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.086173 May 12 07:08:31.995651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 576/1297] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:31 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:32.322363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-71e79d1e-ef73-41c5-8bf8-05de7dce0ed9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:32.323277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-71e79d1e-ef73-41c5-8bf8-05de7dce0ed9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:32.329147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-71e79d1e-ef73-41c5-8bf8-05de7dce0ed9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:32.329593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-71e79d1e-ef73-41c5-8bf8-05de7dce0ed9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:32.330353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-71e79d1e-ef73-41c5-8bf8-05de7dce0ed9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:32.330786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-71e79d1e-ef73-41c5-8bf8-05de7dce0ed9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:32.358858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-71e79d1e-ef73-41c5-8bf8-05de7dce0ed9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040946 May 12 07:08:32.359401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 577/1298] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:32 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:32.539580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5eab4399-0f5e-449d-83f9-24b7d8992429 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:32.540515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5eab4399-0f5e-449d-83f9-24b7d8992429 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:32.546878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5eab4399-0f5e-449d-83f9-24b7d8992429 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:32.547332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5eab4399-0f5e-449d-83f9-24b7d8992429 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:32.548138 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5eab4399-0f5e-449d-83f9-24b7d8992429 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:32.548577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5eab4399-0f5e-449d-83f9-24b7d8992429 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:32.577023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5eab4399-0f5e-449d-83f9-24b7d8992429 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041092 May 12 07:08:32.577520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 578/1299] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:32.636773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:08:32.636932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:08:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:08:33.013172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b1977f18-72c8-4402-bacf-e4acd649f5aa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:33.013826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b1977f18-72c8-4402-bacf-e4acd649f5aa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:33.019830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1977f18-72c8-4402-bacf-e4acd649f5aa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:33.020286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1977f18-72c8-4402-bacf-e4acd649f5aa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:33.021064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1977f18-72c8-4402-bacf-e4acd649f5aa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:33.021510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1977f18-72c8-4402-bacf-e4acd649f5aa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:33.081771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b1977f18-72c8-4402-bacf-e4acd649f5aa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:33.089196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b1977f18-72c8-4402-bacf-e4acd649f5aa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080429 May 12 07:08:33.089753 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 579/1300] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:33 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:33.371334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fe342bde-d484-40b1-bbd9-0ad059db4e35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:33.372314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fe342bde-d484-40b1-bbd9-0ad059db4e35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:33.378090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe342bde-d484-40b1-bbd9-0ad059db4e35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:33.378539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe342bde-d484-40b1-bbd9-0ad059db4e35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:33.379300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe342bde-d484-40b1-bbd9-0ad059db4e35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:33.379757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe342bde-d484-40b1-bbd9-0ad059db4e35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:33.408463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fe342bde-d484-40b1-bbd9-0ad059db4e35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041610 May 12 07:08:33.408995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 580/1301] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:33 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:33.588401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-432b6df5-0a7e-44b2-aded-312fb4c71a0b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:33.589447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-432b6df5-0a7e-44b2-aded-312fb4c71a0b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:33.595721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-432b6df5-0a7e-44b2-aded-312fb4c71a0b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:33.596174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-432b6df5-0a7e-44b2-aded-312fb4c71a0b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:33.596955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-432b6df5-0a7e-44b2-aded-312fb4c71a0b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:33.597394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-432b6df5-0a7e-44b2-aded-312fb4c71a0b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:33.626130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-432b6df5-0a7e-44b2-aded-312fb4c71a0b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041616 May 12 07:08:33.626609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 581/1302] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:33 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:34.104934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7925036a-b7e3-45cb-be5c-3e3debe38d57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:34.105550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7925036a-b7e3-45cb-be5c-3e3debe38d57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:34.111705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7925036a-b7e3-45cb-be5c-3e3debe38d57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:34.112151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7925036a-b7e3-45cb-be5c-3e3debe38d57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:34.112924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7925036a-b7e3-45cb-be5c-3e3debe38d57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:34.113359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7925036a-b7e3-45cb-be5c-3e3debe38d57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:34.172592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7925036a-b7e3-45cb-be5c-3e3debe38d57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:34.180061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7925036a-b7e3-45cb-be5c-3e3debe38d57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079021 May 12 07:08:34.181144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 582/1303] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:34 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:34.419901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-505d9bf8-2a60-4374-9bea-15d800de6735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:34.420742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-505d9bf8-2a60-4374-9bea-15d800de6735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:34.426768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-505d9bf8-2a60-4374-9bea-15d800de6735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:34.427216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-505d9bf8-2a60-4374-9bea-15d800de6735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:34.428007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-505d9bf8-2a60-4374-9bea-15d800de6735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:34.428443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-505d9bf8-2a60-4374-9bea-15d800de6735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:34.457694 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-505d9bf8-2a60-4374-9bea-15d800de6735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041716 May 12 07:08:34.458229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 583/1304] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:34 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:34.638220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3bc013dc-ccd0-4e4b-a111-d89b9fdf0a17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:34.639143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3bc013dc-ccd0-4e4b-a111-d89b9fdf0a17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:34.645410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3bc013dc-ccd0-4e4b-a111-d89b9fdf0a17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:34.647574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3bc013dc-ccd0-4e4b-a111-d89b9fdf0a17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:34.647574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3bc013dc-ccd0-4e4b-a111-d89b9fdf0a17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:34.647574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3bc013dc-ccd0-4e4b-a111-d89b9fdf0a17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:34.676255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3bc013dc-ccd0-4e4b-a111-d89b9fdf0a17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042403 May 12 07:08:34.676731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 584/1305] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:35.197320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6b7fb202-7ebf-4626-8e85-1053f74fc660 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:35.197930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6b7fb202-7ebf-4626-8e85-1053f74fc660 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:35.203860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b7fb202-7ebf-4626-8e85-1053f74fc660 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:35.204302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b7fb202-7ebf-4626-8e85-1053f74fc660 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:35.205059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b7fb202-7ebf-4626-8e85-1053f74fc660 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:35.205490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b7fb202-7ebf-4626-8e85-1053f74fc660 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:35.267119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6b7fb202-7ebf-4626-8e85-1053f74fc660 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:35.274832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6b7fb202-7ebf-4626-8e85-1053f74fc660 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080868 May 12 07:08:35.275385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 585/1306] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:35 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:35.468684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b9607632-6baa-408d-b76e-d3977e96f7b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:35.469603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b9607632-6baa-408d-b76e-d3977e96f7b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:35.475465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9607632-6baa-408d-b76e-d3977e96f7b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:35.475960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9607632-6baa-408d-b76e-d3977e96f7b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:35.476736 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9607632-6baa-408d-b76e-d3977e96f7b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:35.477179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9607632-6baa-408d-b76e-d3977e96f7b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:35.505318 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b9607632-6baa-408d-b76e-d3977e96f7b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040481 May 12 07:08:35.505858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 586/1307] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:35 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:35.687442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0403c1e9-dc2a-46dc-8a67-a4290d08adc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:35.688311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0403c1e9-dc2a-46dc-8a67-a4290d08adc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:35.694411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0403c1e9-dc2a-46dc-8a67-a4290d08adc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:35.694860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0403c1e9-dc2a-46dc-8a67-a4290d08adc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:35.695620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0403c1e9-dc2a-46dc-8a67-a4290d08adc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:35.696746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0403c1e9-dc2a-46dc-8a67-a4290d08adc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:35.724119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0403c1e9-dc2a-46dc-8a67-a4290d08adc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040479 May 12 07:08:35.724642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 587/1308] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:35 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:36.291370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-67983467-d75c-4ad3-b796-84b725e4ad61 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:36.291972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-67983467-d75c-4ad3-b796-84b725e4ad61 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:36.297838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67983467-d75c-4ad3-b796-84b725e4ad61 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:36.298280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67983467-d75c-4ad3-b796-84b725e4ad61 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:36.299303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67983467-d75c-4ad3-b796-84b725e4ad61 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:36.299756 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67983467-d75c-4ad3-b796-84b725e4ad61 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:36.358382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-67983467-d75c-4ad3-b796-84b725e4ad61 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:36.365673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-67983467-d75c-4ad3-b796-84b725e4ad61 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078272 May 12 07:08:36.366226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 588/1309] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:36 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:36.517405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dd5c9ba6-33ed-49b0-9e3e-e73bb48ec7f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:36.518348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dd5c9ba6-33ed-49b0-9e3e-e73bb48ec7f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:36.524240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd5c9ba6-33ed-49b0-9e3e-e73bb48ec7f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:36.524690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd5c9ba6-33ed-49b0-9e3e-e73bb48ec7f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:36.525455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd5c9ba6-33ed-49b0-9e3e-e73bb48ec7f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:36.525889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd5c9ba6-33ed-49b0-9e3e-e73bb48ec7f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:36.554360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dd5c9ba6-33ed-49b0-9e3e-e73bb48ec7f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040876 May 12 07:08:36.554868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 589/1310] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:36 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:36.735582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d5f69e1d-c863-4c34-a63f-97c6c0a6abe1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:36.736525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d5f69e1d-c863-4c34-a63f-97c6c0a6abe1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:36.743497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5f69e1d-c863-4c34-a63f-97c6c0a6abe1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:36.743982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5f69e1d-c863-4c34-a63f-97c6c0a6abe1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:36.744756 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5f69e1d-c863-4c34-a63f-97c6c0a6abe1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:36.745196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5f69e1d-c863-4c34-a63f-97c6c0a6abe1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:36.773766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d5f69e1d-c863-4c34-a63f-97c6c0a6abe1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042126 May 12 07:08:36.774411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 590/1311] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:37.382489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aadcfbc2-d9a1-416a-a1fc-fa3712eb90d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:37.383106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-aadcfbc2-d9a1-416a-a1fc-fa3712eb90d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:37.389624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aadcfbc2-d9a1-416a-a1fc-fa3712eb90d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:37.390075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aadcfbc2-d9a1-416a-a1fc-fa3712eb90d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:37.390848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aadcfbc2-d9a1-416a-a1fc-fa3712eb90d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:37.391289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aadcfbc2-d9a1-416a-a1fc-fa3712eb90d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:37.450063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-aadcfbc2-d9a1-416a-a1fc-fa3712eb90d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:37.457277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aadcfbc2-d9a1-416a-a1fc-fa3712eb90d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078588 May 12 07:08:37.457833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 591/1312] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:37 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:37.565723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-57eec226-e2c3-43c1-84a7-dc4992c3eb90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:37.566628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-57eec226-e2c3-43c1-84a7-dc4992c3eb90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:37.572803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57eec226-e2c3-43c1-84a7-dc4992c3eb90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:37.573258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57eec226-e2c3-43c1-84a7-dc4992c3eb90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:37.574027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57eec226-e2c3-43c1-84a7-dc4992c3eb90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:37.574464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57eec226-e2c3-43c1-84a7-dc4992c3eb90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:37.602576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-57eec226-e2c3-43c1-84a7-dc4992c3eb90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040501 May 12 07:08:37.603105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 592/1313] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:37 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:37.785212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8eeaa8c2-34f4-4834-b08e-9107ec121e23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:37.786137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8eeaa8c2-34f4-4834-b08e-9107ec121e23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:37.792831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8eeaa8c2-34f4-4834-b08e-9107ec121e23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:37.793757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8eeaa8c2-34f4-4834-b08e-9107ec121e23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:37.794040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8eeaa8c2-34f4-4834-b08e-9107ec121e23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:37.794483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8eeaa8c2-34f4-4834-b08e-9107ec121e23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:37.823574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8eeaa8c2-34f4-4834-b08e-9107ec121e23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042088 May 12 07:08:37.827951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 593/1314] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:38.474168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-72f25762-7de6-451a-9b55-10b66cedb430 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:38.474782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-72f25762-7de6-451a-9b55-10b66cedb430 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:38.480744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-72f25762-7de6-451a-9b55-10b66cedb430 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:38.481192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-72f25762-7de6-451a-9b55-10b66cedb430 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:38.481954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-72f25762-7de6-451a-9b55-10b66cedb430 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:38.482389 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-72f25762-7de6-451a-9b55-10b66cedb430 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:38.541245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-72f25762-7de6-451a-9b55-10b66cedb430 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:38.548403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-72f25762-7de6-451a-9b55-10b66cedb430 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078051 May 12 07:08:38.549224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 594/1315] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:38 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:38.613862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-20127d2a-cb02-4b1e-8f1a-6008f8baf40c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:38.614714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-20127d2a-cb02-4b1e-8f1a-6008f8baf40c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:38.620783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20127d2a-cb02-4b1e-8f1a-6008f8baf40c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:38.621238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20127d2a-cb02-4b1e-8f1a-6008f8baf40c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:38.622011 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20127d2a-cb02-4b1e-8f1a-6008f8baf40c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:38.622451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20127d2a-cb02-4b1e-8f1a-6008f8baf40c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:38.651337 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-20127d2a-cb02-4b1e-8f1a-6008f8baf40c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041361 May 12 07:08:38.651927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 595/1316] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:38 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:38.834498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aaedf35c-faed-41b6-96de-2f5121160e75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:38.835418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-aaedf35c-faed-41b6-96de-2f5121160e75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:38.841682 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aaedf35c-faed-41b6-96de-2f5121160e75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:38.842132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aaedf35c-faed-41b6-96de-2f5121160e75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:38.842901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aaedf35c-faed-41b6-96de-2f5121160e75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:38.843340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aaedf35c-faed-41b6-96de-2f5121160e75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:38.871795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aaedf35c-faed-41b6-96de-2f5121160e75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 May 12 07:08:38.872277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 596/1317] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:38 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:39.565273 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1ea47a0b-5770-45a5-adb4-ab3664dafa8a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:39.565886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1ea47a0b-5770-45a5-adb4-ab3664dafa8a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:39.572446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ea47a0b-5770-45a5-adb4-ab3664dafa8a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:39.572889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ea47a0b-5770-45a5-adb4-ab3664dafa8a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:39.573648 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ea47a0b-5770-45a5-adb4-ab3664dafa8a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:39.574084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ea47a0b-5770-45a5-adb4-ab3664dafa8a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:39.635390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1ea47a0b-5770-45a5-adb4-ab3664dafa8a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:39.642618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1ea47a0b-5770-45a5-adb4-ab3664dafa8a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081166 May 12 07:08:39.643174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 597/1318] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:39 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:39.661791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-678d95fc-d48c-4c20-944e-522818edf75e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:39.662697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-678d95fc-d48c-4c20-944e-522818edf75e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:39.668545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-678d95fc-d48c-4c20-944e-522818edf75e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:39.668994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-678d95fc-d48c-4c20-944e-522818edf75e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:39.669764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-678d95fc-d48c-4c20-944e-522818edf75e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:39.670202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-678d95fc-d48c-4c20-944e-522818edf75e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:39.699550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-678d95fc-d48c-4c20-944e-522818edf75e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041300 May 12 07:08:39.700115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 598/1319] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:39 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:39.882872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a26fe16d-31d9-48c0-80d5-5a12729a348b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:39.883808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a26fe16d-31d9-48c0-80d5-5a12729a348b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:39.889979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a26fe16d-31d9-48c0-80d5-5a12729a348b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:39.891915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a26fe16d-31d9-48c0-80d5-5a12729a348b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:39.891915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a26fe16d-31d9-48c0-80d5-5a12729a348b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:39.891915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a26fe16d-31d9-48c0-80d5-5a12729a348b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:39.921450 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a26fe16d-31d9-48c0-80d5-5a12729a348b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042843 May 12 07:08:39.922000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 599/1320] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:40.658505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-24371133-759b-42be-89f6-a40701ddeb71 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:40.659119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-24371133-759b-42be-89f6-a40701ddeb71 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:40.665116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24371133-759b-42be-89f6-a40701ddeb71 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:40.665565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24371133-759b-42be-89f6-a40701ddeb71 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:40.666335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24371133-759b-42be-89f6-a40701ddeb71 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:40.666771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24371133-759b-42be-89f6-a40701ddeb71 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:40.726319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-24371133-759b-42be-89f6-a40701ddeb71 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:40.733700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-24371133-759b-42be-89f6-a40701ddeb71 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079055 May 12 07:08:40.734259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 600/1321] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:40 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:40.738679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3a203723-cb64-4551-b74f-35a6b9c19804 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:40.739617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3a203723-cb64-4551-b74f-35a6b9c19804 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:40.745114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a203723-cb64-4551-b74f-35a6b9c19804 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:40.745565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a203723-cb64-4551-b74f-35a6b9c19804 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:40.746340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a203723-cb64-4551-b74f-35a6b9c19804 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:40.746780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a203723-cb64-4551-b74f-35a6b9c19804 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:40.775737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3a203723-cb64-4551-b74f-35a6b9c19804 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040498 May 12 07:08:40.776283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 601/1322] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:40 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:40.933261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8762cf99-f354-4051-a8f9-ce3918c19e7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:40.934240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8762cf99-f354-4051-a8f9-ce3918c19e7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:40.940454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8762cf99-f354-4051-a8f9-ce3918c19e7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:40.940949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8762cf99-f354-4051-a8f9-ce3918c19e7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:40.941716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8762cf99-f354-4051-a8f9-ce3918c19e7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:40.942150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8762cf99-f354-4051-a8f9-ce3918c19e7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:40.972067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8762cf99-f354-4051-a8f9-ce3918c19e7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042747 May 12 07:08:40.973837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 602/1323] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:40 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:41.749869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-12a7652d-9b8b-4318-90c7-eb795107348d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:41.750479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-12a7652d-9b8b-4318-90c7-eb795107348d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:41.756476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12a7652d-9b8b-4318-90c7-eb795107348d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:41.756922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12a7652d-9b8b-4318-90c7-eb795107348d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:41.757683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12a7652d-9b8b-4318-90c7-eb795107348d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:41.758115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-12a7652d-9b8b-4318-90c7-eb795107348d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:41.817302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-12a7652d-9b8b-4318-90c7-eb795107348d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:41.825292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-12a7652d-9b8b-4318-90c7-eb795107348d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079244 May 12 07:08:41.825869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 603/1324] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:41 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:41.830263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fbc9aeaf-aa82-49eb-83d7-75b55936107f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:41.831156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fbc9aeaf-aa82-49eb-83d7-75b55936107f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:41.836643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fbc9aeaf-aa82-49eb-83d7-75b55936107f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:41.837094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fbc9aeaf-aa82-49eb-83d7-75b55936107f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:41.837855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fbc9aeaf-aa82-49eb-83d7-75b55936107f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:41.838292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fbc9aeaf-aa82-49eb-83d7-75b55936107f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:41.865519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fbc9aeaf-aa82-49eb-83d7-75b55936107f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038716 May 12 07:08:41.866048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 604/1325] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:41 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:41.983737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a81bbec5-ad68-455b-8f28-8a14f55c2352 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:41.984687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a81bbec5-ad68-455b-8f28-8a14f55c2352 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:41.991029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a81bbec5-ad68-455b-8f28-8a14f55c2352 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:41.991544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a81bbec5-ad68-455b-8f28-8a14f55c2352 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:41.992347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a81bbec5-ad68-455b-8f28-8a14f55c2352 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:41.992791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a81bbec5-ad68-455b-8f28-8a14f55c2352 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:42.021847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a81bbec5-ad68-455b-8f28-8a14f55c2352 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041918 May 12 07:08:42.022783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 605/1326] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:41 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:42.842374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9b82cc9f-4e78-45f0-80db-359b8d1a5921 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:42.842992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9b82cc9f-4e78-45f0-80db-359b8d1a5921 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:42.848905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b82cc9f-4e78-45f0-80db-359b8d1a5921 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:42.849355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b82cc9f-4e78-45f0-80db-359b8d1a5921 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:42.850133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b82cc9f-4e78-45f0-80db-359b8d1a5921 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:42.850572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b82cc9f-4e78-45f0-80db-359b8d1a5921 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:42.909815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9b82cc9f-4e78-45f0-80db-359b8d1a5921 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:42.917079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9b82cc9f-4e78-45f0-80db-359b8d1a5921 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078568 May 12 07:08:42.917640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 606/1327] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:42 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:42.922116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-04017be5-306e-48eb-ae4a-fa1d554343b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:42.923014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-04017be5-306e-48eb-ae4a-fa1d554343b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:42.928674 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04017be5-306e-48eb-ae4a-fa1d554343b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:42.929125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04017be5-306e-48eb-ae4a-fa1d554343b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:42.929894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04017be5-306e-48eb-ae4a-fa1d554343b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:42.930334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04017be5-306e-48eb-ae4a-fa1d554343b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:42.958478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-04017be5-306e-48eb-ae4a-fa1d554343b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039854 May 12 07:08:42.959027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 607/1328] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:42 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:43.033825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-522f3f94-2496-462c-91f5-f0406e7a015b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:43.034744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-522f3f94-2496-462c-91f5-f0406e7a015b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:43.041094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-522f3f94-2496-462c-91f5-f0406e7a015b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:43.041542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-522f3f94-2496-462c-91f5-f0406e7a015b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:43.042311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-522f3f94-2496-462c-91f5-f0406e7a015b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:43.042751 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-522f3f94-2496-462c-91f5-f0406e7a015b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:43.071408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-522f3f94-2496-462c-91f5-f0406e7a015b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041008 May 12 07:08:43.071996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 608/1329] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:43.933977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-519f5175-6905-40b0-92de-ecbf8d9167f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:43.934611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-519f5175-6905-40b0-92de-ecbf8d9167f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:43.940373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-519f5175-6905-40b0-92de-ecbf8d9167f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:43.940817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-519f5175-6905-40b0-92de-ecbf8d9167f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:43.941578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-519f5175-6905-40b0-92de-ecbf8d9167f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:43.942016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-519f5175-6905-40b0-92de-ecbf8d9167f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:44.004033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-519f5175-6905-40b0-92de-ecbf8d9167f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:44.012144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-519f5175-6905-40b0-92de-ecbf8d9167f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082497 May 12 07:08:44.012709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 609/1330] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:43 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:44.017172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-47a1dd9d-2928-4360-aa22-0712a1d37919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:44.018071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-47a1dd9d-2928-4360-aa22-0712a1d37919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:44.023593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-47a1dd9d-2928-4360-aa22-0712a1d37919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:44.024066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-47a1dd9d-2928-4360-aa22-0712a1d37919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:44.024832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-47a1dd9d-2928-4360-aa22-0712a1d37919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:44.025265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-47a1dd9d-2928-4360-aa22-0712a1d37919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:44.053441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-47a1dd9d-2928-4360-aa22-0712a1d37919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039744 May 12 07:08:44.054117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 610/1331] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:44 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:44.082031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fb6cb3d3-5573-451f-ad52-d37f766795e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:44.082935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fb6cb3d3-5573-451f-ad52-d37f766795e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:44.088638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb6cb3d3-5573-451f-ad52-d37f766795e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:44.089096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb6cb3d3-5573-451f-ad52-d37f766795e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:44.089866 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb6cb3d3-5573-451f-ad52-d37f766795e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:44.090310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb6cb3d3-5573-451f-ad52-d37f766795e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:44.117571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fb6cb3d3-5573-451f-ad52-d37f766795e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039274 May 12 07:08:44.118630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 611/1332] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:08:45.028477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f66b860a-7299-4029-924c-5ed6033488ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:45.029114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f66b860a-7299-4029-924c-5ed6033488ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:45.034989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f66b860a-7299-4029-924c-5ed6033488ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:45.035439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f66b860a-7299-4029-924c-5ed6033488ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:45.036235 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f66b860a-7299-4029-924c-5ed6033488ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:45.036675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f66b860a-7299-4029-924c-5ed6033488ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:45.096195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f66b860a-7299-4029-924c-5ed6033488ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:45.103966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f66b860a-7299-4029-924c-5ed6033488ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079374 May 12 07:08:45.104527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 612/1333] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:45 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:45.108934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ecbea896-322d-4575-9ca0-1c5e03b0be7c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:45.109841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ecbea896-322d-4575-9ca0-1c5e03b0be7c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:45.115418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ecbea896-322d-4575-9ca0-1c5e03b0be7c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:45.115910 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ecbea896-322d-4575-9ca0-1c5e03b0be7c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:45.116781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ecbea896-322d-4575-9ca0-1c5e03b0be7c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:45.117217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ecbea896-322d-4575-9ca0-1c5e03b0be7c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:45.149301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ecbea896-322d-4575-9ca0-1c5e03b0be7c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 May 12 07:08:45.149838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 613/1334] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:45 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:45.154487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0eb29636-887e-4f99-a8bb-f06c5d1485ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:45.155454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0eb29636-887e-4f99-a8bb-f06c5d1485ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:45.161024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0eb29636-887e-4f99-a8bb-f06c5d1485ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:45.161469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0eb29636-887e-4f99-a8bb-f06c5d1485ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:45.162241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0eb29636-887e-4f99-a8bb-f06c5d1485ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:45.162675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0eb29636-887e-4f99-a8bb-f06c5d1485ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:45.196483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0eb29636-887e-4f99-a8bb-f06c5d1485ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045681 May 12 07:08:45.197034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 614/1335] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:45 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:46.120496 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7b4ded43-2f8b-46a5-992b-3275e144cd9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:46.121125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7b4ded43-2f8b-46a5-992b-3275e144cd9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:46.127358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b4ded43-2f8b-46a5-992b-3275e144cd9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:46.127835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b4ded43-2f8b-46a5-992b-3275e144cd9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:46.128609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b4ded43-2f8b-46a5-992b-3275e144cd9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:46.129042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b4ded43-2f8b-46a5-992b-3275e144cd9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:46.189115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7b4ded43-2f8b-46a5-992b-3275e144cd9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:46.196982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7b4ded43-2f8b-46a5-992b-3275e144cd9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080341 May 12 07:08:46.197542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 615/1336] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:46 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:46.202007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7635fc6e-f175-43bb-847a-befbf57c04fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:46.203572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7635fc6e-f175-43bb-847a-befbf57c04fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:46.209345 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7635fc6e-f175-43bb-847a-befbf57c04fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:46.209820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7635fc6e-f175-43bb-847a-befbf57c04fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:46.210589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7635fc6e-f175-43bb-847a-befbf57c04fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:46.211047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7635fc6e-f175-43bb-847a-befbf57c04fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:46.238375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7635fc6e-f175-43bb-847a-befbf57c04fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039886 May 12 07:08:46.238907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 616/1337] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:46 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:46.243849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d6816b31-bd07-4b4c-aca0-2afbbee0d5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:46.244647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d6816b31-bd07-4b4c-aca0-2afbbee0d5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:46.249864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6816b31-bd07-4b4c-aca0-2afbbee0d5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:46.250309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6816b31-bd07-4b4c-aca0-2afbbee0d5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:46.251062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6816b31-bd07-4b4c-aca0-2afbbee0d5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:46.251493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6816b31-bd07-4b4c-aca0-2afbbee0d5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:46.278677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d6816b31-bd07-4b4c-aca0-2afbbee0d5ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038851 May 12 07:08:46.279203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 617/1338] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:46 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:47.214284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-712b4233-c85c-4ba3-968c-16f63aba9dff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:47.214926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-712b4233-c85c-4ba3-968c-16f63aba9dff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:47.221138 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-712b4233-c85c-4ba3-968c-16f63aba9dff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:47.221594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-712b4233-c85c-4ba3-968c-16f63aba9dff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:47.222370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-712b4233-c85c-4ba3-968c-16f63aba9dff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:47.222811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-712b4233-c85c-4ba3-968c-16f63aba9dff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:47.282791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-712b4233-c85c-4ba3-968c-16f63aba9dff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:47.290205 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-712b4233-c85c-4ba3-968c-16f63aba9dff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080437 May 12 07:08:47.290763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 618/1339] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:47 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:47.295257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d528d28a-24d2-4e75-8884-ac8f90b53936 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:47.296187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d528d28a-24d2-4e75-8884-ac8f90b53936 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:47.301823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d528d28a-24d2-4e75-8884-ac8f90b53936 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:47.302277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d528d28a-24d2-4e75-8884-ac8f90b53936 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:47.303051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d528d28a-24d2-4e75-8884-ac8f90b53936 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:47.303491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d528d28a-24d2-4e75-8884-ac8f90b53936 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:47.332750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d528d28a-24d2-4e75-8884-ac8f90b53936 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041023 May 12 07:08:47.333296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 619/1340] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:47 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:47.338163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-11b1e118-4453-49da-9848-c60618ddd248 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:47.339174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-11b1e118-4453-49da-9848-c60618ddd248 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:47.344497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11b1e118-4453-49da-9848-c60618ddd248 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:47.344975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11b1e118-4453-49da-9848-c60618ddd248 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:47.345745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11b1e118-4453-49da-9848-c60618ddd248 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:47.346187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11b1e118-4453-49da-9848-c60618ddd248 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:47.373685 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-11b1e118-4453-49da-9848-c60618ddd248 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039423 May 12 07:08:47.374219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 620/1341] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:48.307477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-621ce647-aeb5-488d-92f7-90ef557eb060 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:48.308111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-621ce647-aeb5-488d-92f7-90ef557eb060 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:48.314209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-621ce647-aeb5-488d-92f7-90ef557eb060 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:48.314652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-621ce647-aeb5-488d-92f7-90ef557eb060 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:48.315442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-621ce647-aeb5-488d-92f7-90ef557eb060 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:48.315905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-621ce647-aeb5-488d-92f7-90ef557eb060 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:48.377302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-621ce647-aeb5-488d-92f7-90ef557eb060 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:48.384544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-621ce647-aeb5-488d-92f7-90ef557eb060 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081591 May 12 07:08:48.385088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 621/1342] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:48 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:48.389518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d9bdbdef-88d9-41c6-890d-8285cc0f38d8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:48.390411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d9bdbdef-88d9-41c6-890d-8285cc0f38d8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:48.395700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d9bdbdef-88d9-41c6-890d-8285cc0f38d8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:48.396151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d9bdbdef-88d9-41c6-890d-8285cc0f38d8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:48.396909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d9bdbdef-88d9-41c6-890d-8285cc0f38d8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:48.397343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d9bdbdef-88d9-41c6-890d-8285cc0f38d8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:48.425872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d9bdbdef-88d9-41c6-890d-8285cc0f38d8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039806 May 12 07:08:48.426401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 622/1343] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:48 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:48.430625 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a86ea818-5905-4061-a8c6-d46b746ad505 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:48.431485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a86ea818-5905-4061-a8c6-d46b746ad505 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:48.436714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a86ea818-5905-4061-a8c6-d46b746ad505 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:48.437159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a86ea818-5905-4061-a8c6-d46b746ad505 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:48.437911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a86ea818-5905-4061-a8c6-d46b746ad505 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:48.438343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a86ea818-5905-4061-a8c6-d46b746ad505 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:48.465637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a86ea818-5905-4061-a8c6-d46b746ad505 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038326 May 12 07:08:48.466180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 623/1344] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:48 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:49.401644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a0734ac9-8c08-4b15-a3a5-1e5022f1e4bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:49.402316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a0734ac9-8c08-4b15-a3a5-1e5022f1e4bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:49.408534 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0734ac9-8c08-4b15-a3a5-1e5022f1e4bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:49.408974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0734ac9-8c08-4b15-a3a5-1e5022f1e4bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:49.409734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0734ac9-8c08-4b15-a3a5-1e5022f1e4bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:49.410167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0734ac9-8c08-4b15-a3a5-1e5022f1e4bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:49.469691 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a0734ac9-8c08-4b15-a3a5-1e5022f1e4bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:49.477107 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a0734ac9-8c08-4b15-a3a5-1e5022f1e4bb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079777 May 12 07:08:49.478221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 624/1345] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:49 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:49.482705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-db496e19-521e-42c2-9c40-e5838082259a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:49.483612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-db496e19-521e-42c2-9c40-e5838082259a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:49.489001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db496e19-521e-42c2-9c40-e5838082259a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:49.489451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db496e19-521e-42c2-9c40-e5838082259a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:49.490216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db496e19-521e-42c2-9c40-e5838082259a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:49.490654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db496e19-521e-42c2-9c40-e5838082259a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:49.518403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-db496e19-521e-42c2-9c40-e5838082259a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039225 May 12 07:08:49.518931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 625/1346] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:49 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:49.523198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d75860b3-4628-4f3d-8b67-2473df23b27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:49.524724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d75860b3-4628-4f3d-8b67-2473df23b27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:49.530052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d75860b3-4628-4f3d-8b67-2473df23b27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:49.530500 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d75860b3-4628-4f3d-8b67-2473df23b27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:49.531265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d75860b3-4628-4f3d-8b67-2473df23b27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:49.531722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d75860b3-4628-4f3d-8b67-2473df23b27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:49.559365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d75860b3-4628-4f3d-8b67-2473df23b27b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039513 May 12 07:08:49.559953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 626/1347] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:49 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:50.494414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9fe29e4c-6e4a-4c40-b3d1-f5a8438a7ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:50.495076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9fe29e4c-6e4a-4c40-b3d1-f5a8438a7ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:50.501430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9fe29e4c-6e4a-4c40-b3d1-f5a8438a7ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:50.501882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9fe29e4c-6e4a-4c40-b3d1-f5a8438a7ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:50.502659 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9fe29e4c-6e4a-4c40-b3d1-f5a8438a7ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:50.503103 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9fe29e4c-6e4a-4c40-b3d1-f5a8438a7ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:50.562554 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9fe29e4c-6e4a-4c40-b3d1-f5a8438a7ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:50.569882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9fe29e4c-6e4a-4c40-b3d1-f5a8438a7ce1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079410 May 12 07:08:50.570445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 627/1348] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:50 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:50.575521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-020ce283-8942-4886-8f4f-3b611f0e340d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:50.576470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-020ce283-8942-4886-8f4f-3b611f0e340d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:50.582147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-020ce283-8942-4886-8f4f-3b611f0e340d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:50.582642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-020ce283-8942-4886-8f4f-3b611f0e340d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:50.583418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-020ce283-8942-4886-8f4f-3b611f0e340d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:50.583888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-020ce283-8942-4886-8f4f-3b611f0e340d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:50.612789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-020ce283-8942-4886-8f4f-3b611f0e340d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041390 May 12 07:08:50.613317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 628/1349] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:50 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:50.617605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b82d7430-2f2b-41f8-b611-439d15c613b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:50.618469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b82d7430-2f2b-41f8-b611-439d15c613b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:50.624145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b82d7430-2f2b-41f8-b611-439d15c613b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:50.624589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b82d7430-2f2b-41f8-b611-439d15c613b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:50.625422 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b82d7430-2f2b-41f8-b611-439d15c613b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:50.625854 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b82d7430-2f2b-41f8-b611-439d15c613b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:50.653177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b82d7430-2f2b-41f8-b611-439d15c613b2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038929 May 12 07:08:50.653732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 629/1350] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:51.586983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5ca1779e-f6b4-446b-bfbb-eb82c18918b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:51.587653 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5ca1779e-f6b4-446b-bfbb-eb82c18918b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:51.593472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ca1779e-f6b4-446b-bfbb-eb82c18918b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:51.593926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ca1779e-f6b4-446b-bfbb-eb82c18918b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:51.594699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ca1779e-f6b4-446b-bfbb-eb82c18918b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:51.595140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ca1779e-f6b4-446b-bfbb-eb82c18918b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:51.653779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5ca1779e-f6b4-446b-bfbb-eb82c18918b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:51.661134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5ca1779e-f6b4-446b-bfbb-eb82c18918b7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078188 May 12 07:08:51.661689 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 630/1351] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:51 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:51.666120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e6ab1b42-41f6-4f3e-8354-929fe292899e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:51.667025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e6ab1b42-41f6-4f3e-8354-929fe292899e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:51.672477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6ab1b42-41f6-4f3e-8354-929fe292899e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:51.672934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6ab1b42-41f6-4f3e-8354-929fe292899e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:51.673710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6ab1b42-41f6-4f3e-8354-929fe292899e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:51.674410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6ab1b42-41f6-4f3e-8354-929fe292899e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:51.703286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e6ab1b42-41f6-4f3e-8354-929fe292899e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040638 May 12 07:08:51.703859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 631/1352] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:51 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:51.708203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ff9e5ab5-5b7d-49d1-8a7b-56fb40226fc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:51.709083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ff9e5ab5-5b7d-49d1-8a7b-56fb40226fc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:51.714380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff9e5ab5-5b7d-49d1-8a7b-56fb40226fc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:51.714832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff9e5ab5-5b7d-49d1-8a7b-56fb40226fc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:51.715604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff9e5ab5-5b7d-49d1-8a7b-56fb40226fc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:51.716117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff9e5ab5-5b7d-49d1-8a7b-56fb40226fc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:51.743488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ff9e5ab5-5b7d-49d1-8a7b-56fb40226fc1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038703 May 12 07:08:51.744049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 632/1353] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:52.677212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-680390ae-adc4-45f8-bc65-3ec29eca7a34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:52.677875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-680390ae-adc4-45f8-bc65-3ec29eca7a34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:52.684719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-680390ae-adc4-45f8-bc65-3ec29eca7a34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:52.685166 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-680390ae-adc4-45f8-bc65-3ec29eca7a34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:52.685931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-680390ae-adc4-45f8-bc65-3ec29eca7a34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:52.686394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-680390ae-adc4-45f8-bc65-3ec29eca7a34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:52.748141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-680390ae-adc4-45f8-bc65-3ec29eca7a34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:52.755352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-680390ae-adc4-45f8-bc65-3ec29eca7a34 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082204 May 12 07:08:52.755940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 633/1354] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:52 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:52.761179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6cf1b276-0ceb-4778-ac87-bf88068f9fea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:52.762120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6cf1b276-0ceb-4778-ac87-bf88068f9fea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:52.767656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cf1b276-0ceb-4778-ac87-bf88068f9fea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:52.768145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cf1b276-0ceb-4778-ac87-bf88068f9fea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:52.768914 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cf1b276-0ceb-4778-ac87-bf88068f9fea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:52.769351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cf1b276-0ceb-4778-ac87-bf88068f9fea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:52.797257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6cf1b276-0ceb-4778-ac87-bf88068f9fea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039723 May 12 07:08:52.797806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 634/1355] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:52 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:52.802620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8f55524f-9ad1-4540-bad8-eed78fdc7069 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:52.803552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8f55524f-9ad1-4540-bad8-eed78fdc7069 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:52.809463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f55524f-9ad1-4540-bad8-eed78fdc7069 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:52.809913 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f55524f-9ad1-4540-bad8-eed78fdc7069 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:52.810671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f55524f-9ad1-4540-bad8-eed78fdc7069 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:52.811109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f55524f-9ad1-4540-bad8-eed78fdc7069 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:52.838131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8f55524f-9ad1-4540-bad8-eed78fdc7069 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039327 May 12 07:08:52.838660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 635/1356] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:53.771830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b4fb2c85-3ade-4d6b-ac20-77ac3a0a978d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:53.772506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b4fb2c85-3ade-4d6b-ac20-77ac3a0a978d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:53.779131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4fb2c85-3ade-4d6b-ac20-77ac3a0a978d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:53.779574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4fb2c85-3ade-4d6b-ac20-77ac3a0a978d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:53.780363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4fb2c85-3ade-4d6b-ac20-77ac3a0a978d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:53.780799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4fb2c85-3ade-4d6b-ac20-77ac3a0a978d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:53.840330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b4fb2c85-3ade-4d6b-ac20-77ac3a0a978d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:53.847599 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b4fb2c85-3ade-4d6b-ac20-77ac3a0a978d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079586 May 12 07:08:53.848180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 636/1357] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:53 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:53.852568 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c123e3bc-3768-41db-986d-fc4993abac6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:53.853465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c123e3bc-3768-41db-986d-fc4993abac6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:53.859448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c123e3bc-3768-41db-986d-fc4993abac6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:53.859925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c123e3bc-3768-41db-986d-fc4993abac6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:53.860690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c123e3bc-3768-41db-986d-fc4993abac6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:53.861124 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c123e3bc-3768-41db-986d-fc4993abac6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:53.889055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c123e3bc-3768-41db-986d-fc4993abac6b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039882 May 12 07:08:53.889602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 637/1358] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:53 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:53.894151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c3493e15-9ac1-4b58-91e1-c1cf6c405327 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:53.895042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c3493e15-9ac1-4b58-91e1-c1cf6c405327 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:53.900634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3493e15-9ac1-4b58-91e1-c1cf6c405327 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:53.901089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3493e15-9ac1-4b58-91e1-c1cf6c405327 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:53.902397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3493e15-9ac1-4b58-91e1-c1cf6c405327 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:53.902838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3493e15-9ac1-4b58-91e1-c1cf6c405327 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:53.932342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c3493e15-9ac1-4b58-91e1-c1cf6c405327 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 May 12 07:08:53.932889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 638/1359] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:54.863919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e042dead-32d0-4fca-8755-93342277c9fe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:54.864556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e042dead-32d0-4fca-8755-93342277c9fe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:54.871419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e042dead-32d0-4fca-8755-93342277c9fe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:54.871911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e042dead-32d0-4fca-8755-93342277c9fe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:54.872683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e042dead-32d0-4fca-8755-93342277c9fe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:54.873141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e042dead-32d0-4fca-8755-93342277c9fe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:54.932849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e042dead-32d0-4fca-8755-93342277c9fe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:54.940819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e042dead-32d0-4fca-8755-93342277c9fe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080766 May 12 07:08:54.941378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 639/1360] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:54 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:54.945819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-18f011f1-6794-4043-a0bb-26563dda8cdf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:54.946726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-18f011f1-6794-4043-a0bb-26563dda8cdf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:54.952188 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18f011f1-6794-4043-a0bb-26563dda8cdf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:54.952640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18f011f1-6794-4043-a0bb-26563dda8cdf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:54.953412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18f011f1-6794-4043-a0bb-26563dda8cdf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:54.953853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18f011f1-6794-4043-a0bb-26563dda8cdf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:54.986250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-18f011f1-6794-4043-a0bb-26563dda8cdf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 May 12 07:08:54.986834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 640/1361] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:54 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:54.991532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3c260740-8932-44df-9b83-a454b3f3076e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:54.992469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3c260740-8932-44df-9b83-a454b3f3076e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:54.998776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3c260740-8932-44df-9b83-a454b3f3076e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:54.999231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3c260740-8932-44df-9b83-a454b3f3076e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:55.000029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3c260740-8932-44df-9b83-a454b3f3076e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:55.000471 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3c260740-8932-44df-9b83-a454b3f3076e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:55.028332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3c260740-8932-44df-9b83-a454b3f3076e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040504 May 12 07:08:55.028881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 641/1362] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:55.957935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0d955fb7-fe31-49c8-9100-1a70a9b78963 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:55.964092 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0d955fb7-fe31-49c8-9100-1a70a9b78963 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:55.965415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d955fb7-fe31-49c8-9100-1a70a9b78963 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:55.965864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d955fb7-fe31-49c8-9100-1a70a9b78963 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:55.966641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d955fb7-fe31-49c8-9100-1a70a9b78963 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:55.967078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d955fb7-fe31-49c8-9100-1a70a9b78963 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:56.027641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0d955fb7-fe31-49c8-9100-1a70a9b78963 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:56.034978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0d955fb7-fe31-49c8-9100-1a70a9b78963 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080929 May 12 07:08:56.035530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 642/1363] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:55 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:56.039970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cc29439f-9794-492d-88e0-b898709ad50f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:56.040867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cc29439f-9794-492d-88e0-b898709ad50f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:56.047171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc29439f-9794-492d-88e0-b898709ad50f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:56.047621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc29439f-9794-492d-88e0-b898709ad50f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:56.048430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc29439f-9794-492d-88e0-b898709ad50f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:56.049125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc29439f-9794-492d-88e0-b898709ad50f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:56.076993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cc29439f-9794-492d-88e0-b898709ad50f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040468 May 12 07:08:56.077531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 643/1364] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:56 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:56.081869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-60eab181-8172-46c9-b055-22b3f295b989 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:56.090243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-60eab181-8172-46c9-b055-22b3f295b989 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:56.090243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60eab181-8172-46c9-b055-22b3f295b989 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:56.090243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60eab181-8172-46c9-b055-22b3f295b989 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:56.090243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60eab181-8172-46c9-b055-22b3f295b989 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:56.090665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60eab181-8172-46c9-b055-22b3f295b989 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:56.117688 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-60eab181-8172-46c9-b055-22b3f295b989 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039215 May 12 07:08:56.118218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 644/1365] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:57.052323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-eb8a9d94-ba8d-424e-b297-0e0ae0c0554a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:57.052933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-eb8a9d94-ba8d-424e-b297-0e0ae0c0554a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:57.059220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eb8a9d94-ba8d-424e-b297-0e0ae0c0554a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:57.059774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eb8a9d94-ba8d-424e-b297-0e0ae0c0554a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:57.060545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eb8a9d94-ba8d-424e-b297-0e0ae0c0554a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:57.060983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eb8a9d94-ba8d-424e-b297-0e0ae0c0554a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:57.122692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-eb8a9d94-ba8d-424e-b297-0e0ae0c0554a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:57.130131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-eb8a9d94-ba8d-424e-b297-0e0ae0c0554a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081896 May 12 07:08:57.130684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 645/1366] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:57 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:57.135103 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-61ebde82-b8b9-4bca-ae7c-86cdeadbe472 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:57.136035 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-61ebde82-b8b9-4bca-ae7c-86cdeadbe472 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:57.141895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61ebde82-b8b9-4bca-ae7c-86cdeadbe472 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:57.142340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61ebde82-b8b9-4bca-ae7c-86cdeadbe472 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:57.143103 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61ebde82-b8b9-4bca-ae7c-86cdeadbe472 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:57.143534 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61ebde82-b8b9-4bca-ae7c-86cdeadbe472 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:57.171212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-61ebde82-b8b9-4bca-ae7c-86cdeadbe472 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039577 May 12 07:08:57.171770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 646/1367] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:57 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:57.176337 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-95b3faca-5f15-400e-81d1-c2c2450bf631 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:57.177241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-95b3faca-5f15-400e-81d1-c2c2450bf631 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:57.182474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95b3faca-5f15-400e-81d1-c2c2450bf631 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:57.182919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95b3faca-5f15-400e-81d1-c2c2450bf631 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:57.183671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95b3faca-5f15-400e-81d1-c2c2450bf631 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:57.184129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95b3faca-5f15-400e-81d1-c2c2450bf631 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:57.212776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-95b3faca-5f15-400e-81d1-c2c2450bf631 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040070 May 12 07:08:57.213307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 647/1368] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:58.146446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8f66aa36-557d-41e4-a79c-23c5090c4c0f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:58.147045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8f66aa36-557d-41e4-a79c-23c5090c4c0f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:58.153778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f66aa36-557d-41e4-a79c-23c5090c4c0f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:58.154228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f66aa36-557d-41e4-a79c-23c5090c4c0f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:58.154996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f66aa36-557d-41e4-a79c-23c5090c4c0f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:58.155432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f66aa36-557d-41e4-a79c-23c5090c4c0f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:58.215577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8f66aa36-557d-41e4-a79c-23c5090c4c0f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:58.223160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8f66aa36-557d-41e4-a79c-23c5090c4c0f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080493 May 12 07:08:58.223746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 648/1369] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:58 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:58.228375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-66875d2c-76a9-4154-a1be-d57b3beacdc5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:58.229286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-66875d2c-76a9-4154-a1be-d57b3beacdc5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:58.234909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66875d2c-76a9-4154-a1be-d57b3beacdc5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:58.235361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66875d2c-76a9-4154-a1be-d57b3beacdc5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:58.236169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66875d2c-76a9-4154-a1be-d57b3beacdc5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:58.236619 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-66875d2c-76a9-4154-a1be-d57b3beacdc5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:58.265468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-66875d2c-76a9-4154-a1be-d57b3beacdc5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040635 May 12 07:08:58.265955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 649/1370] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:58 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:58.270514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c6dfbc4c-4fbf-4e78-a7c6-69b10e044054 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:58.271402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c6dfbc4c-4fbf-4e78-a7c6-69b10e044054 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:58.276632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6dfbc4c-4fbf-4e78-a7c6-69b10e044054 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:58.277090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6dfbc4c-4fbf-4e78-a7c6-69b10e044054 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:58.277858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6dfbc4c-4fbf-4e78-a7c6-69b10e044054 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:58.278325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6dfbc4c-4fbf-4e78-a7c6-69b10e044054 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:58.306142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c6dfbc4c-4fbf-4e78-a7c6-69b10e044054 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039248 May 12 07:08:58.306679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 650/1371] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:59.239644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-05e8c260-c16c-439c-b575-87057fbc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:59.240303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-05e8c260-c16c-439c-b575-87057fbc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:59.246399 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-05e8c260-c16c-439c-b575-87057fbc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:59.247725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-05e8c260-c16c-439c-b575-87057fbc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:59.248908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-05e8c260-c16c-439c-b575-87057fbc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:59.249530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-05e8c260-c16c-439c-b575-87057fbc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:59.308968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-05e8c260-c16c-439c-b575-87057fbc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:08:59.316769 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-05e8c260-c16c-439c-b575-87057fbc3e15 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081061 May 12 07:08:59.317322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 651/1372] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:08:59 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:08:59.321860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-63d9813a-52bf-4abf-81de-aeeeeba3dd23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:59.322756 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-63d9813a-52bf-4abf-81de-aeeeeba3dd23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:59.328179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-63d9813a-52bf-4abf-81de-aeeeeba3dd23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:59.328625 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-63d9813a-52bf-4abf-81de-aeeeeba3dd23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:59.329385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-63d9813a-52bf-4abf-81de-aeeeeba3dd23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:59.329823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-63d9813a-52bf-4abf-81de-aeeeeba3dd23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:59.357430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-63d9813a-52bf-4abf-81de-aeeeeba3dd23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039156 May 12 07:08:59.357963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 652/1373] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:59 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:08:59.362403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-de22bae0-b1e2-4e0f-ae8c-2f491af3aa1f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:08:59.363276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-de22bae0-b1e2-4e0f-ae8c-2f491af3aa1f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:08:59.368517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de22bae0-b1e2-4e0f-ae8c-2f491af3aa1f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:59.368967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de22bae0-b1e2-4e0f-ae8c-2f491af3aa1f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:59.369721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de22bae0-b1e2-4e0f-ae8c-2f491af3aa1f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:08:59.370145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de22bae0-b1e2-4e0f-ae8c-2f491af3aa1f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:08:59.397527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-de22bae0-b1e2-4e0f-ae8c-2f491af3aa1f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038636 May 12 07:08:59.398062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 653/1374] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:08:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:00.333626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-68de0e30-ee4b-4d61-ab75-f303f1da7efd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:00.334285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-68de0e30-ee4b-4d61-ab75-f303f1da7efd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:00.340963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68de0e30-ee4b-4d61-ab75-f303f1da7efd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:00.341430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68de0e30-ee4b-4d61-ab75-f303f1da7efd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:00.342191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68de0e30-ee4b-4d61-ab75-f303f1da7efd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:00.342628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68de0e30-ee4b-4d61-ab75-f303f1da7efd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:00.401598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-68de0e30-ee4b-4d61-ab75-f303f1da7efd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:00.409391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-68de0e30-ee4b-4d61-ab75-f303f1da7efd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079762 May 12 07:09:00.409951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 654/1375] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:00 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:00.414536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3f691757-d48d-4f14-8214-e2f077e85f65 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:00.415433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3f691757-d48d-4f14-8214-e2f077e85f65 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:00.421466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f691757-d48d-4f14-8214-e2f077e85f65 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:00.421913 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f691757-d48d-4f14-8214-e2f077e85f65 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:00.422675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f691757-d48d-4f14-8214-e2f077e85f65 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:00.423109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f691757-d48d-4f14-8214-e2f077e85f65 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:00.450490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3f691757-d48d-4f14-8214-e2f077e85f65 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039541 May 12 07:09:00.451021 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 655/1376] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:00 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:00.456638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-65f32d3f-048e-4a96-86b4-573e8da0de72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:00.457506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-65f32d3f-048e-4a96-86b4-573e8da0de72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:00.462715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65f32d3f-048e-4a96-86b4-573e8da0de72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:00.463158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65f32d3f-048e-4a96-86b4-573e8da0de72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:00.463949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65f32d3f-048e-4a96-86b4-573e8da0de72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:00.464370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65f32d3f-048e-4a96-86b4-573e8da0de72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:00.493639 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-65f32d3f-048e-4a96-86b4-573e8da0de72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041627 May 12 07:09:00.494180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 656/1377] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:01.426110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-db90e43e-6383-4bbd-afc0-087b6df1f8db tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:01.426778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-db90e43e-6383-4bbd-afc0-087b6df1f8db tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:01.433036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db90e43e-6383-4bbd-afc0-087b6df1f8db tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:01.433481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db90e43e-6383-4bbd-afc0-087b6df1f8db tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:01.434892 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db90e43e-6383-4bbd-afc0-087b6df1f8db tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:01.435329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db90e43e-6383-4bbd-afc0-087b6df1f8db tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:01.497980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-db90e43e-6383-4bbd-afc0-087b6df1f8db tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:01.505494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-db90e43e-6383-4bbd-afc0-087b6df1f8db tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083481 May 12 07:09:01.506079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 657/1378] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:01 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:01.510491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-af7127f9-c50e-4bee-a032-34ebd3538ef9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:01.511391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-af7127f9-c50e-4bee-a032-34ebd3538ef9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:01.516735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af7127f9-c50e-4bee-a032-34ebd3538ef9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:01.517174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af7127f9-c50e-4bee-a032-34ebd3538ef9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:01.517931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af7127f9-c50e-4bee-a032-34ebd3538ef9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:01.518366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af7127f9-c50e-4bee-a032-34ebd3538ef9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:01.546243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-af7127f9-c50e-4bee-a032-34ebd3538ef9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039149 May 12 07:09:01.546802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 658/1379] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:01 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:01.551581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ef3a0923-b2e2-4571-b9be-d372876beeee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:01.552486 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ef3a0923-b2e2-4571-b9be-d372876beeee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:01.557755 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef3a0923-b2e2-4571-b9be-d372876beeee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:01.558202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef3a0923-b2e2-4571-b9be-d372876beeee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:01.558965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef3a0923-b2e2-4571-b9be-d372876beeee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:01.560328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef3a0923-b2e2-4571-b9be-d372876beeee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:01.587555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ef3a0923-b2e2-4571-b9be-d372876beeee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039837 May 12 07:09:01.588111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 659/1380] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:02.522118 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c713c9e9-15eb-404f-9b82-2ad517464dbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:02.522768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c713c9e9-15eb-404f-9b82-2ad517464dbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:02.529716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c713c9e9-15eb-404f-9b82-2ad517464dbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:02.530193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c713c9e9-15eb-404f-9b82-2ad517464dbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:02.530991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c713c9e9-15eb-404f-9b82-2ad517464dbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:02.531427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c713c9e9-15eb-404f-9b82-2ad517464dbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:02.590763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c713c9e9-15eb-404f-9b82-2ad517464dbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:02.598141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c713c9e9-15eb-404f-9b82-2ad517464dbe tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079831 May 12 07:09:02.598693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 660/1381] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:02 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:02.603423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ae328a1e-078e-4af0-b188-758208d5141a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:02.604370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ae328a1e-078e-4af0-b188-758208d5141a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:02.610346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ae328a1e-078e-4af0-b188-758208d5141a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:02.610788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ae328a1e-078e-4af0-b188-758208d5141a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:02.611549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ae328a1e-078e-4af0-b188-758208d5141a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:02.612006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ae328a1e-078e-4af0-b188-758208d5141a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:02.639126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ae328a1e-078e-4af0-b188-758208d5141a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039479 May 12 07:09:02.639669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 661/1382] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:02 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:02.644179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-992b1901-db80-4f42-a366-62f456cb5024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:02.645053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-992b1901-db80-4f42-a366-62f456cb5024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:02.650300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-992b1901-db80-4f42-a366-62f456cb5024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:02.650745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-992b1901-db80-4f42-a366-62f456cb5024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:02.651497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-992b1901-db80-4f42-a366-62f456cb5024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:02.651952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-992b1901-db80-4f42-a366-62f456cb5024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:02.685076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-992b1901-db80-4f42-a366-62f456cb5024 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 May 12 07:09:02.685661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 662/1383] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:03.615297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e585c04c-a7d6-437c-bbf5-930256e9cede tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:03.615972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e585c04c-a7d6-437c-bbf5-930256e9cede tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:03.622116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e585c04c-a7d6-437c-bbf5-930256e9cede tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:03.622559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e585c04c-a7d6-437c-bbf5-930256e9cede tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:03.623332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e585c04c-a7d6-437c-bbf5-930256e9cede tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:03.623770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e585c04c-a7d6-437c-bbf5-930256e9cede tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:03.686906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e585c04c-a7d6-437c-bbf5-930256e9cede tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:03.692501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e585c04c-a7d6-437c-bbf5-930256e9cede tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080996 May 12 07:09:03.693050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 663/1384] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:03 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:03.697447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-61026364-463a-4673-b847-e2866fce5735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:09:03.698351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-61026364-463a-4673-b847-e2866fce5735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:03.705509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61026364-463a-4673-b847-e2866fce5735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:03.706079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61026364-463a-4673-b847-e2866fce5735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:03.707018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61026364-463a-4673-b847-e2866fce5735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:03.707553 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61026364-463a-4673-b847-e2866fce5735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:03.789488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-61026364-463a-4673-b847-e2866fce5735 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "POST /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/action" status: 200 len: 76266 microversion: 2.1 time: 0.095261 May 12 07:09:03.790124 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 664/1385] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 07:09:03 2022] POST /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af/action => generated 76266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:09:03.795105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-458d3372-6ff8-4165-bffe-0b8fbe739b75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:03.796123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-458d3372-6ff8-4165-bffe-0b8fbe739b75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:03.803177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-458d3372-6ff8-4165-bffe-0b8fbe739b75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:03.803624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-458d3372-6ff8-4165-bffe-0b8fbe739b75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:03.804424 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-458d3372-6ff8-4165-bffe-0b8fbe739b75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:03.804867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-458d3372-6ff8-4165-bffe-0b8fbe739b75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:03.833811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-458d3372-6ff8-4165-bffe-0b8fbe739b75 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042517 May 12 07:09:03.834289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 665/1386] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:04.709506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c6d2019d-9fd4-4999-a60f-caf145e1773f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:04.710208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c6d2019d-9fd4-4999-a60f-caf145e1773f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:04.716937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6d2019d-9fd4-4999-a60f-caf145e1773f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:04.717378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6d2019d-9fd4-4999-a60f-caf145e1773f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:04.718139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6d2019d-9fd4-4999-a60f-caf145e1773f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:04.718570 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6d2019d-9fd4-4999-a60f-caf145e1773f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:04.778849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c6d2019d-9fd4-4999-a60f-caf145e1773f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:04.786139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c6d2019d-9fd4-4999-a60f-caf145e1773f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080479 May 12 07:09:04.786700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 666/1387] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:04.845168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b7c6b5a5-c6db-4b55-bf6c-24409d0d27ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:04.846207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b7c6b5a5-c6db-4b55-bf6c-24409d0d27ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:04.852461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7c6b5a5-c6db-4b55-bf6c-24409d0d27ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:04.852917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7c6b5a5-c6db-4b55-bf6c-24409d0d27ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:04.853696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7c6b5a5-c6db-4b55-bf6c-24409d0d27ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:04.854133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7c6b5a5-c6db-4b55-bf6c-24409d0d27ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:04.882871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b7c6b5a5-c6db-4b55-bf6c-24409d0d27ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041589 May 12 07:09:04.883428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 667/1388] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:09:05.803193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a6841853-a105-41b4-94e5-6d17854f0120 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:05.803828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a6841853-a105-41b4-94e5-6d17854f0120 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:05.810504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6841853-a105-41b4-94e5-6d17854f0120 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:05.810956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6841853-a105-41b4-94e5-6d17854f0120 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:05.811756 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6841853-a105-41b4-94e5-6d17854f0120 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:05.812200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6841853-a105-41b4-94e5-6d17854f0120 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:05.874141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a6841853-a105-41b4-94e5-6d17854f0120 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:05.881541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a6841853-a105-41b4-94e5-6d17854f0120 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082586 May 12 07:09:05.882096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 668/1389] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:05 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:05.893723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2a9f7b05-c8b7-45a4-a999-3de1b78da9ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:05.894630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2a9f7b05-c8b7-45a4-a999-3de1b78da9ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:05.900139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a9f7b05-c8b7-45a4-a999-3de1b78da9ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:05.900591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a9f7b05-c8b7-45a4-a999-3de1b78da9ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:05.901361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a9f7b05-c8b7-45a4-a999-3de1b78da9ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:05.901800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a9f7b05-c8b7-45a4-a999-3de1b78da9ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:05.931023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2a9f7b05-c8b7-45a4-a999-3de1b78da9ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040795 May 12 07:09:05.931584 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 669/1390] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:09:06.898487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a9428778-f811-4dd3-952e-258152d2c0b1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:06.908959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a9428778-f811-4dd3-952e-258152d2c0b1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:06.908959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9428778-f811-4dd3-952e-258152d2c0b1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:06.908959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9428778-f811-4dd3-952e-258152d2c0b1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:06.908959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9428778-f811-4dd3-952e-258152d2c0b1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:06.909345 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a9428778-f811-4dd3-952e-258152d2c0b1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:06.968512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a9428778-f811-4dd3-952e-258152d2c0b1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:06.975763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a9428778-f811-4dd3-952e-258152d2c0b1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081114 May 12 07:09:06.976316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 670/1391] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:06 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:06.980891 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0e3a0f1c-017d-4e3e-b6ba-d79536b94490 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:06.981821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0e3a0f1c-017d-4e3e-b6ba-d79536b94490 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:06.987662 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e3a0f1c-017d-4e3e-b6ba-d79536b94490 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:06.988144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e3a0f1c-017d-4e3e-b6ba-d79536b94490 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:06.988945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e3a0f1c-017d-4e3e-b6ba-d79536b94490 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:06.989378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e3a0f1c-017d-4e3e-b6ba-d79536b94490 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:07.017967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0e3a0f1c-017d-4e3e-b6ba-d79536b94490 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040677 May 12 07:09:07.018512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 671/1392] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:07.992507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0a076298-51ce-4ed9-a2c1-e4a757e9967d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:07.993126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0a076298-51ce-4ed9-a2c1-e4a757e9967d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:07.999530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a076298-51ce-4ed9-a2c1-e4a757e9967d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:08.000017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a076298-51ce-4ed9-a2c1-e4a757e9967d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:08.000793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a076298-51ce-4ed9-a2c1-e4a757e9967d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:08.001258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a076298-51ce-4ed9-a2c1-e4a757e9967d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:08.063539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0a076298-51ce-4ed9-a2c1-e4a757e9967d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:08.070859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0a076298-51ce-4ed9-a2c1-e4a757e9967d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082278 May 12 07:09:08.071427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 672/1393] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:07 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:08.076153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c62e63f1-2c5e-4c1d-8888-7b7708f2406d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:08.077079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c62e63f1-2c5e-4c1d-8888-7b7708f2406d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:08.082543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c62e63f1-2c5e-4c1d-8888-7b7708f2406d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:08.082994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c62e63f1-2c5e-4c1d-8888-7b7708f2406d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:08.083799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c62e63f1-2c5e-4c1d-8888-7b7708f2406d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:08.084240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c62e63f1-2c5e-4c1d-8888-7b7708f2406d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:08.112612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c62e63f1-2c5e-4c1d-8888-7b7708f2406d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039933 May 12 07:09:08.113136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 673/1394] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:09.087302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1394db9d-12a9-4ff7-8558-5edfd25e8bff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:09.088000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1394db9d-12a9-4ff7-8558-5edfd25e8bff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:09.094948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1394db9d-12a9-4ff7-8558-5edfd25e8bff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:09.095397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1394db9d-12a9-4ff7-8558-5edfd25e8bff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:09.096209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1394db9d-12a9-4ff7-8558-5edfd25e8bff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:09.096646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1394db9d-12a9-4ff7-8558-5edfd25e8bff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:09.156100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1394db9d-12a9-4ff7-8558-5edfd25e8bff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:09.163356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1394db9d-12a9-4ff7-8558-5edfd25e8bff tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079885 May 12 07:09:09.163958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 674/1395] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:09 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:09.168474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1d3d34af-45d9-453e-984d-c458f33c6f47 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:09.169378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1d3d34af-45d9-453e-984d-c458f33c6f47 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:09.175280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d3d34af-45d9-453e-984d-c458f33c6f47 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:09.175761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d3d34af-45d9-453e-984d-c458f33c6f47 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:09.176544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d3d34af-45d9-453e-984d-c458f33c6f47 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:09.176987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d3d34af-45d9-453e-984d-c458f33c6f47 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:09.205392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1d3d34af-45d9-453e-984d-c458f33c6f47 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040431 May 12 07:09:09.205951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 675/1396] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:10.180264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8e50d016-3132-46d6-ae9b-668295cd9827 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:10.180882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8e50d016-3132-46d6-ae9b-668295cd9827 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:10.187625 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e50d016-3132-46d6-ae9b-668295cd9827 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:10.188141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e50d016-3132-46d6-ae9b-668295cd9827 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:10.188921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e50d016-3132-46d6-ae9b-668295cd9827 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:10.189364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e50d016-3132-46d6-ae9b-668295cd9827 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:10.252549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8e50d016-3132-46d6-ae9b-668295cd9827 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:10.259958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8e50d016-3132-46d6-ae9b-668295cd9827 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083654 May 12 07:09:10.260517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 676/1397] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:10 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:10.265621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f1ad51f3-3c07-4243-877c-014a7691c196 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:10.266521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f1ad51f3-3c07-4243-877c-014a7691c196 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:10.271932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f1ad51f3-3c07-4243-877c-014a7691c196 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:10.272379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f1ad51f3-3c07-4243-877c-014a7691c196 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:10.273142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f1ad51f3-3c07-4243-877c-014a7691c196 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:10.273581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f1ad51f3-3c07-4243-877c-014a7691c196 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:10.300953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f1ad51f3-3c07-4243-877c-014a7691c196 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039496 May 12 07:09:10.301493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 677/1398] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:11.277040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ee849774-fe79-4c8d-b835-d344b23aea22 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:11.278291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ee849774-fe79-4c8d-b835-d344b23aea22 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:11.284658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee849774-fe79-4c8d-b835-d344b23aea22 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:11.285111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee849774-fe79-4c8d-b835-d344b23aea22 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:11.285876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee849774-fe79-4c8d-b835-d344b23aea22 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:11.286313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee849774-fe79-4c8d-b835-d344b23aea22 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:11.345787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ee849774-fe79-4c8d-b835-d344b23aea22 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:11.352955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ee849774-fe79-4c8d-b835-d344b23aea22 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079765 May 12 07:09:11.353507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 678/1399] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:11 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:11.357919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3e141fad-3bfa-44a9-bf52-b5f5bed86e94 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:11.358882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3e141fad-3bfa-44a9-bf52-b5f5bed86e94 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:11.364400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e141fad-3bfa-44a9-bf52-b5f5bed86e94 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:11.364849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e141fad-3bfa-44a9-bf52-b5f5bed86e94 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:11.365616 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e141fad-3bfa-44a9-bf52-b5f5bed86e94 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:11.366052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e141fad-3bfa-44a9-bf52-b5f5bed86e94 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:11.393715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3e141fad-3bfa-44a9-bf52-b5f5bed86e94 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039234 May 12 07:09:11.394261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 679/1400] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:12.369014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5984706e-0096-454f-a3fa-7f78bc07d42e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:12.369643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5984706e-0096-454f-a3fa-7f78bc07d42e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:12.375886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5984706e-0096-454f-a3fa-7f78bc07d42e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:12.376336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5984706e-0096-454f-a3fa-7f78bc07d42e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:12.377139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5984706e-0096-454f-a3fa-7f78bc07d42e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:12.377574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5984706e-0096-454f-a3fa-7f78bc07d42e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:12.438000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5984706e-0096-454f-a3fa-7f78bc07d42e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:12.445149 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5984706e-0096-454f-a3fa-7f78bc07d42e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080047 May 12 07:09:12.445708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 680/1401] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:12 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:12.450193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7eb080e6-6792-47e7-b071-e56fd38d8ba1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:12.451105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7eb080e6-6792-47e7-b071-e56fd38d8ba1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:12.456799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7eb080e6-6792-47e7-b071-e56fd38d8ba1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:12.457251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7eb080e6-6792-47e7-b071-e56fd38d8ba1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:12.458029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7eb080e6-6792-47e7-b071-e56fd38d8ba1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:12.458466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7eb080e6-6792-47e7-b071-e56fd38d8ba1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:12.486821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7eb080e6-6792-47e7-b071-e56fd38d8ba1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040165 May 12 07:09:12.487366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 681/1402] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:12 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:13.461805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2073adf5-6336-491d-8d1a-0d07699216c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:13.462429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2073adf5-6336-491d-8d1a-0d07699216c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:13.469675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2073adf5-6336-491d-8d1a-0d07699216c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:13.470126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2073adf5-6336-491d-8d1a-0d07699216c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:13.470902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2073adf5-6336-491d-8d1a-0d07699216c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:13.471388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2073adf5-6336-491d-8d1a-0d07699216c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:13.530923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2073adf5-6336-491d-8d1a-0d07699216c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:13.538177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2073adf5-6336-491d-8d1a-0d07699216c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080226 May 12 07:09:13.538742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 682/1403] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:13 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:13.543221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ea4f29d2-23fe-44dc-b88b-79e9b7ce026b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:13.544160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ea4f29d2-23fe-44dc-b88b-79e9b7ce026b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:13.549838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ea4f29d2-23fe-44dc-b88b-79e9b7ce026b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:13.550287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ea4f29d2-23fe-44dc-b88b-79e9b7ce026b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:13.551083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ea4f29d2-23fe-44dc-b88b-79e9b7ce026b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:13.551527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ea4f29d2-23fe-44dc-b88b-79e9b7ce026b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:13.579673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ea4f29d2-23fe-44dc-b88b-79e9b7ce026b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039979 May 12 07:09:13.580238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 683/1404] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:14.555286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f83085d6-4536-43b2-a4dd-96dbf89692bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:14.556043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f83085d6-4536-43b2-a4dd-96dbf89692bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:14.561885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f83085d6-4536-43b2-a4dd-96dbf89692bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:14.562327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f83085d6-4536-43b2-a4dd-96dbf89692bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:14.563092 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f83085d6-4536-43b2-a4dd-96dbf89692bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:14.563523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f83085d6-4536-43b2-a4dd-96dbf89692bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:14.626023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f83085d6-4536-43b2-a4dd-96dbf89692bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:14.633372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f83085d6-4536-43b2-a4dd-96dbf89692bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081945 May 12 07:09:14.633923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 684/1405] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:14 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:14.638444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-994402dd-2b08-404f-a93f-ecd9800e0ef4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:14.641619 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-994402dd-2b08-404f-a93f-ecd9800e0ef4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:14.644771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-994402dd-2b08-404f-a93f-ecd9800e0ef4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:14.645214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-994402dd-2b08-404f-a93f-ecd9800e0ef4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:14.645972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-994402dd-2b08-404f-a93f-ecd9800e0ef4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:14.646405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-994402dd-2b08-404f-a93f-ecd9800e0ef4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:14.675514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-994402dd-2b08-404f-a93f-ecd9800e0ef4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040620 May 12 07:09:14.676081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 685/1406] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:15.649418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c8524e02-49be-4c2b-abbf-e1e5dfd5e197 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:15.650088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c8524e02-49be-4c2b-abbf-e1e5dfd5e197 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:15.656828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8524e02-49be-4c2b-abbf-e1e5dfd5e197 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:15.657275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8524e02-49be-4c2b-abbf-e1e5dfd5e197 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:15.658036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8524e02-49be-4c2b-abbf-e1e5dfd5e197 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:15.658466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8524e02-49be-4c2b-abbf-e1e5dfd5e197 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:15.719171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c8524e02-49be-4c2b-abbf-e1e5dfd5e197 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:15.726526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c8524e02-49be-4c2b-abbf-e1e5dfd5e197 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080959 May 12 07:09:15.727088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 686/1407] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:15 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:15.731763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-df3e2408-b3e9-4d54-8831-6de85c644f31 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:15.732796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-df3e2408-b3e9-4d54-8831-6de85c644f31 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:15.738187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df3e2408-b3e9-4d54-8831-6de85c644f31 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:15.738642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df3e2408-b3e9-4d54-8831-6de85c644f31 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:15.739412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df3e2408-b3e9-4d54-8831-6de85c644f31 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:15.739886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df3e2408-b3e9-4d54-8831-6de85c644f31 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:15.767655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-df3e2408-b3e9-4d54-8831-6de85c644f31 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039613 May 12 07:09:15.768215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 687/1408] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:16.743238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-733b411c-b28a-4a50-81fd-0ad5f1ea31d8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:16.743943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-733b411c-b28a-4a50-81fd-0ad5f1ea31d8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:16.750883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-733b411c-b28a-4a50-81fd-0ad5f1ea31d8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:16.751370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-733b411c-b28a-4a50-81fd-0ad5f1ea31d8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:16.752183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-733b411c-b28a-4a50-81fd-0ad5f1ea31d8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:16.752626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-733b411c-b28a-4a50-81fd-0ad5f1ea31d8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:16.813535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-733b411c-b28a-4a50-81fd-0ad5f1ea31d8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:16.820806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-733b411c-b28a-4a50-81fd-0ad5f1ea31d8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081543 May 12 07:09:16.821378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 688/1409] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:16 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:16.825867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2c062d76-e5c8-4a98-bcca-256431751117 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:16.826764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2c062d76-e5c8-4a98-bcca-256431751117 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:16.832181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c062d76-e5c8-4a98-bcca-256431751117 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:16.832634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c062d76-e5c8-4a98-bcca-256431751117 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:16.833409 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c062d76-e5c8-4a98-bcca-256431751117 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:16.833851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c062d76-e5c8-4a98-bcca-256431751117 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:16.862659 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2c062d76-e5c8-4a98-bcca-256431751117 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040318 May 12 07:09:16.863212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 689/1410] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:17.837376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3db8f9ea-3e4b-40df-a0fb-cf245dcf46bc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:17.838038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3db8f9ea-3e4b-40df-a0fb-cf245dcf46bc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:17.844701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3db8f9ea-3e4b-40df-a0fb-cf245dcf46bc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:17.845155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3db8f9ea-3e4b-40df-a0fb-cf245dcf46bc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:17.845919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3db8f9ea-3e4b-40df-a0fb-cf245dcf46bc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:17.846355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3db8f9ea-3e4b-40df-a0fb-cf245dcf46bc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:17.906388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3db8f9ea-3e4b-40df-a0fb-cf245dcf46bc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:17.913764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3db8f9ea-3e4b-40df-a0fb-cf245dcf46bc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080222 May 12 07:09:17.914331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 690/1411] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:17 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:17.918791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-11eb3719-a54c-4781-b322-1795b7a56acc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:17.919712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-11eb3719-a54c-4781-b322-1795b7a56acc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:17.925695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11eb3719-a54c-4781-b322-1795b7a56acc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:17.926141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11eb3719-a54c-4781-b322-1795b7a56acc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:17.926963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11eb3719-a54c-4781-b322-1795b7a56acc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:17.927400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11eb3719-a54c-4781-b322-1795b7a56acc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:17.955277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-11eb3719-a54c-4781-b322-1795b7a56acc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039958 May 12 07:09:17.955841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 691/1412] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:17 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:18.930155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0f76d523-38a8-494d-98fd-dc063f734d21 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:18.930819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0f76d523-38a8-494d-98fd-dc063f734d21 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:18.937662 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f76d523-38a8-494d-98fd-dc063f734d21 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:18.938104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f76d523-38a8-494d-98fd-dc063f734d21 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:18.938871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f76d523-38a8-494d-98fd-dc063f734d21 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:18.939311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f76d523-38a8-494d-98fd-dc063f734d21 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:19.002336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0f76d523-38a8-494d-98fd-dc063f734d21 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:19.009728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0f76d523-38a8-494d-98fd-dc063f734d21 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083476 May 12 07:09:19.010291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 692/1413] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:18 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:19.014855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3dbe17ba-c80b-4bac-96ba-eda13b8a377f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:19.015786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3dbe17ba-c80b-4bac-96ba-eda13b8a377f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:19.021437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dbe17ba-c80b-4bac-96ba-eda13b8a377f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:19.021885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dbe17ba-c80b-4bac-96ba-eda13b8a377f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:19.022678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dbe17ba-c80b-4bac-96ba-eda13b8a377f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:19.023116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dbe17ba-c80b-4bac-96ba-eda13b8a377f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:19.051861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3dbe17ba-c80b-4bac-96ba-eda13b8a377f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040581 May 12 07:09:19.052415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 693/1414] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:20.026225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-57ece947-97a7-47ae-95bd-f1a14b973498 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:20.026852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-57ece947-97a7-47ae-95bd-f1a14b973498 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:20.033632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57ece947-97a7-47ae-95bd-f1a14b973498 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:20.034084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57ece947-97a7-47ae-95bd-f1a14b973498 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:20.034857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57ece947-97a7-47ae-95bd-f1a14b973498 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:20.035294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57ece947-97a7-47ae-95bd-f1a14b973498 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:20.094987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-57ece947-97a7-47ae-95bd-f1a14b973498 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:20.102327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-57ece947-97a7-47ae-95bd-f1a14b973498 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079993 May 12 07:09:20.102916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 694/1415] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:20 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:20.107934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c292a7cf-8edc-4342-ae2c-4383c1045453 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:20.108845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c292a7cf-8edc-4342-ae2c-4383c1045453 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:20.114185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c292a7cf-8edc-4342-ae2c-4383c1045453 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:20.114631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c292a7cf-8edc-4342-ae2c-4383c1045453 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:20.115412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c292a7cf-8edc-4342-ae2c-4383c1045453 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:20.115872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c292a7cf-8edc-4342-ae2c-4383c1045453 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:20.143721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c292a7cf-8edc-4342-ae2c-4383c1045453 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039821 May 12 07:09:20.144259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 695/1416] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:20 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:21.119509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5e395365-3c68-48d8-aa66-5f1f164d7935 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:21.120141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5e395365-3c68-48d8-aa66-5f1f164d7935 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:21.127050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e395365-3c68-48d8-aa66-5f1f164d7935 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:21.131325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e395365-3c68-48d8-aa66-5f1f164d7935 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:21.131325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e395365-3c68-48d8-aa66-5f1f164d7935 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:21.131325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e395365-3c68-48d8-aa66-5f1f164d7935 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:21.194262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5e395365-3c68-48d8-aa66-5f1f164d7935 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:21.201585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5e395365-3c68-48d8-aa66-5f1f164d7935 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.085932 May 12 07:09:21.202152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 696/1417] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:21 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:21.206565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dcfdd116-36c7-422f-92cb-b03deaf95b9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:21.207462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dcfdd116-36c7-422f-92cb-b03deaf95b9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:21.212803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dcfdd116-36c7-422f-92cb-b03deaf95b9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:21.213254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dcfdd116-36c7-422f-92cb-b03deaf95b9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:21.214027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dcfdd116-36c7-422f-92cb-b03deaf95b9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:21.214467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dcfdd116-36c7-422f-92cb-b03deaf95b9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:21.242411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dcfdd116-36c7-422f-92cb-b03deaf95b9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039314 May 12 07:09:21.242946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 697/1418] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:21 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:22.218267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4701512d-b80c-41fe-b88e-5ca77bb47fe3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:22.218894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4701512d-b80c-41fe-b88e-5ca77bb47fe3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:22.225183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4701512d-b80c-41fe-b88e-5ca77bb47fe3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:22.225629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4701512d-b80c-41fe-b88e-5ca77bb47fe3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:22.226443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4701512d-b80c-41fe-b88e-5ca77bb47fe3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:22.226886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4701512d-b80c-41fe-b88e-5ca77bb47fe3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:22.286195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4701512d-b80c-41fe-b88e-5ca77bb47fe3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:22.293386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4701512d-b80c-41fe-b88e-5ca77bb47fe3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079017 May 12 07:09:22.293942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 698/1419] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:22 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:22.298434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8f9f21c4-39c8-4990-8922-f8d9d64a0c55 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:22.299584 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8f9f21c4-39c8-4990-8922-f8d9d64a0c55 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:22.305141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f9f21c4-39c8-4990-8922-f8d9d64a0c55 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:22.305592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f9f21c4-39c8-4990-8922-f8d9d64a0c55 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:22.306361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f9f21c4-39c8-4990-8922-f8d9d64a0c55 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:22.306797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f9f21c4-39c8-4990-8922-f8d9d64a0c55 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:22.335132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8f9f21c4-39c8-4990-8922-f8d9d64a0c55 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040179 May 12 07:09:22.335699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 699/1420] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:23.310610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-62291daa-a7bc-4bcf-99be-e770ce1ccf55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:23.311229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-62291daa-a7bc-4bcf-99be-e770ce1ccf55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:23.317457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-62291daa-a7bc-4bcf-99be-e770ce1ccf55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:23.317929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-62291daa-a7bc-4bcf-99be-e770ce1ccf55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:23.318692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-62291daa-a7bc-4bcf-99be-e770ce1ccf55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:23.319124 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-62291daa-a7bc-4bcf-99be-e770ce1ccf55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:23.380763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-62291daa-a7bc-4bcf-99be-e770ce1ccf55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:23.387925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-62291daa-a7bc-4bcf-99be-e770ce1ccf55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081680 May 12 07:09:23.388484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 700/1421] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:23 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:23.502872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1ae31f64-21ef-4880-a5d8-543aa3b49d50 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:23.503881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1ae31f64-21ef-4880-a5d8-543aa3b49d50 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:23.509667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ae31f64-21ef-4880-a5d8-543aa3b49d50 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:23.510110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ae31f64-21ef-4880-a5d8-543aa3b49d50 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:23.510871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ae31f64-21ef-4880-a5d8-543aa3b49d50 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:23.511313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ae31f64-21ef-4880-a5d8-543aa3b49d50 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:23.538944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1ae31f64-21ef-4880-a5d8-543aa3b49d50 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149483 May 12 07:09:23.539483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 701/1422] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:24.509725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a8470718-1254-4e32-9a07-b338429ba695 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:24.510349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a8470718-1254-4e32-9a07-b338429ba695 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:24.516128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8470718-1254-4e32-9a07-b338429ba695 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:24.516580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8470718-1254-4e32-9a07-b338429ba695 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:24.520137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8470718-1254-4e32-9a07-b338429ba695 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:24.520137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8470718-1254-4e32-9a07-b338429ba695 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:24.577107 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a8470718-1254-4e32-9a07-b338429ba695 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:24.584437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a8470718-1254-4e32-9a07-b338429ba695 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.183860 May 12 07:09:24.584999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 702/1423] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:24 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:24.589508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e51bb663-c01e-47c2-8932-fad45c43505c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:24.590417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e51bb663-c01e-47c2-8932-fad45c43505c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:24.596511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e51bb663-c01e-47c2-8932-fad45c43505c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:24.596964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e51bb663-c01e-47c2-8932-fad45c43505c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:24.597735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e51bb663-c01e-47c2-8932-fad45c43505c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:24.598176 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e51bb663-c01e-47c2-8932-fad45c43505c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:24.626755 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e51bb663-c01e-47c2-8932-fad45c43505c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040754 May 12 07:09:24.627310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 703/1424] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:25.601428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dd04316f-5f36-4312-a217-5a158c67a008 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:25.602171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dd04316f-5f36-4312-a217-5a158c67a008 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:25.609010 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd04316f-5f36-4312-a217-5a158c67a008 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:25.609462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd04316f-5f36-4312-a217-5a158c67a008 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:25.610225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd04316f-5f36-4312-a217-5a158c67a008 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:25.610657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd04316f-5f36-4312-a217-5a158c67a008 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:25.671776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dd04316f-5f36-4312-a217-5a158c67a008 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:25.679358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dd04316f-5f36-4312-a217-5a158c67a008 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081781 May 12 07:09:25.679948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 704/1425] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:25 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:25.684484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a2969018-0675-4bde-96ca-4406f0c8c743 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:25.686033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a2969018-0675-4bde-96ca-4406f0c8c743 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:25.691399 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2969018-0675-4bde-96ca-4406f0c8c743 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:25.691886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2969018-0675-4bde-96ca-4406f0c8c743 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:25.692652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2969018-0675-4bde-96ca-4406f0c8c743 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:25.693084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2969018-0675-4bde-96ca-4406f0c8c743 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:25.720479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a2969018-0675-4bde-96ca-4406f0c8c743 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039572 May 12 07:09:25.721065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 705/1426] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:26.696493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-85ee8c74-1601-47ea-b4ea-c7ce08aacdb4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:26.697160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-85ee8c74-1601-47ea-b4ea-c7ce08aacdb4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:26.704004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85ee8c74-1601-47ea-b4ea-c7ce08aacdb4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:26.704453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85ee8c74-1601-47ea-b4ea-c7ce08aacdb4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:26.705214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85ee8c74-1601-47ea-b4ea-c7ce08aacdb4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:26.705645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85ee8c74-1601-47ea-b4ea-c7ce08aacdb4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:26.764996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-85ee8c74-1601-47ea-b4ea-c7ce08aacdb4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:26.772221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-85ee8c74-1601-47ea-b4ea-c7ce08aacdb4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079649 May 12 07:09:26.772777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 706/1427] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:26 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:26.777190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3e2142e2-9b48-422f-8c64-0659714173d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:26.778083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3e2142e2-9b48-422f-8c64-0659714173d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:26.783983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e2142e2-9b48-422f-8c64-0659714173d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:26.784427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e2142e2-9b48-422f-8c64-0659714173d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:26.785190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e2142e2-9b48-422f-8c64-0659714173d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:26.785621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e2142e2-9b48-422f-8c64-0659714173d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:26.813445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3e2142e2-9b48-422f-8c64-0659714173d5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039716 May 12 07:09:26.813976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 707/1428] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:27.789539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5bb1bc27-0cbf-41b2-829d-6223645f2bf8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:27.790209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5bb1bc27-0cbf-41b2-829d-6223645f2bf8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:27.796980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bb1bc27-0cbf-41b2-829d-6223645f2bf8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:27.797442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bb1bc27-0cbf-41b2-829d-6223645f2bf8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:27.798212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bb1bc27-0cbf-41b2-829d-6223645f2bf8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:27.798650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bb1bc27-0cbf-41b2-829d-6223645f2bf8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:27.860825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5bb1bc27-0cbf-41b2-829d-6223645f2bf8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:27.868062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5bb1bc27-0cbf-41b2-829d-6223645f2bf8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082367 May 12 07:09:27.868625 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 708/1429] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:27 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:27.873668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0d44260d-d077-4f10-9f23-1cfd8e294c65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:27.879629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0d44260d-d077-4f10-9f23-1cfd8e294c65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:27.879939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d44260d-d077-4f10-9f23-1cfd8e294c65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:27.880389 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d44260d-d077-4f10-9f23-1cfd8e294c65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:27.881150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d44260d-d077-4f10-9f23-1cfd8e294c65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:27.881580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d44260d-d077-4f10-9f23-1cfd8e294c65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:27.908849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0d44260d-d077-4f10-9f23-1cfd8e294c65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039254 May 12 07:09:27.917496 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 709/1430] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:28.885276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-90079f58-ba7e-4286-a886-f6b9e28ebac6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:28.885922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-90079f58-ba7e-4286-a886-f6b9e28ebac6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:28.892279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90079f58-ba7e-4286-a886-f6b9e28ebac6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:28.892735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90079f58-ba7e-4286-a886-f6b9e28ebac6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:28.893546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90079f58-ba7e-4286-a886-f6b9e28ebac6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:28.893987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90079f58-ba7e-4286-a886-f6b9e28ebac6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:28.953838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-90079f58-ba7e-4286-a886-f6b9e28ebac6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:28.961152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-90079f58-ba7e-4286-a886-f6b9e28ebac6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079783 May 12 07:09:28.961722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 710/1431] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:28 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:28.966695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-adb25b7b-9dcd-450b-86a2-f7d81f3eb430 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:28.967600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-adb25b7b-9dcd-450b-86a2-f7d81f3eb430 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:28.973981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-adb25b7b-9dcd-450b-86a2-f7d81f3eb430 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:28.974429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-adb25b7b-9dcd-450b-86a2-f7d81f3eb430 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:28.975790 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-adb25b7b-9dcd-450b-86a2-f7d81f3eb430 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:28.976234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-adb25b7b-9dcd-450b-86a2-f7d81f3eb430 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:29.004767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-adb25b7b-9dcd-450b-86a2-f7d81f3eb430 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042032 May 12 07:09:29.005297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 711/1432] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:29.978395 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2d52c914-88c4-4f33-8bb8-edb3f9f05bc4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:29.979082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2d52c914-88c4-4f33-8bb8-edb3f9f05bc4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:29.985466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d52c914-88c4-4f33-8bb8-edb3f9f05bc4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:29.985924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d52c914-88c4-4f33-8bb8-edb3f9f05bc4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:29.986709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d52c914-88c4-4f33-8bb8-edb3f9f05bc4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:29.987156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d52c914-88c4-4f33-8bb8-edb3f9f05bc4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:30.049097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2d52c914-88c4-4f33-8bb8-edb3f9f05bc4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:30.056364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2d52c914-88c4-4f33-8bb8-edb3f9f05bc4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081866 May 12 07:09:30.056932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 712/1433] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:29 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:30.061620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b2b36a03-12de-4401-92cd-7c3dbbb47799 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:30.062529 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b2b36a03-12de-4401-92cd-7c3dbbb47799 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:30.068190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b2b36a03-12de-4401-92cd-7c3dbbb47799 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:30.068642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b2b36a03-12de-4401-92cd-7c3dbbb47799 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:30.069432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b2b36a03-12de-4401-92cd-7c3dbbb47799 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:30.069898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b2b36a03-12de-4401-92cd-7c3dbbb47799 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:30.098633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b2b36a03-12de-4401-92cd-7c3dbbb47799 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040728 May 12 07:09:30.099211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 713/1434] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:31.073040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c0b1043c-3131-4c4e-8bd5-7999db35be5a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:31.073761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c0b1043c-3131-4c4e-8bd5-7999db35be5a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:31.093800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0b1043c-3131-4c4e-8bd5-7999db35be5a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:31.094256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0b1043c-3131-4c4e-8bd5-7999db35be5a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:31.095706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0b1043c-3131-4c4e-8bd5-7999db35be5a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:31.096157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0b1043c-3131-4c4e-8bd5-7999db35be5a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:31.168420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c0b1043c-3131-4c4e-8bd5-7999db35be5a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:31.177696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c0b1043c-3131-4c4e-8bd5-7999db35be5a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.108564 May 12 07:09:31.187376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 714/1435] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:31 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:31.192573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-31fbe641-1152-41b1-8269-6319887f58e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:31.193620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-31fbe641-1152-41b1-8269-6319887f58e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:31.199840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-31fbe641-1152-41b1-8269-6319887f58e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:31.200302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-31fbe641-1152-41b1-8269-6319887f58e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:31.201152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-31fbe641-1152-41b1-8269-6319887f58e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:31.201597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-31fbe641-1152-41b1-8269-6319887f58e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:31.230819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-31fbe641-1152-41b1-8269-6319887f58e2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042047 May 12 07:09:31.231384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 715/1436] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:32.194208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9217f443-f4d5-417d-959a-66de0431ab9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:32.194846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9217f443-f4d5-417d-959a-66de0431ab9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:32.201039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9217f443-f4d5-417d-959a-66de0431ab9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:32.201492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9217f443-f4d5-417d-959a-66de0431ab9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:32.208214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9217f443-f4d5-417d-959a-66de0431ab9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:32.208214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9217f443-f4d5-417d-959a-66de0431ab9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:32.265508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9217f443-f4d5-417d-959a-66de0431ab9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:32.272779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9217f443-f4d5-417d-959a-66de0431ab9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082404 May 12 07:09:32.273409 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 716/1437] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:32 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:32.277899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-80d65f2b-2832-4a72-afcc-0972a4f4fe3c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:32.278840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-80d65f2b-2832-4a72-afcc-0972a4f4fe3c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:32.284443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80d65f2b-2832-4a72-afcc-0972a4f4fe3c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:32.284900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80d65f2b-2832-4a72-afcc-0972a4f4fe3c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:32.285673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80d65f2b-2832-4a72-afcc-0972a4f4fe3c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:32.286110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80d65f2b-2832-4a72-afcc-0972a4f4fe3c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:32.315552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-80d65f2b-2832-4a72-afcc-0972a4f4fe3c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041135 May 12 07:09:32.316145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 717/1438] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:33.289842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3ffef871-1c72-4b80-af5e-c2aff22977cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:33.290493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3ffef871-1c72-4b80-af5e-c2aff22977cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:33.297424 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ffef871-1c72-4b80-af5e-c2aff22977cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:33.297878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ffef871-1c72-4b80-af5e-c2aff22977cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:33.298908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ffef871-1c72-4b80-af5e-c2aff22977cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:33.299356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ffef871-1c72-4b80-af5e-c2aff22977cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:33.358985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3ffef871-1c72-4b80-af5e-c2aff22977cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:33.366148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3ffef871-1c72-4b80-af5e-c2aff22977cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080201 May 12 07:09:33.366717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 718/1439] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:33 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:33.371110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-73419331-b32c-4401-8c1f-599565cde465 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:33.372041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-73419331-b32c-4401-8c1f-599565cde465 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:33.377380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73419331-b32c-4401-8c1f-599565cde465 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:33.377832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73419331-b32c-4401-8c1f-599565cde465 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:33.378607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73419331-b32c-4401-8c1f-599565cde465 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:33.379046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73419331-b32c-4401-8c1f-599565cde465 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:33.409635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-73419331-b32c-4401-8c1f-599565cde465 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041894 May 12 07:09:33.410238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 719/1440] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:33 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:34.382889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c5b466a8-c829-434e-ae34-7eadb1cb07c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:34.383520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c5b466a8-c829-434e-ae34-7eadb1cb07c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:34.389824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5b466a8-c829-434e-ae34-7eadb1cb07c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:34.390276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5b466a8-c829-434e-ae34-7eadb1cb07c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:34.391055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5b466a8-c829-434e-ae34-7eadb1cb07c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:34.391498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5b466a8-c829-434e-ae34-7eadb1cb07c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:34.456163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c5b466a8-c829-434e-ae34-7eadb1cb07c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:34.463439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c5b466a8-c829-434e-ae34-7eadb1cb07c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084507 May 12 07:09:34.464039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 720/1441] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:34 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:09:34.468498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-408e143c-ebc7-47d2-a950-2903c2c5b9f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:34.469409 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-408e143c-ebc7-47d2-a950-2903c2c5b9f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:34.474879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-408e143c-ebc7-47d2-a950-2903c2c5b9f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:34.475336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-408e143c-ebc7-47d2-a950-2903c2c5b9f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:34.476139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-408e143c-ebc7-47d2-a950-2903c2c5b9f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:34.476582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-408e143c-ebc7-47d2-a950-2903c2c5b9f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:34.505946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-408e143c-ebc7-47d2-a950-2903c2c5b9f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040919 May 12 07:09:34.506503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 721/1442] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:35.480016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a2948f6c-136b-4786-869b-62a30bfea7b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:35.480642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a2948f6c-136b-4786-869b-62a30bfea7b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:35.486815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2948f6c-136b-4786-869b-62a30bfea7b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:35.487262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2948f6c-136b-4786-869b-62a30bfea7b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:35.488058 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2948f6c-136b-4786-869b-62a30bfea7b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:35.488492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2948f6c-136b-4786-869b-62a30bfea7b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:35.547637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a2948f6c-136b-4786-869b-62a30bfea7b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:35.555130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a2948f6c-136b-4786-869b-62a30bfea7b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078975 May 12 07:09:35.555713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 722/1443] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:35 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:35.560104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-11b72cd6-7975-468a-9ed2-a8aa314ca1ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:35.561503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-11b72cd6-7975-468a-9ed2-a8aa314ca1ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:35.566818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11b72cd6-7975-468a-9ed2-a8aa314ca1ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:35.567260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11b72cd6-7975-468a-9ed2-a8aa314ca1ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:35.568058 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11b72cd6-7975-468a-9ed2-a8aa314ca1ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:35.568491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11b72cd6-7975-468a-9ed2-a8aa314ca1ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:35.596330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-11b72cd6-7975-468a-9ed2-a8aa314ca1ad tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039673 May 12 07:09:35.596870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 723/1444] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:35 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:36.572287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3530e9f2-2ee6-4015-a704-85297f052afb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:36.572938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3530e9f2-2ee6-4015-a704-85297f052afb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:36.579598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3530e9f2-2ee6-4015-a704-85297f052afb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:36.580155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3530e9f2-2ee6-4015-a704-85297f052afb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:36.580919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3530e9f2-2ee6-4015-a704-85297f052afb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:36.581352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3530e9f2-2ee6-4015-a704-85297f052afb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:36.641189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3530e9f2-2ee6-4015-a704-85297f052afb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:36.648328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3530e9f2-2ee6-4015-a704-85297f052afb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079950 May 12 07:09:36.648887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 724/1445] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:36 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:36.653357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7248b919-b778-4408-a5d0-099fc6bcfc7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:36.654250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7248b919-b778-4408-a5d0-099fc6bcfc7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:36.660128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7248b919-b778-4408-a5d0-099fc6bcfc7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:36.660579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7248b919-b778-4408-a5d0-099fc6bcfc7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:36.661350 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7248b919-b778-4408-a5d0-099fc6bcfc7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:36.661811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7248b919-b778-4408-a5d0-099fc6bcfc7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:36.689355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7248b919-b778-4408-a5d0-099fc6bcfc7f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039490 May 12 07:09:36.689898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 725/1446] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:37.665574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-984dc67d-3c7b-4c3a-862f-89a03fea9ca6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:37.666232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-984dc67d-3c7b-4c3a-862f-89a03fea9ca6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:37.672594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-984dc67d-3c7b-4c3a-862f-89a03fea9ca6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:37.673048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-984dc67d-3c7b-4c3a-862f-89a03fea9ca6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:37.674084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-984dc67d-3c7b-4c3a-862f-89a03fea9ca6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:37.674525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-984dc67d-3c7b-4c3a-862f-89a03fea9ca6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:37.734147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-984dc67d-3c7b-4c3a-862f-89a03fea9ca6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:37.741542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-984dc67d-3c7b-4c3a-862f-89a03fea9ca6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079772 May 12 07:09:37.742105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 726/1447] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:37 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:37.746574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-df6ee54d-703b-4e6f-aa8b-a1a9105c4454 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:37.747520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-df6ee54d-703b-4e6f-aa8b-a1a9105c4454 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:37.753505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df6ee54d-703b-4e6f-aa8b-a1a9105c4454 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:37.753957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df6ee54d-703b-4e6f-aa8b-a1a9105c4454 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:37.754733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df6ee54d-703b-4e6f-aa8b-a1a9105c4454 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:37.755200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df6ee54d-703b-4e6f-aa8b-a1a9105c4454 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:37.783862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-df6ee54d-703b-4e6f-aa8b-a1a9105c4454 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040757 May 12 07:09:37.784404 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 727/1448] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:38.758292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c21ae7f8-944b-4de3-ac30-93ba47a28278 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:38.758917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c21ae7f8-944b-4de3-ac30-93ba47a28278 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:38.765161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c21ae7f8-944b-4de3-ac30-93ba47a28278 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:38.765607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c21ae7f8-944b-4de3-ac30-93ba47a28278 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:38.766383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c21ae7f8-944b-4de3-ac30-93ba47a28278 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:38.766813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c21ae7f8-944b-4de3-ac30-93ba47a28278 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:38.832051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c21ae7f8-944b-4de3-ac30-93ba47a28278 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:38.839428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c21ae7f8-944b-4de3-ac30-93ba47a28278 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.085596 May 12 07:09:38.840025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 728/1449] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:38 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:38.844542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bfa974f9-bca1-43d2-b64d-5e2108ba54d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:38.845484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bfa974f9-bca1-43d2-b64d-5e2108ba54d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:38.852349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfa974f9-bca1-43d2-b64d-5e2108ba54d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:38.856343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfa974f9-bca1-43d2-b64d-5e2108ba54d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:38.856343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfa974f9-bca1-43d2-b64d-5e2108ba54d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:38.856343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfa974f9-bca1-43d2-b64d-5e2108ba54d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:38.881632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bfa974f9-bca1-43d2-b64d-5e2108ba54d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040651 May 12 07:09:38.882175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 729/1450] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:38 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:39.856468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c43986fe-c291-4b34-b5b9-c23510519cae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:39.858218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c43986fe-c291-4b34-b5b9-c23510519cae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:39.865099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c43986fe-c291-4b34-b5b9-c23510519cae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:39.865544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c43986fe-c291-4b34-b5b9-c23510519cae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:39.866310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c43986fe-c291-4b34-b5b9-c23510519cae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:39.866743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c43986fe-c291-4b34-b5b9-c23510519cae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:40.160678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c43986fe-c291-4b34-b5b9-c23510519cae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:40.168229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c43986fe-c291-4b34-b5b9-c23510519cae tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.315643 May 12 07:09:40.168826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 730/1451] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:39 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:09:40.173253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-676abd5c-ff82-41f3-bfca-2b0eac506bb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:40.175090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-676abd5c-ff82-41f3-bfca-2b0eac506bb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:40.180477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-676abd5c-ff82-41f3-bfca-2b0eac506bb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:40.180922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-676abd5c-ff82-41f3-bfca-2b0eac506bb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:40.181682 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-676abd5c-ff82-41f3-bfca-2b0eac506bb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:40.182113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-676abd5c-ff82-41f3-bfca-2b0eac506bb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:40.209746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-676abd5c-ff82-41f3-bfca-2b0eac506bb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039940 May 12 07:09:40.210294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 731/1452] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:40 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:41.185645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-13b70613-ed57-4e35-9aa5-b55be7418177 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:41.186255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-13b70613-ed57-4e35-9aa5-b55be7418177 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:41.193163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13b70613-ed57-4e35-9aa5-b55be7418177 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:41.193612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13b70613-ed57-4e35-9aa5-b55be7418177 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:41.194378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13b70613-ed57-4e35-9aa5-b55be7418177 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:41.194813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-13b70613-ed57-4e35-9aa5-b55be7418177 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:41.254433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-13b70613-ed57-4e35-9aa5-b55be7418177 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:41.261647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-13b70613-ed57-4e35-9aa5-b55be7418177 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079896 May 12 07:09:41.262211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 732/1453] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:41 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:41.266580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-09cac784-7a32-458b-99f5-a07d0521d9da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:41.267475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-09cac784-7a32-458b-99f5-a07d0521d9da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:41.272787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09cac784-7a32-458b-99f5-a07d0521d9da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:41.273233 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09cac784-7a32-458b-99f5-a07d0521d9da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:41.273995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09cac784-7a32-458b-99f5-a07d0521d9da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:41.274429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09cac784-7a32-458b-99f5-a07d0521d9da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:41.302958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-09cac784-7a32-458b-99f5-a07d0521d9da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039781 May 12 07:09:41.303504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 733/1454] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:41 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:42.278281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ab426285-64cc-4843-bede-3e0208837d28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:42.278880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ab426285-64cc-4843-bede-3e0208837d28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:42.285279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab426285-64cc-4843-bede-3e0208837d28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:42.285716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab426285-64cc-4843-bede-3e0208837d28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:42.286491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab426285-64cc-4843-bede-3e0208837d28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:42.286933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab426285-64cc-4843-bede-3e0208837d28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:42.346499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ab426285-64cc-4843-bede-3e0208837d28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:42.353841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ab426285-64cc-4843-bede-3e0208837d28 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079499 May 12 07:09:42.354419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 734/1455] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:42 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:42.358948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c17a2ad4-4c68-43fa-9a67-27eebd1e85f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:42.359923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c17a2ad4-4c68-43fa-9a67-27eebd1e85f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:42.365382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c17a2ad4-4c68-43fa-9a67-27eebd1e85f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:42.365833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c17a2ad4-4c68-43fa-9a67-27eebd1e85f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:42.366603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c17a2ad4-4c68-43fa-9a67-27eebd1e85f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:42.367043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c17a2ad4-4c68-43fa-9a67-27eebd1e85f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:42.395568 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c17a2ad4-4c68-43fa-9a67-27eebd1e85f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040155 May 12 07:09:42.396156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 735/1456] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:42 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:43.370372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bd897802-6cdc-4953-9f5f-e07962e8043c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:43.370994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bd897802-6cdc-4953-9f5f-e07962e8043c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:43.377171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd897802-6cdc-4953-9f5f-e07962e8043c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:43.377617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd897802-6cdc-4953-9f5f-e07962e8043c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:43.378378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd897802-6cdc-4953-9f5f-e07962e8043c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:43.378817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd897802-6cdc-4953-9f5f-e07962e8043c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:43.440210 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bd897802-6cdc-4953-9f5f-e07962e8043c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:43.447490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bd897802-6cdc-4953-9f5f-e07962e8043c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081075 May 12 07:09:43.448083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 736/1457] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:43 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:43.452484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2e68dc25-e73f-4a77-ad0b-0ec3ce893bb4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:43.453386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2e68dc25-e73f-4a77-ad0b-0ec3ce893bb4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:43.459521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e68dc25-e73f-4a77-ad0b-0ec3ce893bb4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:43.460007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e68dc25-e73f-4a77-ad0b-0ec3ce893bb4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:43.460789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e68dc25-e73f-4a77-ad0b-0ec3ce893bb4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:43.461259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e68dc25-e73f-4a77-ad0b-0ec3ce893bb4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:43.489558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2e68dc25-e73f-4a77-ad0b-0ec3ce893bb4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040520 May 12 07:09:43.490113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 737/1458] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:44.464978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f9834cc5-4492-4c41-8567-0520aed47e07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:44.465608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f9834cc5-4492-4c41-8567-0520aed47e07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:44.472313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9834cc5-4492-4c41-8567-0520aed47e07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:44.472762 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9834cc5-4492-4c41-8567-0520aed47e07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:44.473541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9834cc5-4492-4c41-8567-0520aed47e07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:44.473981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9834cc5-4492-4c41-8567-0520aed47e07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:44.537146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f9834cc5-4492-4c41-8567-0520aed47e07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:44.544635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f9834cc5-4492-4c41-8567-0520aed47e07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083623 May 12 07:09:44.545206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 738/1459] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:44 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:44.550641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ec94873d-210c-4d50-834b-ffcdb37c04ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:44.551553 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ec94873d-210c-4d50-834b-ffcdb37c04ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:44.557163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec94873d-210c-4d50-834b-ffcdb37c04ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:44.559572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec94873d-210c-4d50-834b-ffcdb37c04ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:44.559572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec94873d-210c-4d50-834b-ffcdb37c04ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:44.559572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec94873d-210c-4d50-834b-ffcdb37c04ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:44.586478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ec94873d-210c-4d50-834b-ffcdb37c04ac tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040305 May 12 07:09:44.588262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 739/1460] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:45.561901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-51381993-4a0c-4c70-8b93-5c159ddf6f94 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:45.562558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-51381993-4a0c-4c70-8b93-5c159ddf6f94 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:45.568787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51381993-4a0c-4c70-8b93-5c159ddf6f94 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:45.569267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51381993-4a0c-4c70-8b93-5c159ddf6f94 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:45.570033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51381993-4a0c-4c70-8b93-5c159ddf6f94 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:45.570458 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51381993-4a0c-4c70-8b93-5c159ddf6f94 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:45.629646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-51381993-4a0c-4c70-8b93-5c159ddf6f94 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:45.636786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-51381993-4a0c-4c70-8b93-5c159ddf6f94 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078722 May 12 07:09:45.637341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 740/1461] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:45 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:45.641735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-71d7ab83-680f-4e53-af2c-f551e4f059f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:45.643129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-71d7ab83-680f-4e53-af2c-f551e4f059f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:45.648444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-71d7ab83-680f-4e53-af2c-f551e4f059f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:45.648895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-71d7ab83-680f-4e53-af2c-f551e4f059f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:45.649658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-71d7ab83-680f-4e53-af2c-f551e4f059f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:45.650093 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-71d7ab83-680f-4e53-af2c-f551e4f059f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:45.678369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-71d7ab83-680f-4e53-af2c-f551e4f059f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040059 May 12 07:09:45.678921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 741/1462] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:45 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:46.654042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e877e0ee-e87a-465d-a09f-7d519ad8c9fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:46.654701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e877e0ee-e87a-465d-a09f-7d519ad8c9fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:46.661138 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e877e0ee-e87a-465d-a09f-7d519ad8c9fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:46.661593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e877e0ee-e87a-465d-a09f-7d519ad8c9fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:46.662371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e877e0ee-e87a-465d-a09f-7d519ad8c9fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:46.662813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e877e0ee-e87a-465d-a09f-7d519ad8c9fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:46.723455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e877e0ee-e87a-465d-a09f-7d519ad8c9fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:46.730788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e877e0ee-e87a-465d-a09f-7d519ad8c9fb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080646 May 12 07:09:46.731361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 742/1463] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:46 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:46.735856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-af25a69a-3106-4bcf-86c6-e22681ed9eef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:46.736800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-af25a69a-3106-4bcf-86c6-e22681ed9eef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:46.742279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af25a69a-3106-4bcf-86c6-e22681ed9eef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:46.742743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af25a69a-3106-4bcf-86c6-e22681ed9eef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:46.743520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af25a69a-3106-4bcf-86c6-e22681ed9eef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:46.743998 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af25a69a-3106-4bcf-86c6-e22681ed9eef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:46.774179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-af25a69a-3106-4bcf-86c6-e22681ed9eef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041830 May 12 07:09:46.774738 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 743/1464] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:46 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:47.747396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-18354158-7d9e-4e43-91bd-6f34943e6b49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:47.748165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-18354158-7d9e-4e43-91bd-6f34943e6b49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:47.754378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18354158-7d9e-4e43-91bd-6f34943e6b49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:47.754827 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18354158-7d9e-4e43-91bd-6f34943e6b49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:47.755593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18354158-7d9e-4e43-91bd-6f34943e6b49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:47.756049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18354158-7d9e-4e43-91bd-6f34943e6b49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:47.817012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-18354158-7d9e-4e43-91bd-6f34943e6b49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:47.824299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-18354158-7d9e-4e43-91bd-6f34943e6b49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080803 May 12 07:09:47.824859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 744/1465] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:47 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:47.829276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fe59d7c8-11f6-453d-af69-035f474b423b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:47.830709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fe59d7c8-11f6-453d-af69-035f474b423b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:47.836090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe59d7c8-11f6-453d-af69-035f474b423b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:47.836533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe59d7c8-11f6-453d-af69-035f474b423b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:47.837301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe59d7c8-11f6-453d-af69-035f474b423b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:47.837734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe59d7c8-11f6-453d-af69-035f474b423b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:47.865745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fe59d7c8-11f6-453d-af69-035f474b423b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039941 May 12 07:09:47.866306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 745/1466] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:48.841408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4aa4607c-194c-4b04-8649-56d7fe672e4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:48.842075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4aa4607c-194c-4b04-8649-56d7fe672e4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:48.848363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4aa4607c-194c-4b04-8649-56d7fe672e4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:48.849973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4aa4607c-194c-4b04-8649-56d7fe672e4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:48.849973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4aa4607c-194c-4b04-8649-56d7fe672e4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:48.850166 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4aa4607c-194c-4b04-8649-56d7fe672e4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:48.913075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4aa4607c-194c-4b04-8649-56d7fe672e4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:48.920547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4aa4607c-194c-4b04-8649-56d7fe672e4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083720 May 12 07:09:48.921141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 746/1467] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:48 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:48.925931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2f9f7a3f-70e0-4ab1-b754-13addd25a419 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:48.926835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2f9f7a3f-70e0-4ab1-b754-13addd25a419 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:48.932371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f9f7a3f-70e0-4ab1-b754-13addd25a419 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:48.932807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f9f7a3f-70e0-4ab1-b754-13addd25a419 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:48.933569 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f9f7a3f-70e0-4ab1-b754-13addd25a419 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:48.934003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f9f7a3f-70e0-4ab1-b754-13addd25a419 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:48.962900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2f9f7a3f-70e0-4ab1-b754-13addd25a419 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040750 May 12 07:09:48.963461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 747/1468] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:48 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:49.936924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a70dadc5-63fe-4e12-91e7-77213cf686ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:49.937598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a70dadc5-63fe-4e12-91e7-77213cf686ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:49.944360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70dadc5-63fe-4e12-91e7-77213cf686ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:49.944812 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70dadc5-63fe-4e12-91e7-77213cf686ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:49.945738 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70dadc5-63fe-4e12-91e7-77213cf686ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:49.946182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a70dadc5-63fe-4e12-91e7-77213cf686ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:50.006962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a70dadc5-63fe-4e12-91e7-77213cf686ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:50.014344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a70dadc5-63fe-4e12-91e7-77213cf686ac tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081319 May 12 07:09:50.014906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 748/1469] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:49 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:50.019405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8a1449b1-e0b4-4ec7-bf14-a97dce8a5d77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:50.020334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8a1449b1-e0b4-4ec7-bf14-a97dce8a5d77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:50.026818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a1449b1-e0b4-4ec7-bf14-a97dce8a5d77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:50.027262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a1449b1-e0b4-4ec7-bf14-a97dce8a5d77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:50.028073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a1449b1-e0b4-4ec7-bf14-a97dce8a5d77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:50.028510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a1449b1-e0b4-4ec7-bf14-a97dce8a5d77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:50.056975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8a1449b1-e0b4-4ec7-bf14-a97dce8a5d77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041104 May 12 07:09:50.057524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 749/1470] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:51.031785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-10dd5f2e-106d-4986-9dd8-6e9c97e90162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:51.032406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-10dd5f2e-106d-4986-9dd8-6e9c97e90162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:51.039468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10dd5f2e-106d-4986-9dd8-6e9c97e90162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:51.039945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10dd5f2e-106d-4986-9dd8-6e9c97e90162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:51.040768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10dd5f2e-106d-4986-9dd8-6e9c97e90162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:51.041200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10dd5f2e-106d-4986-9dd8-6e9c97e90162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:51.101992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-10dd5f2e-106d-4986-9dd8-6e9c97e90162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:51.109270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-10dd5f2e-106d-4986-9dd8-6e9c97e90162 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081459 May 12 07:09:51.109839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 750/1471] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:51 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:51.114823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5e243e3e-2b1b-4856-b7f2-1e500ea96bcb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:51.116522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5e243e3e-2b1b-4856-b7f2-1e500ea96bcb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:51.121580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e243e3e-2b1b-4856-b7f2-1e500ea96bcb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:51.122054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e243e3e-2b1b-4856-b7f2-1e500ea96bcb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:51.122825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e243e3e-2b1b-4856-b7f2-1e500ea96bcb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:51.123258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e243e3e-2b1b-4856-b7f2-1e500ea96bcb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:51.151384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5e243e3e-2b1b-4856-b7f2-1e500ea96bcb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040574 May 12 07:09:51.151973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 751/1472] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:52.126862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-80b087a3-2ab2-44c7-8b90-b3a325dc4e67 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:52.127507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-80b087a3-2ab2-44c7-8b90-b3a325dc4e67 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:52.133527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80b087a3-2ab2-44c7-8b90-b3a325dc4e67 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:52.133975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80b087a3-2ab2-44c7-8b90-b3a325dc4e67 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:52.134745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80b087a3-2ab2-44c7-8b90-b3a325dc4e67 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:52.135186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80b087a3-2ab2-44c7-8b90-b3a325dc4e67 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:52.194282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-80b087a3-2ab2-44c7-8b90-b3a325dc4e67 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:52.201596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-80b087a3-2ab2-44c7-8b90-b3a325dc4e67 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078571 May 12 07:09:52.202162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 752/1473] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:52 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:52.206666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-88aecfd5-26bd-4ef9-8749-e71ae9a2f8a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:52.207576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-88aecfd5-26bd-4ef9-8749-e71ae9a2f8a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:52.213069 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88aecfd5-26bd-4ef9-8749-e71ae9a2f8a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:52.213521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88aecfd5-26bd-4ef9-8749-e71ae9a2f8a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:52.214291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88aecfd5-26bd-4ef9-8749-e71ae9a2f8a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:52.214730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88aecfd5-26bd-4ef9-8749-e71ae9a2f8a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:52.245048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-88aecfd5-26bd-4ef9-8749-e71ae9a2f8a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041859 May 12 07:09:52.245517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 753/1474] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:53.218057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4a343d5f-b271-4d4b-bd93-7ee4ea3a0611 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:53.218701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4a343d5f-b271-4d4b-bd93-7ee4ea3a0611 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:53.225636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a343d5f-b271-4d4b-bd93-7ee4ea3a0611 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:53.226082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a343d5f-b271-4d4b-bd93-7ee4ea3a0611 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:53.226849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a343d5f-b271-4d4b-bd93-7ee4ea3a0611 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:53.227292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a343d5f-b271-4d4b-bd93-7ee4ea3a0611 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:53.289249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4a343d5f-b271-4d4b-bd93-7ee4ea3a0611 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:53.296487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4a343d5f-b271-4d4b-bd93-7ee4ea3a0611 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082340 May 12 07:09:53.297048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 754/1475] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:53 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:53.301833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-05633029-f1e9-4711-b59f-41448bd301a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:53.302738 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-05633029-f1e9-4711-b59f-41448bd301a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:53.308170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-05633029-f1e9-4711-b59f-41448bd301a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:53.308621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-05633029-f1e9-4711-b59f-41448bd301a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:53.309398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-05633029-f1e9-4711-b59f-41448bd301a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:53.309840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-05633029-f1e9-4711-b59f-41448bd301a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:53.337525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-05633029-f1e9-4711-b59f-41448bd301a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039520 May 12 07:09:53.338066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 755/1476] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:54.313594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fe30d8f3-fe8b-4fe1-bc55-61ac4814bbaa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:54.314707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fe30d8f3-fe8b-4fe1-bc55-61ac4814bbaa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:54.320915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe30d8f3-fe8b-4fe1-bc55-61ac4814bbaa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:54.321363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe30d8f3-fe8b-4fe1-bc55-61ac4814bbaa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:54.322132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe30d8f3-fe8b-4fe1-bc55-61ac4814bbaa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:54.322614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe30d8f3-fe8b-4fe1-bc55-61ac4814bbaa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:54.382120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fe30d8f3-fe8b-4fe1-bc55-61ac4814bbaa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:54.389447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fe30d8f3-fe8b-4fe1-bc55-61ac4814bbaa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080035 May 12 07:09:54.390078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 756/1477] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:54 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:54.395178 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7bcd62fc-bc30-404a-b699-92d49f3524c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:54.396135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7bcd62fc-bc30-404a-b699-92d49f3524c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:54.401574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bcd62fc-bc30-404a-b699-92d49f3524c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:54.402025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bcd62fc-bc30-404a-b699-92d49f3524c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:54.402796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bcd62fc-bc30-404a-b699-92d49f3524c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:54.403236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bcd62fc-bc30-404a-b699-92d49f3524c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:54.431197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7bcd62fc-bc30-404a-b699-92d49f3524c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040162 May 12 07:09:54.431767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 757/1478] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:55.406369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8053386f-418d-4d1b-8c5b-055c91140300 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:55.407000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8053386f-418d-4d1b-8c5b-055c91140300 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:55.413168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8053386f-418d-4d1b-8c5b-055c91140300 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:55.413615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8053386f-418d-4d1b-8c5b-055c91140300 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:55.414382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8053386f-418d-4d1b-8c5b-055c91140300 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:55.414815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8053386f-418d-4d1b-8c5b-055c91140300 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:55.475722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8053386f-418d-4d1b-8c5b-055c91140300 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:55.483023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8053386f-418d-4d1b-8c5b-055c91140300 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080612 May 12 07:09:55.483597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 758/1479] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:55 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:55.488132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e3a5a56a-2eb0-49f1-afdd-e940d7f2d7d1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:55.489073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e3a5a56a-2eb0-49f1-afdd-e940d7f2d7d1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:55.494559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3a5a56a-2eb0-49f1-afdd-e940d7f2d7d1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:55.495009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3a5a56a-2eb0-49f1-afdd-e940d7f2d7d1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:55.495813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3a5a56a-2eb0-49f1-afdd-e940d7f2d7d1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:55.496254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3a5a56a-2eb0-49f1-afdd-e940d7f2d7d1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:55.524745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e3a5a56a-2eb0-49f1-afdd-e940d7f2d7d1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040154 May 12 07:09:55.525298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 759/1480] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:55 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:56.499631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d7cb7e5b-766b-4611-8899-f3ee5603be52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:56.500346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d7cb7e5b-766b-4611-8899-f3ee5603be52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:56.507105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7cb7e5b-766b-4611-8899-f3ee5603be52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:56.507562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7cb7e5b-766b-4611-8899-f3ee5603be52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:56.508374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7cb7e5b-766b-4611-8899-f3ee5603be52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:56.508813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7cb7e5b-766b-4611-8899-f3ee5603be52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:56.572401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d7cb7e5b-766b-4611-8899-f3ee5603be52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:56.580247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d7cb7e5b-766b-4611-8899-f3ee5603be52 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083886 May 12 07:09:56.580816 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 760/1481] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:56 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:56.585272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ced1136c-3b44-45ef-9996-5e418e99ca65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:56.586211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ced1136c-3b44-45ef-9996-5e418e99ca65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:56.591641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ced1136c-3b44-45ef-9996-5e418e99ca65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:56.592127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ced1136c-3b44-45ef-9996-5e418e99ca65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:56.592900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ced1136c-3b44-45ef-9996-5e418e99ca65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:56.593339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ced1136c-3b44-45ef-9996-5e418e99ca65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:56.622942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ced1136c-3b44-45ef-9996-5e418e99ca65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041155 May 12 07:09:56.623489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 761/1482] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:57.597104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6641fd32-7583-44c0-9ea3-5cfe93f11644 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:57.597732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6641fd32-7583-44c0-9ea3-5cfe93f11644 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:57.604539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6641fd32-7583-44c0-9ea3-5cfe93f11644 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:57.604987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6641fd32-7583-44c0-9ea3-5cfe93f11644 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:57.605757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6641fd32-7583-44c0-9ea3-5cfe93f11644 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:57.606196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6641fd32-7583-44c0-9ea3-5cfe93f11644 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:57.668486 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6641fd32-7583-44c0-9ea3-5cfe93f11644 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:57.676106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6641fd32-7583-44c0-9ea3-5cfe93f11644 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083472 May 12 07:09:57.676672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 762/1483] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:57 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:57.681172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9ffd37f2-c95a-4f5e-81d7-9bd2c606240a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:57.682106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9ffd37f2-c95a-4f5e-81d7-9bd2c606240a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:57.687464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ffd37f2-c95a-4f5e-81d7-9bd2c606240a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:57.687953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ffd37f2-c95a-4f5e-81d7-9bd2c606240a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:57.688766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ffd37f2-c95a-4f5e-81d7-9bd2c606240a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:57.689208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ffd37f2-c95a-4f5e-81d7-9bd2c606240a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:57.719860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9ffd37f2-c95a-4f5e-81d7-9bd2c606240a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042166 May 12 07:09:57.721072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 763/1484] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:58.692811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-abaa6e59-d270-449e-a781-70ed8b1dbe6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:58.693462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-abaa6e59-d270-449e-a781-70ed8b1dbe6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:58.699708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abaa6e59-d270-449e-a781-70ed8b1dbe6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:58.700159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abaa6e59-d270-449e-a781-70ed8b1dbe6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:58.700928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abaa6e59-d270-449e-a781-70ed8b1dbe6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:58.701366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abaa6e59-d270-449e-a781-70ed8b1dbe6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:58.761994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-abaa6e59-d270-449e-a781-70ed8b1dbe6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:58.769425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-abaa6e59-d270-449e-a781-70ed8b1dbe6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080596 May 12 07:09:58.770000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 764/1485] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:58 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:58.774505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-60295a13-4b91-4d6d-9962-03800c908e97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:58.775438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-60295a13-4b91-4d6d-9962-03800c908e97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:58.781258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60295a13-4b91-4d6d-9962-03800c908e97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:58.781711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60295a13-4b91-4d6d-9962-03800c908e97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:58.782988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60295a13-4b91-4d6d-9962-03800c908e97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:58.783425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60295a13-4b91-4d6d-9962-03800c908e97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:58.812940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-60295a13-4b91-4d6d-9962-03800c908e97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041908 May 12 07:09:58.813505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 765/1486] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:09:59.786028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c2b951b4-38e3-43c8-ae19-0605ccb19298 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:59.786685 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c2b951b4-38e3-43c8-ae19-0605ccb19298 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:59.792959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2b951b4-38e3-43c8-ae19-0605ccb19298 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:59.793417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2b951b4-38e3-43c8-ae19-0605ccb19298 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:59.794199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2b951b4-38e3-43c8-ae19-0605ccb19298 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:59.794641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2b951b4-38e3-43c8-ae19-0605ccb19298 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:59.854630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c2b951b4-38e3-43c8-ae19-0605ccb19298 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:09:59.862503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c2b951b4-38e3-43c8-ae19-0605ccb19298 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080404 May 12 07:09:59.863072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 766/1487] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:09:59 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:09:59.867530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f8b5d130-bdb9-4195-938f-fc0dc0b48262 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:09:59.868469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f8b5d130-bdb9-4195-938f-fc0dc0b48262 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:09:59.873848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8b5d130-bdb9-4195-938f-fc0dc0b48262 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:59.874300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8b5d130-bdb9-4195-938f-fc0dc0b48262 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:59.875079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8b5d130-bdb9-4195-938f-fc0dc0b48262 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:09:59.875519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8b5d130-bdb9-4195-938f-fc0dc0b48262 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:09:59.903555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f8b5d130-bdb9-4195-938f-fc0dc0b48262 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039507 May 12 07:09:59.904143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 767/1488] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:09:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:00.879002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5dd1d143-f1aa-4889-bd24-e88b952cbc57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:00.879715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5dd1d143-f1aa-4889-bd24-e88b952cbc57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:00.885966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dd1d143-f1aa-4889-bd24-e88b952cbc57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:00.886419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dd1d143-f1aa-4889-bd24-e88b952cbc57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:00.887189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dd1d143-f1aa-4889-bd24-e88b952cbc57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:00.887635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dd1d143-f1aa-4889-bd24-e88b952cbc57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:00.947463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5dd1d143-f1aa-4889-bd24-e88b952cbc57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:00.955422 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5dd1d143-f1aa-4889-bd24-e88b952cbc57 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080709 May 12 07:10:00.956029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 768/1489] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:00 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:00.960583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-59ca6982-376b-42f1-b775-d55f438ceced tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:00.961502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-59ca6982-376b-42f1-b775-d55f438ceced tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:00.967393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59ca6982-376b-42f1-b775-d55f438ceced tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:00.967887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59ca6982-376b-42f1-b775-d55f438ceced tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:00.968677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59ca6982-376b-42f1-b775-d55f438ceced tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:00.969122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59ca6982-376b-42f1-b775-d55f438ceced tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:00.999090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-59ca6982-376b-42f1-b775-d55f438ceced tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042054 May 12 07:10:00.999654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 769/1490] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:01.017673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:10:01.017859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:10:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:10:01.972100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bf89b5b4-6f97-4fd1-8f40-4e73c176c6c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:01.972763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bf89b5b4-6f97-4fd1-8f40-4e73c176c6c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:01.979031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf89b5b4-6f97-4fd1-8f40-4e73c176c6c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:01.979477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf89b5b4-6f97-4fd1-8f40-4e73c176c6c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:01.980272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf89b5b4-6f97-4fd1-8f40-4e73c176c6c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:01.980709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf89b5b4-6f97-4fd1-8f40-4e73c176c6c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:02.043241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bf89b5b4-6f97-4fd1-8f40-4e73c176c6c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:02.051500 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bf89b5b4-6f97-4fd1-8f40-4e73c176c6c0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083242 May 12 07:10:02.052122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 770/1491] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:01 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:02.056604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-56e65e4c-abd9-40b5-9c32-9c1687c4f409 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:02.057508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-56e65e4c-abd9-40b5-9c32-9c1687c4f409 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:02.062856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56e65e4c-abd9-40b5-9c32-9c1687c4f409 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:02.063305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56e65e4c-abd9-40b5-9c32-9c1687c4f409 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:02.064740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56e65e4c-abd9-40b5-9c32-9c1687c4f409 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:02.065181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56e65e4c-abd9-40b5-9c32-9c1687c4f409 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:02.092715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-56e65e4c-abd9-40b5-9c32-9c1687c4f409 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039625 May 12 07:10:02.093253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 771/1492] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:03.068013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-955cbc57-1e21-4fde-aa2e-ed527c8e053b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:03.068666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-955cbc57-1e21-4fde-aa2e-ed527c8e053b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:03.075076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-955cbc57-1e21-4fde-aa2e-ed527c8e053b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:03.075524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-955cbc57-1e21-4fde-aa2e-ed527c8e053b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:03.076365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-955cbc57-1e21-4fde-aa2e-ed527c8e053b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:03.076804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-955cbc57-1e21-4fde-aa2e-ed527c8e053b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:03.137514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-955cbc57-1e21-4fde-aa2e-ed527c8e053b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:03.145464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-955cbc57-1e21-4fde-aa2e-ed527c8e053b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081351 May 12 07:10:03.146036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 772/1493] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:03 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:03.150485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5d804b5b-96c1-4b93-8a58-4b7aafa95ac3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:03.151405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5d804b5b-96c1-4b93-8a58-4b7aafa95ac3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:03.156801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d804b5b-96c1-4b93-8a58-4b7aafa95ac3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:03.157251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d804b5b-96c1-4b93-8a58-4b7aafa95ac3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:03.158022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d804b5b-96c1-4b93-8a58-4b7aafa95ac3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:03.158460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d804b5b-96c1-4b93-8a58-4b7aafa95ac3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:03.186029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5d804b5b-96c1-4b93-8a58-4b7aafa95ac3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039038 May 12 07:10:03.186569 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 773/1494] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:04.162961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-03fc4fcd-693f-489a-952a-e41318d0f62f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:04.163762 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-03fc4fcd-693f-489a-952a-e41318d0f62f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:04.169951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-03fc4fcd-693f-489a-952a-e41318d0f62f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:04.170401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-03fc4fcd-693f-489a-952a-e41318d0f62f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:04.171174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-03fc4fcd-693f-489a-952a-e41318d0f62f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:04.171614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-03fc4fcd-693f-489a-952a-e41318d0f62f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:04.231767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-03fc4fcd-693f-489a-952a-e41318d0f62f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:04.239842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-03fc4fcd-693f-489a-952a-e41318d0f62f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080776 May 12 07:10:04.240415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 774/1495] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:04.244956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1395f903-13b3-4b11-a005-461094d9cf67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:04.245867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1395f903-13b3-4b11-a005-461094d9cf67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:04.251576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1395f903-13b3-4b11-a005-461094d9cf67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:04.252058 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1395f903-13b3-4b11-a005-461094d9cf67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:04.252835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1395f903-13b3-4b11-a005-461094d9cf67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:04.253299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1395f903-13b3-4b11-a005-461094d9cf67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:04.281128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1395f903-13b3-4b11-a005-461094d9cf67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039764 May 12 07:10:04.281661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 775/1496] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:05.256771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-08039e57-a457-486c-bd80-e7e2a80ce423 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:05.257377 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-08039e57-a457-486c-bd80-e7e2a80ce423 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:05.263927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08039e57-a457-486c-bd80-e7e2a80ce423 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:05.264372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08039e57-a457-486c-bd80-e7e2a80ce423 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:05.265141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08039e57-a457-486c-bd80-e7e2a80ce423 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:05.265578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08039e57-a457-486c-bd80-e7e2a80ce423 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:05.325993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-08039e57-a457-486c-bd80-e7e2a80ce423 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:05.333374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-08039e57-a457-486c-bd80-e7e2a80ce423 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080564 May 12 07:10:05.333936 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 776/1497] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:05 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:05.338441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3d6607bc-f69f-4d00-a8a9-1e720c587cbf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:05.339340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3d6607bc-f69f-4d00-a8a9-1e720c587cbf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:05.345287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3d6607bc-f69f-4d00-a8a9-1e720c587cbf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:05.345735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3d6607bc-f69f-4d00-a8a9-1e720c587cbf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:05.346495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3d6607bc-f69f-4d00-a8a9-1e720c587cbf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:05.346936 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3d6607bc-f69f-4d00-a8a9-1e720c587cbf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:05.376571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3d6607bc-f69f-4d00-a8a9-1e720c587cbf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041677 May 12 07:10:05.377117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 777/1498] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:06.349745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a8349d6b-5b32-41e8-a7ac-356172c36a95 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:06.350365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a8349d6b-5b32-41e8-a7ac-356172c36a95 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:06.356610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8349d6b-5b32-41e8-a7ac-356172c36a95 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:06.357051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8349d6b-5b32-41e8-a7ac-356172c36a95 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:06.357815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8349d6b-5b32-41e8-a7ac-356172c36a95 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:06.358248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8349d6b-5b32-41e8-a7ac-356172c36a95 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:06.421450 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a8349d6b-5b32-41e8-a7ac-356172c36a95 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:06.429033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a8349d6b-5b32-41e8-a7ac-356172c36a95 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083315 May 12 07:10:06.429598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 778/1499] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:06 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:06.434040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4c05f77a-b9e3-448e-8c6c-46c18f7688bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:06.434944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4c05f77a-b9e3-448e-8c6c-46c18f7688bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:06.441179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c05f77a-b9e3-448e-8c6c-46c18f7688bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:06.441625 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c05f77a-b9e3-448e-8c6c-46c18f7688bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:06.442396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c05f77a-b9e3-448e-8c6c-46c18f7688bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:06.442829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c05f77a-b9e3-448e-8c6c-46c18f7688bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:06.471125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4c05f77a-b9e3-448e-8c6c-46c18f7688bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040568 May 12 07:10:06.471676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 779/1500] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:07.445701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7f11c138-4e8b-47e3-b78d-e687de6d80b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:07.446389 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7f11c138-4e8b-47e3-b78d-e687de6d80b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:07.452635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f11c138-4e8b-47e3-b78d-e687de6d80b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:07.453087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f11c138-4e8b-47e3-b78d-e687de6d80b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:07.453858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f11c138-4e8b-47e3-b78d-e687de6d80b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:07.454296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f11c138-4e8b-47e3-b78d-e687de6d80b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:07.516014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7f11c138-4e8b-47e3-b78d-e687de6d80b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:07.523664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7f11c138-4e8b-47e3-b78d-e687de6d80b6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081866 May 12 07:10:07.524270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 780/1501] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:07 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:07.528695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a0ae86a9-3dcc-4360-b0b6-4447f54c8eae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:07.529607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a0ae86a9-3dcc-4360-b0b6-4447f54c8eae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:07.535571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0ae86a9-3dcc-4360-b0b6-4447f54c8eae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:07.536047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0ae86a9-3dcc-4360-b0b6-4447f54c8eae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:07.536817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0ae86a9-3dcc-4360-b0b6-4447f54c8eae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:07.537255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0ae86a9-3dcc-4360-b0b6-4447f54c8eae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:07.565190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a0ae86a9-3dcc-4360-b0b6-4447f54c8eae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039954 May 12 07:10:07.565736 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 781/1502] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:07 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:08.540066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-61680a10-113a-48ab-8511-f36783abc4eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:08.540656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-61680a10-113a-48ab-8511-f36783abc4eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:08.546951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61680a10-113a-48ab-8511-f36783abc4eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:08.547403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61680a10-113a-48ab-8511-f36783abc4eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:08.548238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61680a10-113a-48ab-8511-f36783abc4eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:08.548933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-61680a10-113a-48ab-8511-f36783abc4eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:08.608412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-61680a10-113a-48ab-8511-f36783abc4eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:08.615655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-61680a10-113a-48ab-8511-f36783abc4eb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079532 May 12 07:10:08.616245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 782/1503] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:08 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:08.620665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3ea78bc5-e63e-44f0-bb66-18f6a8380183 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:08.621567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3ea78bc5-e63e-44f0-bb66-18f6a8380183 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:08.627401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ea78bc5-e63e-44f0-bb66-18f6a8380183 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:08.627881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ea78bc5-e63e-44f0-bb66-18f6a8380183 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:08.628651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ea78bc5-e63e-44f0-bb66-18f6a8380183 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:08.629097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ea78bc5-e63e-44f0-bb66-18f6a8380183 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:08.657425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3ea78bc5-e63e-44f0-bb66-18f6a8380183 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040209 May 12 07:10:08.658068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 783/1504] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:09.632273 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-904741ae-d9b4-4857-8f27-32dd2497abd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:09.632921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-904741ae-d9b4-4857-8f27-32dd2497abd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:09.639141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-904741ae-d9b4-4857-8f27-32dd2497abd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:09.639586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-904741ae-d9b4-4857-8f27-32dd2497abd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:09.640391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-904741ae-d9b4-4857-8f27-32dd2497abd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:09.640828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-904741ae-d9b4-4857-8f27-32dd2497abd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:09.700934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-904741ae-d9b4-4857-8f27-32dd2497abd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:09.708719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-904741ae-d9b4-4857-8f27-32dd2497abd7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080310 May 12 07:10:09.709283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 784/1505] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:09 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:09.713822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-01fd4907-877e-4475-9bcc-fa6baf89f097 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:09.714722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-01fd4907-877e-4475-9bcc-fa6baf89f097 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:09.720985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01fd4907-877e-4475-9bcc-fa6baf89f097 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:09.721439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01fd4907-877e-4475-9bcc-fa6baf89f097 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:09.722204 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01fd4907-877e-4475-9bcc-fa6baf89f097 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:09.722641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01fd4907-877e-4475-9bcc-fa6baf89f097 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:09.751732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-01fd4907-877e-4475-9bcc-fa6baf89f097 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041461 May 12 07:10:09.752280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 785/1506] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:10.026015 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:10:10.026470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:10:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.25) !!! May 12 07:10:10.727087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-97b3987b-7bb5-485b-8eab-9c75efdf6340 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:10.727722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-97b3987b-7bb5-485b-8eab-9c75efdf6340 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:10.734043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97b3987b-7bb5-485b-8eab-9c75efdf6340 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:10.734493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97b3987b-7bb5-485b-8eab-9c75efdf6340 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:10.735264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97b3987b-7bb5-485b-8eab-9c75efdf6340 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:10.735719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97b3987b-7bb5-485b-8eab-9c75efdf6340 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:10.799078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97b3987b-7bb5-485b-8eab-9c75efdf6340 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:10.806955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-97b3987b-7bb5-485b-8eab-9c75efdf6340 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084676 May 12 07:10:10.807523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 786/1507] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:10 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:10.812064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2bf311b8-51b0-414c-8ecc-669619b3d303 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:10.812973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2bf311b8-51b0-414c-8ecc-669619b3d303 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:10.818393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2bf311b8-51b0-414c-8ecc-669619b3d303 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:10.818846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2bf311b8-51b0-414c-8ecc-669619b3d303 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:10.819617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2bf311b8-51b0-414c-8ecc-669619b3d303 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:10.820089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2bf311b8-51b0-414c-8ecc-669619b3d303 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:10.847999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2bf311b8-51b0-414c-8ecc-669619b3d303 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039470 May 12 07:10:10.848557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 787/1508] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:11.823310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2b373226-e7b1-4686-8492-9c974eba60a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:11.824012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2b373226-e7b1-4686-8492-9c974eba60a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:11.830196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2b373226-e7b1-4686-8492-9c974eba60a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:11.830644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2b373226-e7b1-4686-8492-9c974eba60a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:11.831403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2b373226-e7b1-4686-8492-9c974eba60a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:11.831874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2b373226-e7b1-4686-8492-9c974eba60a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:11.891731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2b373226-e7b1-4686-8492-9c974eba60a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:11.899070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2b373226-e7b1-4686-8492-9c974eba60a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079567 May 12 07:10:11.899632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 788/1509] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:11 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:11.904086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-72b757eb-c279-4668-9331-fb094bff4563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:11.904986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-72b757eb-c279-4668-9331-fb094bff4563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:11.910400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-72b757eb-c279-4668-9331-fb094bff4563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:11.910848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-72b757eb-c279-4668-9331-fb094bff4563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:11.911611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-72b757eb-c279-4668-9331-fb094bff4563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:11.912067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-72b757eb-c279-4668-9331-fb094bff4563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:11.940437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-72b757eb-c279-4668-9331-fb094bff4563 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039185 May 12 07:10:11.940970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 789/1510] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:12.915603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-129b6ac7-18ea-44a7-8def-39ae33d89cb0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:12.916313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-129b6ac7-18ea-44a7-8def-39ae33d89cb0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:12.922502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-129b6ac7-18ea-44a7-8def-39ae33d89cb0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:12.922945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-129b6ac7-18ea-44a7-8def-39ae33d89cb0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:12.923996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-129b6ac7-18ea-44a7-8def-39ae33d89cb0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:12.924434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-129b6ac7-18ea-44a7-8def-39ae33d89cb0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:12.984576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-129b6ac7-18ea-44a7-8def-39ae33d89cb0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:12.991985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-129b6ac7-18ea-44a7-8def-39ae33d89cb0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080219 May 12 07:10:12.992561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 790/1511] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:12 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:12.997107 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f6465ef6-23db-4af5-86de-9968e1617233 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:12.998049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f6465ef6-23db-4af5-86de-9968e1617233 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:13.004241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6465ef6-23db-4af5-86de-9968e1617233 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:13.004702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6465ef6-23db-4af5-86de-9968e1617233 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:13.005472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6465ef6-23db-4af5-86de-9968e1617233 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:13.005939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6465ef6-23db-4af5-86de-9968e1617233 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:13.034369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f6465ef6-23db-4af5-86de-9968e1617233 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040817 May 12 07:10:13.034920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 791/1512] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:12 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:14.007830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3fa6f3e4-5e88-4d69-aa09-0df3e924a595 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:14.008453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3fa6f3e4-5e88-4d69-aa09-0df3e924a595 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:14.014729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3fa6f3e4-5e88-4d69-aa09-0df3e924a595 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:14.015188 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3fa6f3e4-5e88-4d69-aa09-0df3e924a595 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:14.015999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3fa6f3e4-5e88-4d69-aa09-0df3e924a595 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:14.016446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3fa6f3e4-5e88-4d69-aa09-0df3e924a595 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:14.076820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3fa6f3e4-5e88-4d69-aa09-0df3e924a595 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:14.084573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3fa6f3e4-5e88-4d69-aa09-0df3e924a595 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080644 May 12 07:10:14.085142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 792/1513] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:14 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:14.089612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-80d2d023-ba3f-466e-be42-fb0695da8298 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:14.090522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-80d2d023-ba3f-466e-be42-fb0695da8298 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:14.096666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80d2d023-ba3f-466e-be42-fb0695da8298 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:14.097126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80d2d023-ba3f-466e-be42-fb0695da8298 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:14.097909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80d2d023-ba3f-466e-be42-fb0695da8298 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:14.098353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-80d2d023-ba3f-466e-be42-fb0695da8298 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:14.127451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-80d2d023-ba3f-466e-be42-fb0695da8298 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041341 May 12 07:10:14.128049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 793/1514] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:15.101725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-56e4f78d-38d7-4490-9ae6-fd96bbbaeedf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:15.102340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-56e4f78d-38d7-4490-9ae6-fd96bbbaeedf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:15.108668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56e4f78d-38d7-4490-9ae6-fd96bbbaeedf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:15.109120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56e4f78d-38d7-4490-9ae6-fd96bbbaeedf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:15.109887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56e4f78d-38d7-4490-9ae6-fd96bbbaeedf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:15.110327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56e4f78d-38d7-4490-9ae6-fd96bbbaeedf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:15.173964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-56e4f78d-38d7-4490-9ae6-fd96bbbaeedf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:15.181964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-56e4f78d-38d7-4490-9ae6-fd96bbbaeedf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084648 May 12 07:10:15.182537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 794/1515] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:15 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:15.186988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f165e47a-ec44-4345-bf09-e2de231f0173 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:15.187918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f165e47a-ec44-4345-bf09-e2de231f0173 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:15.193253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f165e47a-ec44-4345-bf09-e2de231f0173 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:15.193704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f165e47a-ec44-4345-bf09-e2de231f0173 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:15.194473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f165e47a-ec44-4345-bf09-e2de231f0173 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:15.194919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f165e47a-ec44-4345-bf09-e2de231f0173 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:15.223163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f165e47a-ec44-4345-bf09-e2de231f0173 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039653 May 12 07:10:15.223716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 795/1516] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:16.198296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c0d6cefc-5574-473f-ad6a-0c46289de274 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:16.198985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c0d6cefc-5574-473f-ad6a-0c46289de274 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:16.205182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0d6cefc-5574-473f-ad6a-0c46289de274 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:16.205630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0d6cefc-5574-473f-ad6a-0c46289de274 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:16.206436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0d6cefc-5574-473f-ad6a-0c46289de274 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:16.206876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0d6cefc-5574-473f-ad6a-0c46289de274 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:16.268310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c0d6cefc-5574-473f-ad6a-0c46289de274 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:16.275641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c0d6cefc-5574-473f-ad6a-0c46289de274 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081225 May 12 07:10:16.276230 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 796/1517] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:16 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:16.280789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-32566ca4-c9a1-4b81-9fc7-0a9c9a982e57 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:16.281696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-32566ca4-c9a1-4b81-9fc7-0a9c9a982e57 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:16.287278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-32566ca4-c9a1-4b81-9fc7-0a9c9a982e57 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:16.287763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-32566ca4-c9a1-4b81-9fc7-0a9c9a982e57 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:16.288556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-32566ca4-c9a1-4b81-9fc7-0a9c9a982e57 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:16.289022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-32566ca4-c9a1-4b81-9fc7-0a9c9a982e57 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:16.317721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-32566ca4-c9a1-4b81-9fc7-0a9c9a982e57 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040505 May 12 07:10:16.318255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 797/1518] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:16.565558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:10:16.566104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:10:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.25) !!! May 12 07:10:17.292299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-de775f7a-5d95-464b-b701-76a9dfaa318a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:17.292851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-de775f7a-5d95-464b-b701-76a9dfaa318a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:17.299335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de775f7a-5d95-464b-b701-76a9dfaa318a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:17.299808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de775f7a-5d95-464b-b701-76a9dfaa318a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:17.300570 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de775f7a-5d95-464b-b701-76a9dfaa318a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:17.301004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de775f7a-5d95-464b-b701-76a9dfaa318a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:17.360505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de775f7a-5d95-464b-b701-76a9dfaa318a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:17.367793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-de775f7a-5d95-464b-b701-76a9dfaa318a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079392 May 12 07:10:17.368361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 798/1519] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:17 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:17.372760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ba9201a9-91e3-44c3-9f76-6b88fea40c14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:17.373653 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ba9201a9-91e3-44c3-9f76-6b88fea40c14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:17.379708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ba9201a9-91e3-44c3-9f76-6b88fea40c14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:17.380180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ba9201a9-91e3-44c3-9f76-6b88fea40c14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:17.380947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ba9201a9-91e3-44c3-9f76-6b88fea40c14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:17.381381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ba9201a9-91e3-44c3-9f76-6b88fea40c14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:17.410318 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ba9201a9-91e3-44c3-9f76-6b88fea40c14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040991 May 12 07:10:17.410886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 799/1520] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:17 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:18.385197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-69bc1c42-8faf-4e08-9bc7-d0dd6b36c22a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:18.385812 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-69bc1c42-8faf-4e08-9bc7-d0dd6b36c22a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:18.392079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69bc1c42-8faf-4e08-9bc7-d0dd6b36c22a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:18.392533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69bc1c42-8faf-4e08-9bc7-d0dd6b36c22a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:18.393297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69bc1c42-8faf-4e08-9bc7-d0dd6b36c22a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:18.393738 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69bc1c42-8faf-4e08-9bc7-d0dd6b36c22a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:18.454476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-69bc1c42-8faf-4e08-9bc7-d0dd6b36c22a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:18.462026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-69bc1c42-8faf-4e08-9bc7-d0dd6b36c22a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080772 May 12 07:10:18.462594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 800/1521] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:18 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:18.467168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bf082c59-aa52-4af9-9649-484864b41446 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:18.468165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bf082c59-aa52-4af9-9649-484864b41446 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:18.477962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf082c59-aa52-4af9-9649-484864b41446 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:18.478414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf082c59-aa52-4af9-9649-484864b41446 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:18.479187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf082c59-aa52-4af9-9649-484864b41446 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:18.479628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf082c59-aa52-4af9-9649-484864b41446 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:18.510273 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bf082c59-aa52-4af9-9649-484864b41446 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046706 May 12 07:10:18.510820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 801/1522] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:19.479771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-36b53051-bea3-4f58-9b0c-dd68a4f2c53e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:19.480511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-36b53051-bea3-4f58-9b0c-dd68a4f2c53e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:19.487359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-36b53051-bea3-4f58-9b0c-dd68a4f2c53e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:19.487838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-36b53051-bea3-4f58-9b0c-dd68a4f2c53e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:19.488608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-36b53051-bea3-4f58-9b0c-dd68a4f2c53e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:19.489047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-36b53051-bea3-4f58-9b0c-dd68a4f2c53e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:19.552222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-36b53051-bea3-4f58-9b0c-dd68a4f2c53e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:19.559474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-36b53051-bea3-4f58-9b0c-dd68a4f2c53e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084023 May 12 07:10:19.560076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 802/1523] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:19 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:19.564597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1928c964-ba79-4bb4-b7ea-fe14c1d0b067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:19.565500 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1928c964-ba79-4bb4-b7ea-fe14c1d0b067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:19.571356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1928c964-ba79-4bb4-b7ea-fe14c1d0b067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:19.571846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1928c964-ba79-4bb4-b7ea-fe14c1d0b067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:19.572620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1928c964-ba79-4bb4-b7ea-fe14c1d0b067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:19.573056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1928c964-ba79-4bb4-b7ea-fe14c1d0b067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:19.601419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1928c964-ba79-4bb4-b7ea-fe14c1d0b067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040391 May 12 07:10:19.601958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 803/1524] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:20.576646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3a8bed78-1ad1-4e5c-9834-6c35b7def8fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:20.577327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3a8bed78-1ad1-4e5c-9834-6c35b7def8fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:20.583515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a8bed78-1ad1-4e5c-9834-6c35b7def8fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:20.583993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a8bed78-1ad1-4e5c-9834-6c35b7def8fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:20.584763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a8bed78-1ad1-4e5c-9834-6c35b7def8fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:20.585204 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a8bed78-1ad1-4e5c-9834-6c35b7def8fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:20.645419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3a8bed78-1ad1-4e5c-9834-6c35b7def8fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:20.652600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3a8bed78-1ad1-4e5c-9834-6c35b7def8fc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079817 May 12 07:10:20.653170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 804/1525] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:20 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:20.657696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bf57949a-9d12-49a9-957a-4c8f902cdb14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:20.658593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bf57949a-9d12-49a9-957a-4c8f902cdb14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:20.664538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf57949a-9d12-49a9-957a-4c8f902cdb14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:20.664990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf57949a-9d12-49a9-957a-4c8f902cdb14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:20.665766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf57949a-9d12-49a9-957a-4c8f902cdb14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:20.666205 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf57949a-9d12-49a9-957a-4c8f902cdb14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:20.693788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bf57949a-9d12-49a9-957a-4c8f902cdb14 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039667 May 12 07:10:20.694336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 805/1526] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:20 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:21.669833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0689ebf3-78f0-44ef-a03f-e4051a1284ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:21.670498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0689ebf3-78f0-44ef-a03f-e4051a1284ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:21.677051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0689ebf3-78f0-44ef-a03f-e4051a1284ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:21.677496 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0689ebf3-78f0-44ef-a03f-e4051a1284ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:21.678274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0689ebf3-78f0-44ef-a03f-e4051a1284ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:21.678691 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0689ebf3-78f0-44ef-a03f-e4051a1284ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:21.738118 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0689ebf3-78f0-44ef-a03f-e4051a1284ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:21.745976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0689ebf3-78f0-44ef-a03f-e4051a1284ec tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080183 May 12 07:10:21.746544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 806/1527] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:21 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:21.751004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4bf27128-1b6f-444a-b151-d52c04b975f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:21.751932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4bf27128-1b6f-444a-b151-d52c04b975f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:21.758070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4bf27128-1b6f-444a-b151-d52c04b975f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:21.758526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4bf27128-1b6f-444a-b151-d52c04b975f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:21.759335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4bf27128-1b6f-444a-b151-d52c04b975f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:21.759809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4bf27128-1b6f-444a-b151-d52c04b975f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:21.788079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4bf27128-1b6f-444a-b151-d52c04b975f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040556 May 12 07:10:21.788627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 807/1528] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:21 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:22.762359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a71aa79b-be32-4654-a3e8-6142a676661a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:22.763030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a71aa79b-be32-4654-a3e8-6142a676661a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:22.769266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a71aa79b-be32-4654-a3e8-6142a676661a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:22.769720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a71aa79b-be32-4654-a3e8-6142a676661a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:22.770515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a71aa79b-be32-4654-a3e8-6142a676661a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:22.770957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a71aa79b-be32-4654-a3e8-6142a676661a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:22.832456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a71aa79b-be32-4654-a3e8-6142a676661a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:22.839809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a71aa79b-be32-4654-a3e8-6142a676661a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081320 May 12 07:10:22.840380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 808/1529] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:22 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:22.844790 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-626a0e90-be08-46b2-af33-5a8608642a84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:22.845686 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-626a0e90-be08-46b2-af33-5a8608642a84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:22.851522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-626a0e90-be08-46b2-af33-5a8608642a84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:22.851996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-626a0e90-be08-46b2-af33-5a8608642a84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:22.852765 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-626a0e90-be08-46b2-af33-5a8608642a84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:22.853195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-626a0e90-be08-46b2-af33-5a8608642a84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:22.881618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-626a0e90-be08-46b2-af33-5a8608642a84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040284 May 12 07:10:22.882162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 809/1530] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:23.856801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3234af01-c05a-4d8c-9104-fa0f39e0d667 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:23.857474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3234af01-c05a-4d8c-9104-fa0f39e0d667 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:23.863702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3234af01-c05a-4d8c-9104-fa0f39e0d667 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:23.864166 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3234af01-c05a-4d8c-9104-fa0f39e0d667 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:23.864929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3234af01-c05a-4d8c-9104-fa0f39e0d667 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:23.865364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3234af01-c05a-4d8c-9104-fa0f39e0d667 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:23.929020 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3234af01-c05a-4d8c-9104-fa0f39e0d667 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:23.936286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3234af01-c05a-4d8c-9104-fa0f39e0d667 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083321 May 12 07:10:23.936850 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 810/1531] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:23 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:23.941244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-468f9e4e-1835-401a-84ce-e66da3288a44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:23.942146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-468f9e4e-1835-401a-84ce-e66da3288a44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:23.947965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-468f9e4e-1835-401a-84ce-e66da3288a44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:23.948427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-468f9e4e-1835-401a-84ce-e66da3288a44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:23.949208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-468f9e4e-1835-401a-84ce-e66da3288a44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:23.949651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-468f9e4e-1835-401a-84ce-e66da3288a44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:23.979309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-468f9e4e-1835-401a-84ce-e66da3288a44 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041460 May 12 07:10:23.979901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 811/1532] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:24.761176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-68f17b80-62c4-4053-b37f-9a5bcd6c9daa tempest-VolumesSnapshotsTestJSON-1098122012 tempest-VolumesSnapshotsTestJSON-1098122012-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 114.523129 May 12 07:10:24.761969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 722/1533] 10.222.0.25 () {60 vars in 1154 bytes} [Thu May 12 07:08:30 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 114525 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 12 07:10:24.952930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b5173382-4fd9-41f2-96ae-5b95de1048ef tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:24.953547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b5173382-4fd9-41f2-96ae-5b95de1048ef tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:24.959594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b5173382-4fd9-41f2-96ae-5b95de1048ef tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:24.960071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b5173382-4fd9-41f2-96ae-5b95de1048ef tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:24.961901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b5173382-4fd9-41f2-96ae-5b95de1048ef tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:24.962337 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b5173382-4fd9-41f2-96ae-5b95de1048ef tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:24.992465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b99944d0-e69e-458f-b148-4439cb8d98c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:24.993837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b99944d0-e69e-458f-b148-4439cb8d98c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:25.000818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b99944d0-e69e-458f-b148-4439cb8d98c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:25.001271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b99944d0-e69e-458f-b148-4439cb8d98c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:25.002234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b99944d0-e69e-458f-b148-4439cb8d98c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:25.002678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b99944d0-e69e-458f-b148-4439cb8d98c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:25.026635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b5173382-4fd9-41f2-96ae-5b95de1048ef tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:25.034156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b5173382-4fd9-41f2-96ae-5b95de1048ef tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084882 May 12 07:10:25.034374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b99944d0-e69e-458f-b148-4439cb8d98c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047708 May 12 07:10:25.034844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 812/1534] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:24 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:25.038605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 723/1535] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:25.141402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-08f8b2ba-3c10-4036-bd10-7408212bb605 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:25.142057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-08f8b2ba-3c10-4036-bd10-7408212bb605 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:25.148386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08f8b2ba-3c10-4036-bd10-7408212bb605 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:25.148840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08f8b2ba-3c10-4036-bd10-7408212bb605 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:25.149608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08f8b2ba-3c10-4036-bd10-7408212bb605 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:25.150044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08f8b2ba-3c10-4036-bd10-7408212bb605 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:25.174806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-08f8b2ba-3c10-4036-bd10-7408212bb605 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:10:25.442096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-08f8b2ba-3c10-4036-bd10-7408212bb605 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 204 len: 0 microversion: 2.20 time: 0.304209 May 12 07:10:25.442674 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 813/1536] 10.222.0.25 () {60 vars in 1279 bytes} [Thu May 12 07:10:25 2022] DELETE /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 07:10:25.450812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-33e86e36-5492-4eb7-b9ea-94864a6790f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:25.453628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-33e86e36-5492-4eb7-b9ea-94864a6790f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:25.458501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33e86e36-5492-4eb7-b9ea-94864a6790f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:25.458948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33e86e36-5492-4eb7-b9ea-94864a6790f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:25.459775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33e86e36-5492-4eb7-b9ea-94864a6790f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:25.460213 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33e86e36-5492-4eb7-b9ea-94864a6790f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:25.584854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-33e86e36-5492-4eb7-b9ea-94864a6790f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:25.593004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-33e86e36-5492-4eb7-b9ea-94864a6790f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:25.594488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-33e86e36-5492-4eb7-b9ea-94864a6790f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:25.595645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-33e86e36-5492-4eb7-b9ea-94864a6790f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148790 May 12 07:10:25.596230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 724/1537] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:25 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:10:26.045945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7285ac60-bbb5-4c94-8d49-a97d03591d88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:26.046973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7285ac60-bbb5-4c94-8d49-a97d03591d88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:26.050335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2261addc-760d-4b96-a065-51054819023a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:26.051445 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2261addc-760d-4b96-a065-51054819023a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:26.054599 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7285ac60-bbb5-4c94-8d49-a97d03591d88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:26.054750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7285ac60-bbb5-4c94-8d49-a97d03591d88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:26.055446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7285ac60-bbb5-4c94-8d49-a97d03591d88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:26.055918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7285ac60-bbb5-4c94-8d49-a97d03591d88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:26.057628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2261addc-760d-4b96-a065-51054819023a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:26.058068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2261addc-760d-4b96-a065-51054819023a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:26.058829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2261addc-760d-4b96-a065-51054819023a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:26.059264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2261addc-760d-4b96-a065-51054819023a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:26.085542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7285ac60-bbb5-4c94-8d49-a97d03591d88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 May 12 07:10:26.088609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 814/1538] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:26.123334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2261addc-760d-4b96-a065-51054819023a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:26.131243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2261addc-760d-4b96-a065-51054819023a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.085047 May 12 07:10:26.131837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 725/1539] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:26 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:26.614803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b908ffd2-9e5e-411c-bb91-14eb15389bfa tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:26.617989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b908ffd2-9e5e-411c-bb91-14eb15389bfa tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:26.628217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b908ffd2-9e5e-411c-bb91-14eb15389bfa tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:26.628668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b908ffd2-9e5e-411c-bb91-14eb15389bfa tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:26.629443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b908ffd2-9e5e-411c-bb91-14eb15389bfa tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:26.629884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b908ffd2-9e5e-411c-bb91-14eb15389bfa tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:26.754374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b908ffd2-9e5e-411c-bb91-14eb15389bfa tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:26.762565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b908ffd2-9e5e-411c-bb91-14eb15389bfa tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:26.764105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b908ffd2-9e5e-411c-bb91-14eb15389bfa tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:26.765273 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b908ffd2-9e5e-411c-bb91-14eb15389bfa tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.155091 May 12 07:10:26.765829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 815/1540] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:26 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:27.097112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9c6c7922-f922-431d-a9b0-8c5111ba485f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:27.098144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9c6c7922-f922-431d-a9b0-8c5111ba485f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:27.104480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c6c7922-f922-431d-a9b0-8c5111ba485f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:27.104926 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c6c7922-f922-431d-a9b0-8c5111ba485f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:27.105690 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c6c7922-f922-431d-a9b0-8c5111ba485f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:27.106124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c6c7922-f922-431d-a9b0-8c5111ba485f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:27.133935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9c6c7922-f922-431d-a9b0-8c5111ba485f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040835 May 12 07:10:27.134485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 726/1541] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:27.148187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-24fa1959-e3a9-43d5-bb22-ea3aa6e9675d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:27.148808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-24fa1959-e3a9-43d5-bb22-ea3aa6e9675d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:27.155091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24fa1959-e3a9-43d5-bb22-ea3aa6e9675d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:27.155544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24fa1959-e3a9-43d5-bb22-ea3aa6e9675d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:27.156354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24fa1959-e3a9-43d5-bb22-ea3aa6e9675d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:27.156795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24fa1959-e3a9-43d5-bb22-ea3aa6e9675d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:27.217712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-24fa1959-e3a9-43d5-bb22-ea3aa6e9675d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:27.224950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-24fa1959-e3a9-43d5-bb22-ea3aa6e9675d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081245 May 12 07:10:27.225513 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 816/1542] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:27 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:27.783843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cdef7f5a-e38b-4697-9d79-a80b7a16f526 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:27.784463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cdef7f5a-e38b-4697-9d79-a80b7a16f526 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:27.790861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cdef7f5a-e38b-4697-9d79-a80b7a16f526 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:27.791315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cdef7f5a-e38b-4697-9d79-a80b7a16f526 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:27.792134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cdef7f5a-e38b-4697-9d79-a80b7a16f526 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:27.792574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cdef7f5a-e38b-4697-9d79-a80b7a16f526 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:27.919592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cdef7f5a-e38b-4697-9d79-a80b7a16f526 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:27.928980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cdef7f5a-e38b-4697-9d79-a80b7a16f526 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:27.932944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cdef7f5a-e38b-4697-9d79-a80b7a16f526 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:27.932944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cdef7f5a-e38b-4697-9d79-a80b7a16f526 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151693 May 12 07:10:27.932944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 727/1543] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:27 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:28.145997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3049488c-ed30-4922-8961-d0f28fdbe9a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:28.146937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3049488c-ed30-4922-8961-d0f28fdbe9a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:28.153282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3049488c-ed30-4922-8961-d0f28fdbe9a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:28.153828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3049488c-ed30-4922-8961-d0f28fdbe9a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:28.154494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3049488c-ed30-4922-8961-d0f28fdbe9a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:28.154938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3049488c-ed30-4922-8961-d0f28fdbe9a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:28.183518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3049488c-ed30-4922-8961-d0f28fdbe9a4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042118 May 12 07:10:28.184105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 817/1544] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:28.241493 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3c9af4d7-26ab-4653-909b-0b6a374d90e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:28.242150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3c9af4d7-26ab-4653-909b-0b6a374d90e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:28.248535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c9af4d7-26ab-4653-909b-0b6a374d90e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:28.248987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c9af4d7-26ab-4653-909b-0b6a374d90e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:28.249759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c9af4d7-26ab-4653-909b-0b6a374d90e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:28.250200 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c9af4d7-26ab-4653-909b-0b6a374d90e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:28.310194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3c9af4d7-26ab-4653-909b-0b6a374d90e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:28.317411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3c9af4d7-26ab-4653-909b-0b6a374d90e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079818 May 12 07:10:28.317977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 728/1545] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:28 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:28.950379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ee3b2f24-2ef2-4adc-b066-dd478f8e874e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:28.950984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ee3b2f24-2ef2-4adc-b066-dd478f8e874e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:28.957388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee3b2f24-2ef2-4adc-b066-dd478f8e874e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:28.957841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee3b2f24-2ef2-4adc-b066-dd478f8e874e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:28.958609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee3b2f24-2ef2-4adc-b066-dd478f8e874e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:28.959054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee3b2f24-2ef2-4adc-b066-dd478f8e874e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:29.086540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ee3b2f24-2ef2-4adc-b066-dd478f8e874e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:29.094964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ee3b2f24-2ef2-4adc-b066-dd478f8e874e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:29.096508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ee3b2f24-2ef2-4adc-b066-dd478f8e874e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:29.098295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ee3b2f24-2ef2-4adc-b066-dd478f8e874e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151332 May 12 07:10:29.098848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 818/1546] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:28 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:29.194480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bb81abb6-8684-4891-baf6-629135c3df7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:29.195415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bb81abb6-8684-4891-baf6-629135c3df7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:29.201427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb81abb6-8684-4891-baf6-629135c3df7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:29.201824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb81abb6-8684-4891-baf6-629135c3df7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:29.202600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb81abb6-8684-4891-baf6-629135c3df7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:29.203043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb81abb6-8684-4891-baf6-629135c3df7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:29.231925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bb81abb6-8684-4891-baf6-629135c3df7d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041487 May 12 07:10:29.232478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 729/1547] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:29.334665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-88876dca-2d79-4315-9338-3d71c3d601e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:29.335397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-88876dca-2d79-4315-9338-3d71c3d601e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:29.341620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88876dca-2d79-4315-9338-3d71c3d601e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:29.342066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88876dca-2d79-4315-9338-3d71c3d601e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:29.342830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88876dca-2d79-4315-9338-3d71c3d601e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:29.343260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88876dca-2d79-4315-9338-3d71c3d601e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:29.405866 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-88876dca-2d79-4315-9338-3d71c3d601e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:29.413107 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-88876dca-2d79-4315-9338-3d71c3d601e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082835 May 12 07:10:29.413673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 819/1548] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:29 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:30.050390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:10:30.051468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:10:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:10:30.117333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4e7bdb82-6fa6-49e8-a6ca-9101eb3a8f69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:30.117944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4e7bdb82-6fa6-49e8-a6ca-9101eb3a8f69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:30.124273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4e7bdb82-6fa6-49e8-a6ca-9101eb3a8f69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:30.124722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4e7bdb82-6fa6-49e8-a6ca-9101eb3a8f69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:30.125485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4e7bdb82-6fa6-49e8-a6ca-9101eb3a8f69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:30.125923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4e7bdb82-6fa6-49e8-a6ca-9101eb3a8f69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:30.243475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3dcaf2a9-20d8-4e65-85d9-5d13a6a689cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:30.244438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3dcaf2a9-20d8-4e65-85d9-5d13a6a689cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:30.250199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dcaf2a9-20d8-4e65-85d9-5d13a6a689cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:30.250645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dcaf2a9-20d8-4e65-85d9-5d13a6a689cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:30.251436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dcaf2a9-20d8-4e65-85d9-5d13a6a689cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:30.251625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4e7bdb82-6fa6-49e8-a6ca-9101eb3a8f69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:30.251905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dcaf2a9-20d8-4e65-85d9-5d13a6a689cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:30.262772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4e7bdb82-6fa6-49e8-a6ca-9101eb3a8f69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:30.264299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4e7bdb82-6fa6-49e8-a6ca-9101eb3a8f69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:30.265470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4e7bdb82-6fa6-49e8-a6ca-9101eb3a8f69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152484 May 12 07:10:30.266023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 730/1549] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:30 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:30.281038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3dcaf2a9-20d8-4e65-85d9-5d13a6a689cc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041761 May 12 07:10:30.281586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 820/1550] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:10:30.429712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ba26f957-55de-41ac-9470-bda5d4fa4984 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:30.430332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ba26f957-55de-41ac-9470-bda5d4fa4984 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:30.436189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba26f957-55de-41ac-9470-bda5d4fa4984 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:30.436634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba26f957-55de-41ac-9470-bda5d4fa4984 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:30.437394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba26f957-55de-41ac-9470-bda5d4fa4984 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:30.437830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba26f957-55de-41ac-9470-bda5d4fa4984 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:30.496965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ba26f957-55de-41ac-9470-bda5d4fa4984 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:30.504133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ba26f957-55de-41ac-9470-bda5d4fa4984 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078269 May 12 07:10:30.504691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 731/1551] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:30 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:31.284323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-75a259a3-782d-4fed-a74c-30cee6faae15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:31.285670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-75a259a3-782d-4fed-a74c-30cee6faae15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:31.292464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75a259a3-782d-4fed-a74c-30cee6faae15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:31.292635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-055ffff8-d213-4514-9ef1-10b07658bc5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:31.293032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75a259a3-782d-4fed-a74c-30cee6faae15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:31.293457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-055ffff8-d213-4514-9ef1-10b07658bc5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:31.293657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75a259a3-782d-4fed-a74c-30cee6faae15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:31.294086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75a259a3-782d-4fed-a74c-30cee6faae15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:31.299832 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-055ffff8-d213-4514-9ef1-10b07658bc5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:31.300282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-055ffff8-d213-4514-9ef1-10b07658bc5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:31.301054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-055ffff8-d213-4514-9ef1-10b07658bc5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:31.301485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-055ffff8-d213-4514-9ef1-10b07658bc5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:31.330416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-055ffff8-d213-4514-9ef1-10b07658bc5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041930 May 12 07:10:31.334599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 732/1552] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:31.429295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-75a259a3-782d-4fed-a74c-30cee6faae15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:31.440019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-75a259a3-782d-4fed-a74c-30cee6faae15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:31.441566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-75a259a3-782d-4fed-a74c-30cee6faae15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:31.442741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-75a259a3-782d-4fed-a74c-30cee6faae15 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.162600 May 12 07:10:31.443401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 821/1553] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:31 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:31.521147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-58fc0967-2758-4269-aae8-1650aea7ac65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:31.521871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-58fc0967-2758-4269-aae8-1650aea7ac65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:31.527756 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58fc0967-2758-4269-aae8-1650aea7ac65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:31.528207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58fc0967-2758-4269-aae8-1650aea7ac65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:31.528965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58fc0967-2758-4269-aae8-1650aea7ac65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:31.529399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58fc0967-2758-4269-aae8-1650aea7ac65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:31.590723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-58fc0967-2758-4269-aae8-1650aea7ac65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:31.598399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-58fc0967-2758-4269-aae8-1650aea7ac65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081763 May 12 07:10:31.598954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 733/1554] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:31 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:32.342491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d09a9ba9-0c11-4e1e-8823-e067ba08eac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:32.343344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d09a9ba9-0c11-4e1e-8823-e067ba08eac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:32.349600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d09a9ba9-0c11-4e1e-8823-e067ba08eac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:32.350046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d09a9ba9-0c11-4e1e-8823-e067ba08eac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:32.350811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d09a9ba9-0c11-4e1e-8823-e067ba08eac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:32.351245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d09a9ba9-0c11-4e1e-8823-e067ba08eac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:32.379096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d09a9ba9-0c11-4e1e-8823-e067ba08eac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040190 May 12 07:10:32.379631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 822/1555] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:32.461491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6b79f8e3-0511-4e3f-a6c0-ee7fb2035886 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:32.462108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6b79f8e3-0511-4e3f-a6c0-ee7fb2035886 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:32.468493 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b79f8e3-0511-4e3f-a6c0-ee7fb2035886 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:32.468947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b79f8e3-0511-4e3f-a6c0-ee7fb2035886 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:32.469714 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b79f8e3-0511-4e3f-a6c0-ee7fb2035886 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:32.470153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b79f8e3-0511-4e3f-a6c0-ee7fb2035886 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:32.593516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6b79f8e3-0511-4e3f-a6c0-ee7fb2035886 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:32.601513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6b79f8e3-0511-4e3f-a6c0-ee7fb2035886 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:32.602995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6b79f8e3-0511-4e3f-a6c0-ee7fb2035886 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:32.604178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6b79f8e3-0511-4e3f-a6c0-ee7fb2035886 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147188 May 12 07:10:32.604736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 734/1556] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:32 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:10:32.615123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3ddbf1af-f7f3-4c40-ae7a-39e3e332b5df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:32.616298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3ddbf1af-f7f3-4c40-ae7a-39e3e332b5df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:32.622807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ddbf1af-f7f3-4c40-ae7a-39e3e332b5df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:32.623259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ddbf1af-f7f3-4c40-ae7a-39e3e332b5df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:32.624056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ddbf1af-f7f3-4c40-ae7a-39e3e332b5df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:32.624498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ddbf1af-f7f3-4c40-ae7a-39e3e332b5df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:32.688280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3ddbf1af-f7f3-4c40-ae7a-39e3e332b5df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:32.696264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3ddbf1af-f7f3-4c40-ae7a-39e3e332b5df tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.085941 May 12 07:10:32.696826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 823/1557] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:32 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:33.389711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4facf3f3-c9a9-4be3-a2f6-c11e1c86a46f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:33.390552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4facf3f3-c9a9-4be3-a2f6-c11e1c86a46f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:33.396948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4facf3f3-c9a9-4be3-a2f6-c11e1c86a46f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:33.397396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4facf3f3-c9a9-4be3-a2f6-c11e1c86a46f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:33.398159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4facf3f3-c9a9-4be3-a2f6-c11e1c86a46f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:33.398596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4facf3f3-c9a9-4be3-a2f6-c11e1c86a46f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:33.426962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4facf3f3-c9a9-4be3-a2f6-c11e1c86a46f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041270 May 12 07:10:33.427507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 735/1558] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:33 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:33.622376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6cb154c4-c7c7-43f2-89d9-96abb65d1896 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:33.623061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6cb154c4-c7c7-43f2-89d9-96abb65d1896 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:33.629352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cb154c4-c7c7-43f2-89d9-96abb65d1896 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:33.629798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cb154c4-c7c7-43f2-89d9-96abb65d1896 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:33.630562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cb154c4-c7c7-43f2-89d9-96abb65d1896 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:33.630997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cb154c4-c7c7-43f2-89d9-96abb65d1896 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:33.712817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e4615383-8a25-4912-97dc-cff246f75733 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:33.713427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e4615383-8a25-4912-97dc-cff246f75733 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:33.727456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4615383-8a25-4912-97dc-cff246f75733 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:33.727935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4615383-8a25-4912-97dc-cff246f75733 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:33.728720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4615383-8a25-4912-97dc-cff246f75733 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:33.729152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4615383-8a25-4912-97dc-cff246f75733 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:33.763321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6cb154c4-c7c7-43f2-89d9-96abb65d1896 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:33.773142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6cb154c4-c7c7-43f2-89d9-96abb65d1896 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:33.774843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6cb154c4-c7c7-43f2-89d9-96abb65d1896 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:33.776062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6cb154c4-c7c7-43f2-89d9-96abb65d1896 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.157651 May 12 07:10:33.778348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 824/1559] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:33 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:33.794643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e4615383-8a25-4912-97dc-cff246f75733 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:33.799366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e4615383-8a25-4912-97dc-cff246f75733 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.090425 May 12 07:10:33.799953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 736/1560] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:33 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:34.438610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-49a63f88-a59c-4d13-965b-aefd9b872dfd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:34.439483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-49a63f88-a59c-4d13-965b-aefd9b872dfd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:34.445912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49a63f88-a59c-4d13-965b-aefd9b872dfd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:34.446355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49a63f88-a59c-4d13-965b-aefd9b872dfd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:34.447117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49a63f88-a59c-4d13-965b-aefd9b872dfd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:34.447549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49a63f88-a59c-4d13-965b-aefd9b872dfd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:34.474746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-49a63f88-a59c-4d13-965b-aefd9b872dfd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040303 May 12 07:10:34.475293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 825/1561] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:34.793987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-983bebb9-85af-4d3a-ab19-b22759209e04 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:34.794604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-983bebb9-85af-4d3a-ab19-b22759209e04 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:34.801199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-983bebb9-85af-4d3a-ab19-b22759209e04 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:34.802257 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-983bebb9-85af-4d3a-ab19-b22759209e04 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:34.803061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-983bebb9-85af-4d3a-ab19-b22759209e04 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:34.803501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-983bebb9-85af-4d3a-ab19-b22759209e04 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:34.816218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c3c1b965-1f7e-419c-836d-9217a942bcbf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:34.816836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c3c1b965-1f7e-419c-836d-9217a942bcbf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:34.822960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3c1b965-1f7e-419c-836d-9217a942bcbf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:34.823410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3c1b965-1f7e-419c-836d-9217a942bcbf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:34.824225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3c1b965-1f7e-419c-836d-9217a942bcbf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:34.824667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3c1b965-1f7e-419c-836d-9217a942bcbf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:34.908511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c3c1b965-1f7e-419c-836d-9217a942bcbf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:34.916977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c3c1b965-1f7e-419c-836d-9217a942bcbf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.104606 May 12 07:10:34.917558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 826/1562] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:34 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:34.962579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-983bebb9-85af-4d3a-ab19-b22759209e04 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:34.970951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-983bebb9-85af-4d3a-ab19-b22759209e04 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:34.972655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-983bebb9-85af-4d3a-ab19-b22759209e04 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:34.974448 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-983bebb9-85af-4d3a-ab19-b22759209e04 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.184407 May 12 07:10:34.975012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 737/1563] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:34 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:35.485500 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f5cc513e-3adb-41e4-9a8b-9f3cac30ef0e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:35.486430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f5cc513e-3adb-41e4-9a8b-9f3cac30ef0e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:35.492353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5cc513e-3adb-41e4-9a8b-9f3cac30ef0e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:35.492821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5cc513e-3adb-41e4-9a8b-9f3cac30ef0e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:35.493600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5cc513e-3adb-41e4-9a8b-9f3cac30ef0e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:35.494045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5cc513e-3adb-41e4-9a8b-9f3cac30ef0e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:35.522903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f5cc513e-3adb-41e4-9a8b-9f3cac30ef0e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041414 May 12 07:10:35.523455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 827/1564] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:35 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:35.933730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f998d8eb-bf52-4738-8fa2-dccb1ef63b2b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:35.934346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f998d8eb-bf52-4738-8fa2-dccb1ef63b2b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:35.940742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f998d8eb-bf52-4738-8fa2-dccb1ef63b2b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:35.949575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f998d8eb-bf52-4738-8fa2-dccb1ef63b2b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:35.949575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f998d8eb-bf52-4738-8fa2-dccb1ef63b2b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:35.949575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f998d8eb-bf52-4738-8fa2-dccb1ef63b2b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:35.993377 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-da128436-3ca9-45cd-9029-aca31c18bb9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:35.994822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-da128436-3ca9-45cd-9029-aca31c18bb9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:36.000650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da128436-3ca9-45cd-9029-aca31c18bb9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:36.001102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da128436-3ca9-45cd-9029-aca31c18bb9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:36.002382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da128436-3ca9-45cd-9029-aca31c18bb9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:36.002382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da128436-3ca9-45cd-9029-aca31c18bb9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:36.004474 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f998d8eb-bf52-4738-8fa2-dccb1ef63b2b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:36.012049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f998d8eb-bf52-4738-8fa2-dccb1ef63b2b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082199 May 12 07:10:36.012631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 738/1565] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:35 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:36.129914 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-da128436-3ca9-45cd-9029-aca31c18bb9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:36.145925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-da128436-3ca9-45cd-9029-aca31c18bb9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:36.145925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-da128436-3ca9-45cd-9029-aca31c18bb9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:36.145925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-da128436-3ca9-45cd-9029-aca31c18bb9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151890 May 12 07:10:36.146266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 828/1566] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:35 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:36.534389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7e3a8aea-8c75-457d-bb00-f6cb1e8509f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:36.535308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7e3a8aea-8c75-457d-bb00-f6cb1e8509f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:36.541814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7e3a8aea-8c75-457d-bb00-f6cb1e8509f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:36.542255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7e3a8aea-8c75-457d-bb00-f6cb1e8509f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:36.543012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7e3a8aea-8c75-457d-bb00-f6cb1e8509f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:36.543445 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7e3a8aea-8c75-457d-bb00-f6cb1e8509f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:36.570948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7e3a8aea-8c75-457d-bb00-f6cb1e8509f5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040495 May 12 07:10:36.571486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 739/1567] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:37.028764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cc91b5c2-2076-4666-8873-6e49a60013e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:37.029370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cc91b5c2-2076-4666-8873-6e49a60013e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:37.035721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc91b5c2-2076-4666-8873-6e49a60013e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:37.036186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc91b5c2-2076-4666-8873-6e49a60013e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:37.036954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc91b5c2-2076-4666-8873-6e49a60013e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:37.037388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc91b5c2-2076-4666-8873-6e49a60013e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:37.097560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cc91b5c2-2076-4666-8873-6e49a60013e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:37.104822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cc91b5c2-2076-4666-8873-6e49a60013e3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079874 May 12 07:10:37.105382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 829/1568] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:37 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:37.158618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-748c1838-de1f-450a-b71b-4aa1645629df tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:37.159258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-748c1838-de1f-450a-b71b-4aa1645629df tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:37.165547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-748c1838-de1f-450a-b71b-4aa1645629df tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:37.165998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-748c1838-de1f-450a-b71b-4aa1645629df tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:37.166766 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-748c1838-de1f-450a-b71b-4aa1645629df tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:37.167208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-748c1838-de1f-450a-b71b-4aa1645629df tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:37.295347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-748c1838-de1f-450a-b71b-4aa1645629df tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:37.304303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-748c1838-de1f-450a-b71b-4aa1645629df tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:37.305798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-748c1838-de1f-450a-b71b-4aa1645629df tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:37.306966 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-748c1838-de1f-450a-b71b-4aa1645629df tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152287 May 12 07:10:37.307518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 740/1569] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:37 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:37.582457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fede7d63-e206-4f92-9e43-00c4984bfd97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:37.583325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fede7d63-e206-4f92-9e43-00c4984bfd97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:37.589241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fede7d63-e206-4f92-9e43-00c4984bfd97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:37.589692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fede7d63-e206-4f92-9e43-00c4984bfd97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:37.590463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fede7d63-e206-4f92-9e43-00c4984bfd97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:37.590901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fede7d63-e206-4f92-9e43-00c4984bfd97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:37.619539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fede7d63-e206-4f92-9e43-00c4984bfd97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041187 May 12 07:10:37.620111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 830/1570] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:38.121672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f6d10d4e-88bc-4111-b5c0-0ff203713981 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:38.122283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f6d10d4e-88bc-4111-b5c0-0ff203713981 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:38.128235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6d10d4e-88bc-4111-b5c0-0ff203713981 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:38.128686 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6d10d4e-88bc-4111-b5c0-0ff203713981 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:38.129455 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6d10d4e-88bc-4111-b5c0-0ff203713981 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:38.129896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6d10d4e-88bc-4111-b5c0-0ff203713981 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:38.192244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f6d10d4e-88bc-4111-b5c0-0ff203713981 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:38.199422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f6d10d4e-88bc-4111-b5c0-0ff203713981 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081622 May 12 07:10:38.200022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 741/1571] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:38 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:38.326599 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b83a9d09-4058-4b12-9e80-b53138afea16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:38.327206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b83a9d09-4058-4b12-9e80-b53138afea16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:38.334115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b83a9d09-4058-4b12-9e80-b53138afea16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:38.338356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b83a9d09-4058-4b12-9e80-b53138afea16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:38.338356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b83a9d09-4058-4b12-9e80-b53138afea16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:38.338356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b83a9d09-4058-4b12-9e80-b53138afea16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:38.460009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b83a9d09-4058-4b12-9e80-b53138afea16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:38.468192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b83a9d09-4058-4b12-9e80-b53138afea16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:38.469685 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b83a9d09-4058-4b12-9e80-b53138afea16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:38.470844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b83a9d09-4058-4b12-9e80-b53138afea16 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148232 May 12 07:10:38.471428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 831/1572] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:38 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:38.631623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-21b75628-7cfa-4e8f-aeae-9bbe258342e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:38.632507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-21b75628-7cfa-4e8f-aeae-9bbe258342e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:38.638410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21b75628-7cfa-4e8f-aeae-9bbe258342e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:38.638854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21b75628-7cfa-4e8f-aeae-9bbe258342e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:38.639641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21b75628-7cfa-4e8f-aeae-9bbe258342e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:38.640103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21b75628-7cfa-4e8f-aeae-9bbe258342e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:38.668744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-21b75628-7cfa-4e8f-aeae-9bbe258342e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041724 May 12 07:10:38.669286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 742/1573] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:38 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:39.216634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-29566ccc-45ec-4882-9e0a-8b3e1fe57a2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:39.217251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-29566ccc-45ec-4882-9e0a-8b3e1fe57a2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:39.223660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29566ccc-45ec-4882-9e0a-8b3e1fe57a2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:39.224142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29566ccc-45ec-4882-9e0a-8b3e1fe57a2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:39.224917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29566ccc-45ec-4882-9e0a-8b3e1fe57a2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:39.225355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29566ccc-45ec-4882-9e0a-8b3e1fe57a2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:39.286067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-29566ccc-45ec-4882-9e0a-8b3e1fe57a2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:39.293308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-29566ccc-45ec-4882-9e0a-8b3e1fe57a2a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080576 May 12 07:10:39.293904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 832/1574] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:39 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:39.489005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a84b2838-cf0b-4929-9511-32308141a5fb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:39.489623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a84b2838-cf0b-4929-9511-32308141a5fb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:39.495938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a84b2838-cf0b-4929-9511-32308141a5fb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:39.496400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a84b2838-cf0b-4929-9511-32308141a5fb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:39.497165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a84b2838-cf0b-4929-9511-32308141a5fb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:39.497602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a84b2838-cf0b-4929-9511-32308141a5fb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:39.623342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a84b2838-cf0b-4929-9511-32308141a5fb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:39.631520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a84b2838-cf0b-4929-9511-32308141a5fb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:39.633096 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a84b2838-cf0b-4929-9511-32308141a5fb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:39.634259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a84b2838-cf0b-4929-9511-32308141a5fb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149204 May 12 07:10:39.634818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 743/1575] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:39 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:39.680663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ac909467-c0e8-46ae-bae3-1e20a3656ad9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:39.681591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ac909467-c0e8-46ae-bae3-1e20a3656ad9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:39.688467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac909467-c0e8-46ae-bae3-1e20a3656ad9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:39.688921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac909467-c0e8-46ae-bae3-1e20a3656ad9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:39.689867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac909467-c0e8-46ae-bae3-1e20a3656ad9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:39.690533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac909467-c0e8-46ae-bae3-1e20a3656ad9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:39.719057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ac909467-c0e8-46ae-bae3-1e20a3656ad9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042519 May 12 07:10:39.719605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 833/1576] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:40.310925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-302a57d7-db55-4a18-b50c-d9e5315d4896 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:40.311546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-302a57d7-db55-4a18-b50c-d9e5315d4896 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:40.318060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-302a57d7-db55-4a18-b50c-d9e5315d4896 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:40.318513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-302a57d7-db55-4a18-b50c-d9e5315d4896 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:40.319294 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-302a57d7-db55-4a18-b50c-d9e5315d4896 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:40.319754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-302a57d7-db55-4a18-b50c-d9e5315d4896 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:40.378245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-302a57d7-db55-4a18-b50c-d9e5315d4896 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:40.386200 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-302a57d7-db55-4a18-b50c-d9e5315d4896 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079247 May 12 07:10:40.386763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 744/1577] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:40 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:40.652411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cb8a0576-aacd-4dcd-be8b-094137d3f70b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:40.652952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cb8a0576-aacd-4dcd-be8b-094137d3f70b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:40.658766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb8a0576-aacd-4dcd-be8b-094137d3f70b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:40.659216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb8a0576-aacd-4dcd-be8b-094137d3f70b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:40.660010 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb8a0576-aacd-4dcd-be8b-094137d3f70b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:40.660448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb8a0576-aacd-4dcd-be8b-094137d3f70b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:40.731063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c30edfa7-9280-411f-a152-e061df058b70 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:40.732026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c30edfa7-9280-411f-a152-e061df058b70 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:40.738126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c30edfa7-9280-411f-a152-e061df058b70 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:40.738664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c30edfa7-9280-411f-a152-e061df058b70 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:40.739342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c30edfa7-9280-411f-a152-e061df058b70 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:40.740360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c30edfa7-9280-411f-a152-e061df058b70 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:40.769011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c30edfa7-9280-411f-a152-e061df058b70 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041932 May 12 07:10:40.769572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 745/1578] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:40 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:10:40.788005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cb8a0576-aacd-4dcd-be8b-094137d3f70b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:40.796173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cb8a0576-aacd-4dcd-be8b-094137d3f70b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:40.797665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cb8a0576-aacd-4dcd-be8b-094137d3f70b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:40.799112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cb8a0576-aacd-4dcd-be8b-094137d3f70b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150349 May 12 07:10:40.799662 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 834/1579] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:40 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:41.402777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-df194370-9c24-43fc-bb1d-f6768f7e201f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:41.403387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-df194370-9c24-43fc-bb1d-f6768f7e201f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:41.409339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-df194370-9c24-43fc-bb1d-f6768f7e201f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:41.409787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-df194370-9c24-43fc-bb1d-f6768f7e201f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:41.410549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-df194370-9c24-43fc-bb1d-f6768f7e201f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:41.410980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-df194370-9c24-43fc-bb1d-f6768f7e201f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:41.474063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-df194370-9c24-43fc-bb1d-f6768f7e201f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:41.481473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-df194370-9c24-43fc-bb1d-f6768f7e201f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082506 May 12 07:10:41.482063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 746/1580] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:41 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:41.780401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-01302553-be78-4545-80de-20a14f303d1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:41.781325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-01302553-be78-4545-80de-20a14f303d1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:41.787623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01302553-be78-4545-80de-20a14f303d1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:41.788095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01302553-be78-4545-80de-20a14f303d1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:41.788860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01302553-be78-4545-80de-20a14f303d1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:41.789295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-01302553-be78-4545-80de-20a14f303d1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:41.818942 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c9fe3a85-40ec-449a-b48f-9d6fd1b748b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:41.819504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-01302553-be78-4545-80de-20a14f303d1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042277 May 12 07:10:41.819624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c9fe3a85-40ec-449a-b48f-9d6fd1b748b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:41.820017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 835/1581] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:41 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:41.825891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9fe3a85-40ec-449a-b48f-9d6fd1b748b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:41.826339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9fe3a85-40ec-449a-b48f-9d6fd1b748b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:41.827116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9fe3a85-40ec-449a-b48f-9d6fd1b748b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:41.827549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9fe3a85-40ec-449a-b48f-9d6fd1b748b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:41.951187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c9fe3a85-40ec-449a-b48f-9d6fd1b748b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:41.959393 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c9fe3a85-40ec-449a-b48f-9d6fd1b748b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:41.960919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c9fe3a85-40ec-449a-b48f-9d6fd1b748b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:41.962086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c9fe3a85-40ec-449a-b48f-9d6fd1b748b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147634 May 12 07:10:41.962647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 747/1582] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:41 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:10:42.498131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1fe8a6ab-0f1f-4ee8-816e-9e739c2899be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:42.498740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1fe8a6ab-0f1f-4ee8-816e-9e739c2899be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:42.505624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fe8a6ab-0f1f-4ee8-816e-9e739c2899be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:42.506082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fe8a6ab-0f1f-4ee8-816e-9e739c2899be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:42.506852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fe8a6ab-0f1f-4ee8-816e-9e739c2899be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:42.507294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fe8a6ab-0f1f-4ee8-816e-9e739c2899be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:42.565947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1fe8a6ab-0f1f-4ee8-816e-9e739c2899be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:42.576156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1fe8a6ab-0f1f-4ee8-816e-9e739c2899be tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081866 May 12 07:10:42.576723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 836/1583] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:42 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:42.830789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e8262694-ce93-4103-80e5-f32e624ce123 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:42.831638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e8262694-ce93-4103-80e5-f32e624ce123 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:42.838757 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8262694-ce93-4103-80e5-f32e624ce123 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:42.839203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8262694-ce93-4103-80e5-f32e624ce123 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:42.839998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8262694-ce93-4103-80e5-f32e624ce123 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:42.840430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8262694-ce93-4103-80e5-f32e624ce123 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:42.869151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e8262694-ce93-4103-80e5-f32e624ce123 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 May 12 07:10:42.869701 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 748/1584] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:42 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:42.981023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-beea7f3c-4e0f-4593-8061-a81ee963636c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:42.981683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-beea7f3c-4e0f-4593-8061-a81ee963636c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:42.988270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-beea7f3c-4e0f-4593-8061-a81ee963636c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:42.988723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-beea7f3c-4e0f-4593-8061-a81ee963636c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:42.990161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-beea7f3c-4e0f-4593-8061-a81ee963636c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:42.990603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-beea7f3c-4e0f-4593-8061-a81ee963636c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:43.118431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-beea7f3c-4e0f-4593-8061-a81ee963636c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:43.126622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-beea7f3c-4e0f-4593-8061-a81ee963636c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:43.128147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-beea7f3c-4e0f-4593-8061-a81ee963636c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:43.129298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-beea7f3c-4e0f-4593-8061-a81ee963636c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152355 May 12 07:10:43.129858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 837/1585] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:42 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:43.592733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-946ca5a8-df6e-4b99-bfff-e791d115ec49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:43.593337 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-946ca5a8-df6e-4b99-bfff-e791d115ec49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:43.599209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-946ca5a8-df6e-4b99-bfff-e791d115ec49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:43.599651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-946ca5a8-df6e-4b99-bfff-e791d115ec49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:43.600439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-946ca5a8-df6e-4b99-bfff-e791d115ec49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:43.600873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-946ca5a8-df6e-4b99-bfff-e791d115ec49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:43.659727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-946ca5a8-df6e-4b99-bfff-e791d115ec49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:43.666949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-946ca5a8-df6e-4b99-bfff-e791d115ec49 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078061 May 12 07:10:43.667507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 749/1586] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:43 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:43.881354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7df073ee-626d-4975-963a-ea9a67764fce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:43.882200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7df073ee-626d-4975-963a-ea9a67764fce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:43.888134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7df073ee-626d-4975-963a-ea9a67764fce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:43.888596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7df073ee-626d-4975-963a-ea9a67764fce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:43.889366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7df073ee-626d-4975-963a-ea9a67764fce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:43.889807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7df073ee-626d-4975-963a-ea9a67764fce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:43.917478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7df073ee-626d-4975-963a-ea9a67764fce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040858 May 12 07:10:43.918022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 838/1587] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:44.147895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a4577b7d-5bee-4845-ac20-2b4b521aa437 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:44.148473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a4577b7d-5bee-4845-ac20-2b4b521aa437 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:44.154980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4577b7d-5bee-4845-ac20-2b4b521aa437 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:44.155428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4577b7d-5bee-4845-ac20-2b4b521aa437 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:44.156220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4577b7d-5bee-4845-ac20-2b4b521aa437 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:44.156655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a4577b7d-5bee-4845-ac20-2b4b521aa437 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:44.281520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a4577b7d-5bee-4845-ac20-2b4b521aa437 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:44.290433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a4577b7d-5bee-4845-ac20-2b4b521aa437 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:44.291964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a4577b7d-5bee-4845-ac20-2b4b521aa437 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:44.293125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a4577b7d-5bee-4845-ac20-2b4b521aa437 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149308 May 12 07:10:44.293685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 750/1588] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:44 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:44.683862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-222aa907-a861-46ba-86ca-5d613142b1cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:44.684632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-222aa907-a861-46ba-86ca-5d613142b1cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:44.690863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-222aa907-a861-46ba-86ca-5d613142b1cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:44.696122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-222aa907-a861-46ba-86ca-5d613142b1cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:44.696122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-222aa907-a861-46ba-86ca-5d613142b1cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:44.696122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-222aa907-a861-46ba-86ca-5d613142b1cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:44.755417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-222aa907-a861-46ba-86ca-5d613142b1cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:44.762751 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-222aa907-a861-46ba-86ca-5d613142b1cf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082857 May 12 07:10:44.763318 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 839/1589] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:44 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:44.929074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cb3dc2c7-3b0e-4d46-ba90-a96e9983b6b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:44.929998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cb3dc2c7-3b0e-4d46-ba90-a96e9983b6b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:44.935899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cb3dc2c7-3b0e-4d46-ba90-a96e9983b6b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:44.936294 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cb3dc2c7-3b0e-4d46-ba90-a96e9983b6b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:44.937053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cb3dc2c7-3b0e-4d46-ba90-a96e9983b6b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:44.937491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cb3dc2c7-3b0e-4d46-ba90-a96e9983b6b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:44.966640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cb3dc2c7-3b0e-4d46-ba90-a96e9983b6b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 May 12 07:10:44.967185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 751/1590] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:45.312293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3a6e976e-25a6-4066-bd4d-cd154926aff2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:45.312918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3a6e976e-25a6-4066-bd4d-cd154926aff2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:45.318877 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a6e976e-25a6-4066-bd4d-cd154926aff2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:45.319330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a6e976e-25a6-4066-bd4d-cd154926aff2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:45.320147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a6e976e-25a6-4066-bd4d-cd154926aff2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:45.320590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a6e976e-25a6-4066-bd4d-cd154926aff2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:45.443485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3a6e976e-25a6-4066-bd4d-cd154926aff2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:45.452180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3a6e976e-25a6-4066-bd4d-cd154926aff2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:45.453711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3a6e976e-25a6-4066-bd4d-cd154926aff2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:45.454884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3a6e976e-25a6-4066-bd4d-cd154926aff2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146529 May 12 07:10:45.455446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 840/1591] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:45 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:45.780019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e912a06e-b316-4c6c-b8e8-338a16121901 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:45.780630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e912a06e-b316-4c6c-b8e8-338a16121901 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:45.786845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e912a06e-b316-4c6c-b8e8-338a16121901 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:45.787290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e912a06e-b316-4c6c-b8e8-338a16121901 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:45.788082 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e912a06e-b316-4c6c-b8e8-338a16121901 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:45.788515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e912a06e-b316-4c6c-b8e8-338a16121901 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:45.848088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e912a06e-b316-4c6c-b8e8-338a16121901 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:45.855352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e912a06e-b316-4c6c-b8e8-338a16121901 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079132 May 12 07:10:45.855936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 752/1592] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:45 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:45.978239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e51d7e02-d0fb-4929-ada6-39c42b6e5c2a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:45.979175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e51d7e02-d0fb-4929-ada6-39c42b6e5c2a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:45.985687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e51d7e02-d0fb-4929-ada6-39c42b6e5c2a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:45.986131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e51d7e02-d0fb-4929-ada6-39c42b6e5c2a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:45.986915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e51d7e02-d0fb-4929-ada6-39c42b6e5c2a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:45.987365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e51d7e02-d0fb-4929-ada6-39c42b6e5c2a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:46.017759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e51d7e02-d0fb-4929-ada6-39c42b6e5c2a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043546 May 12 07:10:46.018326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 841/1593] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:45 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:46.474445 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-18e754e5-9ddd-4b3b-86b1-d2f045a3b11e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:46.475053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-18e754e5-9ddd-4b3b-86b1-d2f045a3b11e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:46.481053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-18e754e5-9ddd-4b3b-86b1-d2f045a3b11e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:46.481504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-18e754e5-9ddd-4b3b-86b1-d2f045a3b11e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:46.482271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-18e754e5-9ddd-4b3b-86b1-d2f045a3b11e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:46.482735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-18e754e5-9ddd-4b3b-86b1-d2f045a3b11e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:46.609300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-18e754e5-9ddd-4b3b-86b1-d2f045a3b11e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:46.618141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-18e754e5-9ddd-4b3b-86b1-d2f045a3b11e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:46.619648 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-18e754e5-9ddd-4b3b-86b1-d2f045a3b11e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:46.620833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-18e754e5-9ddd-4b3b-86b1-d2f045a3b11e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150352 May 12 07:10:46.621679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 753/1594] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:46 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:46.871723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fa54c711-a0b6-4bad-811b-62aa75836d96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:46.872339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fa54c711-a0b6-4bad-811b-62aa75836d96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:46.878229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa54c711-a0b6-4bad-811b-62aa75836d96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:46.878684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa54c711-a0b6-4bad-811b-62aa75836d96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:46.879461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa54c711-a0b6-4bad-811b-62aa75836d96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:46.879932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa54c711-a0b6-4bad-811b-62aa75836d96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:46.940002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fa54c711-a0b6-4bad-811b-62aa75836d96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:46.947406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fa54c711-a0b6-4bad-811b-62aa75836d96 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079539 May 12 07:10:46.948086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 842/1595] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:46 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:47.030225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-403d06d0-0857-4bf5-8f88-7a997963d829 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:47.031158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-403d06d0-0857-4bf5-8f88-7a997963d829 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:47.037702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-403d06d0-0857-4bf5-8f88-7a997963d829 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:47.038154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-403d06d0-0857-4bf5-8f88-7a997963d829 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:47.039449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-403d06d0-0857-4bf5-8f88-7a997963d829 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:47.039947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-403d06d0-0857-4bf5-8f88-7a997963d829 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:47.068688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-403d06d0-0857-4bf5-8f88-7a997963d829 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042412 May 12 07:10:47.069238 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 754/1596] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:47.639292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3dc82c0e-7a9f-4c2d-91b9-8533e868b4b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:47.639940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3dc82c0e-7a9f-4c2d-91b9-8533e868b4b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:47.646856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dc82c0e-7a9f-4c2d-91b9-8533e868b4b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:47.647310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dc82c0e-7a9f-4c2d-91b9-8533e868b4b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:47.648127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dc82c0e-7a9f-4c2d-91b9-8533e868b4b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:47.648572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dc82c0e-7a9f-4c2d-91b9-8533e868b4b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:47.773898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3dc82c0e-7a9f-4c2d-91b9-8533e868b4b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:47.782126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3dc82c0e-7a9f-4c2d-91b9-8533e868b4b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:47.783640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3dc82c0e-7a9f-4c2d-91b9-8533e868b4b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:47.784832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3dc82c0e-7a9f-4c2d-91b9-8533e868b4b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149454 May 12 07:10:47.785394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 843/1597] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:47 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:47.964947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bad7d202-b78f-4432-b4c5-027bc3d2c1a8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:47.965493 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bad7d202-b78f-4432-b4c5-027bc3d2c1a8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:47.971402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bad7d202-b78f-4432-b4c5-027bc3d2c1a8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:47.978470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bad7d202-b78f-4432-b4c5-027bc3d2c1a8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:47.978470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bad7d202-b78f-4432-b4c5-027bc3d2c1a8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:47.978470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bad7d202-b78f-4432-b4c5-027bc3d2c1a8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:48.036423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bad7d202-b78f-4432-b4c5-027bc3d2c1a8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:48.044311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bad7d202-b78f-4432-b4c5-027bc3d2c1a8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083332 May 12 07:10:48.044880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 755/1598] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:47 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:48.080211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fb1c2951-ffa6-49ea-9c07-338fa4a967ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:48.081173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fb1c2951-ffa6-49ea-9c07-338fa4a967ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:48.087096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb1c2951-ffa6-49ea-9c07-338fa4a967ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:48.087535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb1c2951-ffa6-49ea-9c07-338fa4a967ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:48.088338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb1c2951-ffa6-49ea-9c07-338fa4a967ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:48.088781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb1c2951-ffa6-49ea-9c07-338fa4a967ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:48.118289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fb1c2951-ffa6-49ea-9c07-338fa4a967ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042005 May 12 07:10:48.118852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 844/1599] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:48 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:48.804049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-95485bd6-e813-43db-a5c6-72b35260c343 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:48.804661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-95485bd6-e813-43db-a5c6-72b35260c343 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:48.810738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-95485bd6-e813-43db-a5c6-72b35260c343 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:48.811186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-95485bd6-e813-43db-a5c6-72b35260c343 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:48.811987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-95485bd6-e813-43db-a5c6-72b35260c343 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:48.812423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-95485bd6-e813-43db-a5c6-72b35260c343 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:48.936538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-95485bd6-e813-43db-a5c6-72b35260c343 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:48.944661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-95485bd6-e813-43db-a5c6-72b35260c343 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:48.946152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-95485bd6-e813-43db-a5c6-72b35260c343 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:48.947302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-95485bd6-e813-43db-a5c6-72b35260c343 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147911 May 12 07:10:48.947897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 756/1600] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:48 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:49.061507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-54a0675e-80c8-4060-a71d-60b5211b1b6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:49.062049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-54a0675e-80c8-4060-a71d-60b5211b1b6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:49.068521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54a0675e-80c8-4060-a71d-60b5211b1b6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:49.068966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54a0675e-80c8-4060-a71d-60b5211b1b6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:49.069731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54a0675e-80c8-4060-a71d-60b5211b1b6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:49.070163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54a0675e-80c8-4060-a71d-60b5211b1b6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:49.129732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-54a0675e-80c8-4060-a71d-60b5211b1b6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:49.129968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1a535cca-3317-47a4-8219-82a019dbe99f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:49.130885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1a535cca-3317-47a4-8219-82a019dbe99f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:49.137198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-54a0675e-80c8-4060-a71d-60b5211b1b6a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079611 May 12 07:10:49.137340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a535cca-3317-47a4-8219-82a019dbe99f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:49.137768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a535cca-3317-47a4-8219-82a019dbe99f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:49.137889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 845/1601] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:49 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:49.138608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a535cca-3317-47a4-8219-82a019dbe99f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:49.139056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a535cca-3317-47a4-8219-82a019dbe99f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:49.168670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1a535cca-3317-47a4-8219-82a019dbe99f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042586 May 12 07:10:49.169226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 757/1602] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:49 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:10:49.965387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6d93ef07-709c-4e03-b34b-7322ae81091a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:49.966025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6d93ef07-709c-4e03-b34b-7322ae81091a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:49.972070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6d93ef07-709c-4e03-b34b-7322ae81091a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:49.972512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6d93ef07-709c-4e03-b34b-7322ae81091a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:49.973277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6d93ef07-709c-4e03-b34b-7322ae81091a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:49.973711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6d93ef07-709c-4e03-b34b-7322ae81091a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:50.099892 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6d93ef07-709c-4e03-b34b-7322ae81091a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:50.108119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6d93ef07-709c-4e03-b34b-7322ae81091a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:50.109624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6d93ef07-709c-4e03-b34b-7322ae81091a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:50.110786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6d93ef07-709c-4e03-b34b-7322ae81091a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149320 May 12 07:10:50.111355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 846/1603] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:49 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:50.154174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-434f2784-46aa-409f-96dc-e223b7e53faa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:50.154802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-434f2784-46aa-409f-96dc-e223b7e53faa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:50.161076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434f2784-46aa-409f-96dc-e223b7e53faa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:50.161528 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434f2784-46aa-409f-96dc-e223b7e53faa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:50.162294 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434f2784-46aa-409f-96dc-e223b7e53faa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:50.162730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-434f2784-46aa-409f-96dc-e223b7e53faa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:50.180850 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-828beaae-5177-49dd-aeeb-db0f2530c7be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:50.181813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-828beaae-5177-49dd-aeeb-db0f2530c7be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:50.187600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-828beaae-5177-49dd-aeeb-db0f2530c7be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:50.188112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-828beaae-5177-49dd-aeeb-db0f2530c7be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:50.188890 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-828beaae-5177-49dd-aeeb-db0f2530c7be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:50.189328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-828beaae-5177-49dd-aeeb-db0f2530c7be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:50.218981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-828beaae-5177-49dd-aeeb-db0f2530c7be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042414 May 12 07:10:50.219713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 847/1604] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:10:50.224804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-434f2784-46aa-409f-96dc-e223b7e53faa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:50.232175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-434f2784-46aa-409f-96dc-e223b7e53faa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081885 May 12 07:10:50.232732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 758/1605] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:50 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:51.130281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b5a81cdc-1a42-4f8d-a76e-6bed34d92b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:51.130895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b5a81cdc-1a42-4f8d-a76e-6bed34d92b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:51.137127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b5a81cdc-1a42-4f8d-a76e-6bed34d92b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:51.137577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b5a81cdc-1a42-4f8d-a76e-6bed34d92b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:51.138345 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b5a81cdc-1a42-4f8d-a76e-6bed34d92b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:51.138783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b5a81cdc-1a42-4f8d-a76e-6bed34d92b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:51.230377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f3f96844-e8ab-4139-88b0-4e885a7383bc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:51.231428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f3f96844-e8ab-4139-88b0-4e885a7383bc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:51.237518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f3f96844-e8ab-4139-88b0-4e885a7383bc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:51.238051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f3f96844-e8ab-4139-88b0-4e885a7383bc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:51.238891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f3f96844-e8ab-4139-88b0-4e885a7383bc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:51.239424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f3f96844-e8ab-4139-88b0-4e885a7383bc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:51.264770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b5a81cdc-1a42-4f8d-a76e-6bed34d92b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:51.268904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f3f96844-e8ab-4139-88b0-4e885a7383bc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042363 May 12 07:10:51.269554 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 759/1606] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:10:51.273946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b5a81cdc-1a42-4f8d-a76e-6bed34d92b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:51.274649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-09354382-5310-4dbb-91ab-f188bc0ba5d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:51.275269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-09354382-5310-4dbb-91ab-f188bc0ba5d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:51.275454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b5a81cdc-1a42-4f8d-a76e-6bed34d92b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:51.276652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b5a81cdc-1a42-4f8d-a76e-6bed34d92b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150841 May 12 07:10:51.277207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 848/1607] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:51 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:51.281185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09354382-5310-4dbb-91ab-f188bc0ba5d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:51.281644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09354382-5310-4dbb-91ab-f188bc0ba5d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:51.282426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09354382-5310-4dbb-91ab-f188bc0ba5d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:51.282873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09354382-5310-4dbb-91ab-f188bc0ba5d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:51.347874 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-09354382-5310-4dbb-91ab-f188bc0ba5d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:51.355127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-09354382-5310-4dbb-91ab-f188bc0ba5d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084640 May 12 07:10:51.355709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 760/1608] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:51 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:52.281146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c2303a78-3c82-4467-bba1-cf65ef58ce80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:52.282034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c2303a78-3c82-4467-bba1-cf65ef58ce80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:52.288167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2303a78-3c82-4467-bba1-cf65ef58ce80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:52.288616 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2303a78-3c82-4467-bba1-cf65ef58ce80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:52.289401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2303a78-3c82-4467-bba1-cf65ef58ce80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:52.289841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c2303a78-3c82-4467-bba1-cf65ef58ce80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:52.294237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3fd8db72-2b78-4e54-8921-18288df66a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:52.294820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3fd8db72-2b78-4e54-8921-18288df66a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:52.301838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3fd8db72-2b78-4e54-8921-18288df66a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:52.302291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3fd8db72-2b78-4e54-8921-18288df66a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:52.303049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3fd8db72-2b78-4e54-8921-18288df66a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:52.303481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3fd8db72-2b78-4e54-8921-18288df66a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:52.320743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c2303a78-3c82-4467-bba1-cf65ef58ce80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043641 May 12 07:10:52.321493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 849/1609] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:52.372120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6df96264-dddd-4532-8dd9-291747eae363 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:52.372734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6df96264-dddd-4532-8dd9-291747eae363 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:52.378483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6df96264-dddd-4532-8dd9-291747eae363 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:52.379268 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6df96264-dddd-4532-8dd9-291747eae363 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:52.380274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6df96264-dddd-4532-8dd9-291747eae363 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:52.380833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6df96264-dddd-4532-8dd9-291747eae363 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:52.447921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6df96264-dddd-4532-8dd9-291747eae363 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:52.452322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3fd8db72-2b78-4e54-8921-18288df66a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:52.455274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6df96264-dddd-4532-8dd9-291747eae363 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.087049 May 12 07:10:52.455880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 850/1610] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:52 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:10:52.460768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3fd8db72-2b78-4e54-8921-18288df66a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:52.462368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3fd8db72-2b78-4e54-8921-18288df66a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:52.463529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3fd8db72-2b78-4e54-8921-18288df66a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.173119 May 12 07:10:52.464117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 761/1611] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:52 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:10:53.332385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0d7cbd0f-d5fe-425e-97bc-8ddc82da9146 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:53.333236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0d7cbd0f-d5fe-425e-97bc-8ddc82da9146 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:53.339528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d7cbd0f-d5fe-425e-97bc-8ddc82da9146 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:53.340009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d7cbd0f-d5fe-425e-97bc-8ddc82da9146 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:53.340783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d7cbd0f-d5fe-425e-97bc-8ddc82da9146 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:53.341221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d7cbd0f-d5fe-425e-97bc-8ddc82da9146 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:53.371848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0d7cbd0f-d5fe-425e-97bc-8ddc82da9146 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043549 May 12 07:10:53.372393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 851/1612] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:53.471084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-93ab34b6-3fcb-43e1-89e5-6540452449a0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:53.471720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-93ab34b6-3fcb-43e1-89e5-6540452449a0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:53.478593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93ab34b6-3fcb-43e1-89e5-6540452449a0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:53.479042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93ab34b6-3fcb-43e1-89e5-6540452449a0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:53.479848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93ab34b6-3fcb-43e1-89e5-6540452449a0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:53.480289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93ab34b6-3fcb-43e1-89e5-6540452449a0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:53.481141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0c4c1d30-6d8d-41dc-99d4-0817c5aa8358 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:53.481746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0c4c1d30-6d8d-41dc-99d4-0817c5aa8358 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:53.487464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c4c1d30-6d8d-41dc-99d4-0817c5aa8358 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:53.487941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c4c1d30-6d8d-41dc-99d4-0817c5aa8358 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:53.488705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c4c1d30-6d8d-41dc-99d4-0817c5aa8358 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:53.489811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c4c1d30-6d8d-41dc-99d4-0817c5aa8358 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:53.546601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-93ab34b6-3fcb-43e1-89e5-6540452449a0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:53.554805 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-93ab34b6-3fcb-43e1-89e5-6540452449a0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.087579 May 12 07:10:53.555376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 762/1613] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:53 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:53.627978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0c4c1d30-6d8d-41dc-99d4-0817c5aa8358 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:53.636071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0c4c1d30-6d8d-41dc-99d4-0817c5aa8358 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:53.637572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0c4c1d30-6d8d-41dc-99d4-0817c5aa8358 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:53.638718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0c4c1d30-6d8d-41dc-99d4-0817c5aa8358 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.161427 May 12 07:10:53.639276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 852/1614] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:53 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:10:54.384272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0b820ad1-bf5f-46de-b675-39ea875bdf15 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:54.385192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0b820ad1-bf5f-46de-b675-39ea875bdf15 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:54.391077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b820ad1-bf5f-46de-b675-39ea875bdf15 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:54.391521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b820ad1-bf5f-46de-b675-39ea875bdf15 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:54.392308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b820ad1-bf5f-46de-b675-39ea875bdf15 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:54.392738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b820ad1-bf5f-46de-b675-39ea875bdf15 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:54.420272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0b820ad1-bf5f-46de-b675-39ea875bdf15 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040797 May 12 07:10:54.420813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 763/1615] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:54.571250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a29a160e-fcb7-4c23-beaa-7992da555e4e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:54.571899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a29a160e-fcb7-4c23-beaa-7992da555e4e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:54.578155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a29a160e-fcb7-4c23-beaa-7992da555e4e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:54.578607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a29a160e-fcb7-4c23-beaa-7992da555e4e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:54.579372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a29a160e-fcb7-4c23-beaa-7992da555e4e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:54.579835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a29a160e-fcb7-4c23-beaa-7992da555e4e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:54.641030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a29a160e-fcb7-4c23-beaa-7992da555e4e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:54.648375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a29a160e-fcb7-4c23-beaa-7992da555e4e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081599 May 12 07:10:54.648935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 853/1616] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:54 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:54.657719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-313298eb-1190-4232-8b5a-d4c7fca11df0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:54.658334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-313298eb-1190-4232-8b5a-d4c7fca11df0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:54.664601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-313298eb-1190-4232-8b5a-d4c7fca11df0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:54.665053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-313298eb-1190-4232-8b5a-d4c7fca11df0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:54.665819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-313298eb-1190-4232-8b5a-d4c7fca11df0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:54.666257 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-313298eb-1190-4232-8b5a-d4c7fca11df0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:54.791977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-313298eb-1190-4232-8b5a-d4c7fca11df0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:54.800340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-313298eb-1190-4232-8b5a-d4c7fca11df0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:54.802423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-313298eb-1190-4232-8b5a-d4c7fca11df0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:54.803568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-313298eb-1190-4232-8b5a-d4c7fca11df0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149789 May 12 07:10:54.804163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 764/1617] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:54 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:55.431585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-102e309c-8bf0-4c2b-9d51-e0562ed18171 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:55.432439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-102e309c-8bf0-4c2b-9d51-e0562ed18171 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:55.438314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-102e309c-8bf0-4c2b-9d51-e0562ed18171 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:55.438759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-102e309c-8bf0-4c2b-9d51-e0562ed18171 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:55.439524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-102e309c-8bf0-4c2b-9d51-e0562ed18171 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:55.439991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-102e309c-8bf0-4c2b-9d51-e0562ed18171 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:55.468722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-102e309c-8bf0-4c2b-9d51-e0562ed18171 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 May 12 07:10:55.469265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 854/1618] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:55 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:55.665271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4053974e-13d1-4625-b301-83b9dbc4ba26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:55.665890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4053974e-13d1-4625-b301-83b9dbc4ba26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:55.672239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4053974e-13d1-4625-b301-83b9dbc4ba26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:55.672691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4053974e-13d1-4625-b301-83b9dbc4ba26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:55.673701 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4053974e-13d1-4625-b301-83b9dbc4ba26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:55.674152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4053974e-13d1-4625-b301-83b9dbc4ba26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:55.736078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4053974e-13d1-4625-b301-83b9dbc4ba26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:55.744260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4053974e-13d1-4625-b301-83b9dbc4ba26 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083333 May 12 07:10:55.744857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 765/1619] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:55 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:55.821779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f772c768-627d-4b36-a309-240bdaeac5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:55.822390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f772c768-627d-4b36-a309-240bdaeac5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:55.828642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f772c768-627d-4b36-a309-240bdaeac5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:55.829094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f772c768-627d-4b36-a309-240bdaeac5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:55.829864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f772c768-627d-4b36-a309-240bdaeac5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:55.830301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f772c768-627d-4b36-a309-240bdaeac5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:55.954953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f772c768-627d-4b36-a309-240bdaeac5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:55.964021 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f772c768-627d-4b36-a309-240bdaeac5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:55.965536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f772c768-627d-4b36-a309-240bdaeac5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:55.966778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f772c768-627d-4b36-a309-240bdaeac5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148906 May 12 07:10:55.970301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 855/1620] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:55 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:56.480436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2b16df75-80e1-407e-8c94-35961569d4ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:56.481270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2b16df75-80e1-407e-8c94-35961569d4ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:56.487069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b16df75-80e1-407e-8c94-35961569d4ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:56.487516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b16df75-80e1-407e-8c94-35961569d4ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:56.488315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b16df75-80e1-407e-8c94-35961569d4ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:56.489405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b16df75-80e1-407e-8c94-35961569d4ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:56.516873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2b16df75-80e1-407e-8c94-35961569d4ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040506 May 12 07:10:56.517410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 766/1621] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:56.760600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7c38638e-7338-4eed-9812-6566e5252c45 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:56.761216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7c38638e-7338-4eed-9812-6566e5252c45 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:56.767134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7c38638e-7338-4eed-9812-6566e5252c45 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:56.767583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7c38638e-7338-4eed-9812-6566e5252c45 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:56.768386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7c38638e-7338-4eed-9812-6566e5252c45 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:56.768827 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7c38638e-7338-4eed-9812-6566e5252c45 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:56.828462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7c38638e-7338-4eed-9812-6566e5252c45 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:56.836127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7c38638e-7338-4eed-9812-6566e5252c45 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079351 May 12 07:10:56.836728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 856/1622] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:56 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:56.985463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a5d40bcd-8103-43a3-b303-a01d47a9db54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:56.986067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a5d40bcd-8103-43a3-b303-a01d47a9db54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:56.992479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5d40bcd-8103-43a3-b303-a01d47a9db54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:56.992933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5d40bcd-8103-43a3-b303-a01d47a9db54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:56.993705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5d40bcd-8103-43a3-b303-a01d47a9db54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:56.994138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5d40bcd-8103-43a3-b303-a01d47a9db54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:57.123876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a5d40bcd-8103-43a3-b303-a01d47a9db54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:57.132414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a5d40bcd-8103-43a3-b303-a01d47a9db54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:57.133889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a5d40bcd-8103-43a3-b303-a01d47a9db54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:57.135034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a5d40bcd-8103-43a3-b303-a01d47a9db54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.153460 May 12 07:10:57.135591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 767/1623] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:56 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:57.528207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-17d27c6d-950b-4eeb-bde2-b6c11e738655 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:57.529143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-17d27c6d-950b-4eeb-bde2-b6c11e738655 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:57.535013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-17d27c6d-950b-4eeb-bde2-b6c11e738655 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:57.535470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-17d27c6d-950b-4eeb-bde2-b6c11e738655 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:57.536287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-17d27c6d-950b-4eeb-bde2-b6c11e738655 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:57.536726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-17d27c6d-950b-4eeb-bde2-b6c11e738655 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:57.565458 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-17d27c6d-950b-4eeb-bde2-b6c11e738655 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 May 12 07:10:57.566008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 857/1624] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:57.852537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bdbc8d58-7775-48e2-8b72-a82362f2fda6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:57.853086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bdbc8d58-7775-48e2-8b72-a82362f2fda6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:57.858943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdbc8d58-7775-48e2-8b72-a82362f2fda6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:57.859391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdbc8d58-7775-48e2-8b72-a82362f2fda6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:57.860197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdbc8d58-7775-48e2-8b72-a82362f2fda6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:57.860636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdbc8d58-7775-48e2-8b72-a82362f2fda6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:57.919799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bdbc8d58-7775-48e2-8b72-a82362f2fda6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:57.927408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bdbc8d58-7775-48e2-8b72-a82362f2fda6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078784 May 12 07:10:57.928005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 768/1625] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:57 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:58.154256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-97fef600-75bb-44f3-ba63-ecffa0e86345 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:58.154788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-97fef600-75bb-44f3-ba63-ecffa0e86345 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:58.161119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97fef600-75bb-44f3-ba63-ecffa0e86345 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:58.161572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97fef600-75bb-44f3-ba63-ecffa0e86345 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:58.162344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97fef600-75bb-44f3-ba63-ecffa0e86345 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:58.162782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97fef600-75bb-44f3-ba63-ecffa0e86345 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:58.285866 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97fef600-75bb-44f3-ba63-ecffa0e86345 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:58.294000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97fef600-75bb-44f3-ba63-ecffa0e86345 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:58.295502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97fef600-75bb-44f3-ba63-ecffa0e86345 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:58.296702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-97fef600-75bb-44f3-ba63-ecffa0e86345 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146442 May 12 07:10:58.297264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 858/1626] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:58 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:58.577622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e99f212f-26ba-43c1-a3bf-c4c919935b95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:58.578550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e99f212f-26ba-43c1-a3bf-c4c919935b95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:58.584810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e99f212f-26ba-43c1-a3bf-c4c919935b95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:58.585264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e99f212f-26ba-43c1-a3bf-c4c919935b95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:58.586033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e99f212f-26ba-43c1-a3bf-c4c919935b95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:58.586471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e99f212f-26ba-43c1-a3bf-c4c919935b95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:58.615267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e99f212f-26ba-43c1-a3bf-c4c919935b95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041622 May 12 07:10:58.615839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 769/1627] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:10:58.943483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bb84ea46-049a-4baa-8f96-2d868913e3d7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:58.944049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bb84ea46-049a-4baa-8f96-2d868913e3d7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:58.949974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb84ea46-049a-4baa-8f96-2d868913e3d7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:58.950426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb84ea46-049a-4baa-8f96-2d868913e3d7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:58.951257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb84ea46-049a-4baa-8f96-2d868913e3d7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:58.951717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb84ea46-049a-4baa-8f96-2d868913e3d7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:59.016767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bb84ea46-049a-4baa-8f96-2d868913e3d7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:59.024654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bb84ea46-049a-4baa-8f96-2d868913e3d7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.085069 May 12 07:10:59.025238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 859/1628] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:10:58 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:10:59.316389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c5b9c5ae-7cc5-4bfa-a3d8-6a3e7b443cff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:59.317491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c5b9c5ae-7cc5-4bfa-a3d8-6a3e7b443cff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:59.323211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5b9c5ae-7cc5-4bfa-a3d8-6a3e7b443cff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:59.323664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5b9c5ae-7cc5-4bfa-a3d8-6a3e7b443cff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:59.324468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5b9c5ae-7cc5-4bfa-a3d8-6a3e7b443cff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:59.325002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5b9c5ae-7cc5-4bfa-a3d8-6a3e7b443cff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:59.450993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c5b9c5ae-7cc5-4bfa-a3d8-6a3e7b443cff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:59.460005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c5b9c5ae-7cc5-4bfa-a3d8-6a3e7b443cff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:59.461498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c5b9c5ae-7cc5-4bfa-a3d8-6a3e7b443cff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:10:59.462661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c5b9c5ae-7cc5-4bfa-a3d8-6a3e7b443cff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150244 May 12 07:10:59.463215 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 770/1629] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:10:59 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:10:59.626652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e1d07161-c6ea-4609-98cc-5713859ff82f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:10:59.627578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e1d07161-c6ea-4609-98cc-5713859ff82f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:10:59.634512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1d07161-c6ea-4609-98cc-5713859ff82f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:59.634963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1d07161-c6ea-4609-98cc-5713859ff82f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:59.635757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1d07161-c6ea-4609-98cc-5713859ff82f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:10:59.636200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1d07161-c6ea-4609-98cc-5713859ff82f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:10:59.664328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e1d07161-c6ea-4609-98cc-5713859ff82f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041675 May 12 07:10:59.664882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 860/1630] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:10:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:00.041605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fa6c9c64-eac5-45b5-a247-d0b8bb4cc500 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:00.042227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fa6c9c64-eac5-45b5-a247-d0b8bb4cc500 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:00.048884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fa6c9c64-eac5-45b5-a247-d0b8bb4cc500 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:00.049327 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fa6c9c64-eac5-45b5-a247-d0b8bb4cc500 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:00.050086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fa6c9c64-eac5-45b5-a247-d0b8bb4cc500 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:00.050518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fa6c9c64-eac5-45b5-a247-d0b8bb4cc500 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:00.110084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fa6c9c64-eac5-45b5-a247-d0b8bb4cc500 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:00.118038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fa6c9c64-eac5-45b5-a247-d0b8bb4cc500 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080261 May 12 07:11:00.118604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 771/1631] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:00 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:00.480266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2c53d0d6-ca26-4d61-8baa-0feb372be573 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:00.480803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2c53d0d6-ca26-4d61-8baa-0feb372be573 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:00.486690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c53d0d6-ca26-4d61-8baa-0feb372be573 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:00.487143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c53d0d6-ca26-4d61-8baa-0feb372be573 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:00.487939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c53d0d6-ca26-4d61-8baa-0feb372be573 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:00.488376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c53d0d6-ca26-4d61-8baa-0feb372be573 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:00.613954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2c53d0d6-ca26-4d61-8baa-0feb372be573 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:00.622089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2c53d0d6-ca26-4d61-8baa-0feb372be573 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:00.623596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2c53d0d6-ca26-4d61-8baa-0feb372be573 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:00.624791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2c53d0d6-ca26-4d61-8baa-0feb372be573 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148527 May 12 07:11:00.625357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 861/1632] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:00 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:00.676119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-782de36a-59c7-4483-9ad6-6d463478186d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:00.677037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-782de36a-59c7-4483-9ad6-6d463478186d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:00.682731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-782de36a-59c7-4483-9ad6-6d463478186d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:00.683180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-782de36a-59c7-4483-9ad6-6d463478186d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:00.683974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-782de36a-59c7-4483-9ad6-6d463478186d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:00.684410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-782de36a-59c7-4483-9ad6-6d463478186d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:00.713067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-782de36a-59c7-4483-9ad6-6d463478186d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041273 May 12 07:11:00.713613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 772/1633] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:01.135000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ad8488a3-a4bf-454a-aec8-a98a59c49cfc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:01.135618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ad8488a3-a4bf-454a-aec8-a98a59c49cfc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:01.141968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad8488a3-a4bf-454a-aec8-a98a59c49cfc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:01.142422 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad8488a3-a4bf-454a-aec8-a98a59c49cfc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:01.143200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad8488a3-a4bf-454a-aec8-a98a59c49cfc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:01.143640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad8488a3-a4bf-454a-aec8-a98a59c49cfc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:01.206101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ad8488a3-a4bf-454a-aec8-a98a59c49cfc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:01.213862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ad8488a3-a4bf-454a-aec8-a98a59c49cfc tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082552 May 12 07:11:01.214437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 862/1634] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:01 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:01.642426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-933ec7a0-2675-416e-96f2-a77d1e855a69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:01.643021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-933ec7a0-2675-416e-96f2-a77d1e855a69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:01.649064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-933ec7a0-2675-416e-96f2-a77d1e855a69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:01.649507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-933ec7a0-2675-416e-96f2-a77d1e855a69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:01.650269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-933ec7a0-2675-416e-96f2-a77d1e855a69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:01.650699 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-933ec7a0-2675-416e-96f2-a77d1e855a69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:01.726011 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-200a70c6-7223-4acf-89e9-2c564add278e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:01.726938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-200a70c6-7223-4acf-89e9-2c564add278e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:01.732907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-200a70c6-7223-4acf-89e9-2c564add278e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:01.733353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-200a70c6-7223-4acf-89e9-2c564add278e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:01.734125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-200a70c6-7223-4acf-89e9-2c564add278e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:01.734558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-200a70c6-7223-4acf-89e9-2c564add278e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:01.763425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-200a70c6-7223-4acf-89e9-2c564add278e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041833 May 12 07:11:01.764026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 863/1635] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:11:01.775151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-933ec7a0-2675-416e-96f2-a77d1e855a69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:01.783390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-933ec7a0-2675-416e-96f2-a77d1e855a69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:01.784919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-933ec7a0-2675-416e-96f2-a77d1e855a69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:01.786565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-933ec7a0-2675-416e-96f2-a77d1e855a69 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148105 May 12 07:11:01.787118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 773/1636] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:01 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:02.230858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e5ca6044-1d60-45ff-8a6d-909d24758d13 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:02.231475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e5ca6044-1d60-45ff-8a6d-909d24758d13 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:02.238133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5ca6044-1d60-45ff-8a6d-909d24758d13 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:02.239228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5ca6044-1d60-45ff-8a6d-909d24758d13 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:02.240035 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5ca6044-1d60-45ff-8a6d-909d24758d13 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:02.240541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5ca6044-1d60-45ff-8a6d-909d24758d13 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:02.304775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e5ca6044-1d60-45ff-8a6d-909d24758d13 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:02.312086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e5ca6044-1d60-45ff-8a6d-909d24758d13 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.085077 May 12 07:11:02.312660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 864/1637] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:02 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:02.775288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-43459f10-c837-49ec-b47e-8b4767a45f42 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:02.776244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-43459f10-c837-49ec-b47e-8b4767a45f42 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:02.782466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43459f10-c837-49ec-b47e-8b4767a45f42 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:02.782910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43459f10-c837-49ec-b47e-8b4767a45f42 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:02.783666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43459f10-c837-49ec-b47e-8b4767a45f42 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:02.784120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-43459f10-c837-49ec-b47e-8b4767a45f42 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:02.804603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-38f4c5d0-aa1f-42db-95e4-f4aad072d199 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:02.805290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-38f4c5d0-aa1f-42db-95e4-f4aad072d199 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:02.811144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38f4c5d0-aa1f-42db-95e4-f4aad072d199 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:02.811602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38f4c5d0-aa1f-42db-95e4-f4aad072d199 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:02.812420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38f4c5d0-aa1f-42db-95e4-f4aad072d199 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:02.812864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38f4c5d0-aa1f-42db-95e4-f4aad072d199 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:02.813247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-43459f10-c837-49ec-b47e-8b4767a45f42 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041856 May 12 07:11:02.813804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 774/1638] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:02.935086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-38f4c5d0-aa1f-42db-95e4-f4aad072d199 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:02.943777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-38f4c5d0-aa1f-42db-95e4-f4aad072d199 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:02.945459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-38f4c5d0-aa1f-42db-95e4-f4aad072d199 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:02.946642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-38f4c5d0-aa1f-42db-95e4-f4aad072d199 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146190 May 12 07:11:02.947208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 865/1639] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:02 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:11:03.327813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1c9f39d5-64b8-4f9a-909e-e2a4f8b1cdde tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:03.328356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1c9f39d5-64b8-4f9a-909e-e2a4f8b1cdde tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:03.334918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c9f39d5-64b8-4f9a-909e-e2a4f8b1cdde tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:03.335369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c9f39d5-64b8-4f9a-909e-e2a4f8b1cdde tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:03.336167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c9f39d5-64b8-4f9a-909e-e2a4f8b1cdde tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:03.336606 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c9f39d5-64b8-4f9a-909e-e2a4f8b1cdde tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:03.395877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1c9f39d5-64b8-4f9a-909e-e2a4f8b1cdde tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:03.403078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1c9f39d5-64b8-4f9a-909e-e2a4f8b1cdde tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079182 May 12 07:11:03.403640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 775/1640] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:03 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:03.824824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a16596ef-8632-45af-87ad-060c7dd24d80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:03.825745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a16596ef-8632-45af-87ad-060c7dd24d80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:03.832063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a16596ef-8632-45af-87ad-060c7dd24d80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:03.832512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a16596ef-8632-45af-87ad-060c7dd24d80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:03.833275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a16596ef-8632-45af-87ad-060c7dd24d80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:03.833707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a16596ef-8632-45af-87ad-060c7dd24d80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:03.862427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a16596ef-8632-45af-87ad-060c7dd24d80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041674 May 12 07:11:03.862976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 866/1641] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:03.966497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-aed2f139-c86f-42a2-a774-fa8b845f0978 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:03.967041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-aed2f139-c86f-42a2-a774-fa8b845f0978 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:03.973896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aed2f139-c86f-42a2-a774-fa8b845f0978 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:03.974372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aed2f139-c86f-42a2-a774-fa8b845f0978 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:03.975138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aed2f139-c86f-42a2-a774-fa8b845f0978 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:03.975581 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aed2f139-c86f-42a2-a774-fa8b845f0978 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:04.102867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aed2f139-c86f-42a2-a774-fa8b845f0978 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:04.111112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aed2f139-c86f-42a2-a774-fa8b845f0978 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:04.112647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aed2f139-c86f-42a2-a774-fa8b845f0978 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:04.113808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-aed2f139-c86f-42a2-a774-fa8b845f0978 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151359 May 12 07:11:04.114368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 776/1642] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:04.419851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8cec9a8c-7203-4577-a41b-d4b0f49259e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:04.420462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8cec9a8c-7203-4577-a41b-d4b0f49259e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:04.426611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8cec9a8c-7203-4577-a41b-d4b0f49259e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:04.427057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8cec9a8c-7203-4577-a41b-d4b0f49259e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:04.427847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8cec9a8c-7203-4577-a41b-d4b0f49259e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:04.428284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8cec9a8c-7203-4577-a41b-d4b0f49259e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:04.487830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8cec9a8c-7203-4577-a41b-d4b0f49259e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:04.495176 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8cec9a8c-7203-4577-a41b-d4b0f49259e1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079216 May 12 07:11:04.495761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 867/1643] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:04.874456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b8810d35-6034-4cf3-b547-822d10a16f0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:04.875399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b8810d35-6034-4cf3-b547-822d10a16f0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:04.881271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8810d35-6034-4cf3-b547-822d10a16f0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:04.881719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8810d35-6034-4cf3-b547-822d10a16f0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:04.882481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8810d35-6034-4cf3-b547-822d10a16f0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:04.882908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8810d35-6034-4cf3-b547-822d10a16f0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:04.912308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b8810d35-6034-4cf3-b547-822d10a16f0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041861 May 12 07:11:04.912851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 777/1644] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:05.132255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5baf52f0-62c8-4daa-b818-711a2310c6cd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:05.132795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5baf52f0-62c8-4daa-b818-711a2310c6cd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:05.139089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5baf52f0-62c8-4daa-b818-711a2310c6cd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:05.139562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5baf52f0-62c8-4daa-b818-711a2310c6cd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:05.140355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5baf52f0-62c8-4daa-b818-711a2310c6cd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:05.140797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5baf52f0-62c8-4daa-b818-711a2310c6cd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:05.264758 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5baf52f0-62c8-4daa-b818-711a2310c6cd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:05.273602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5baf52f0-62c8-4daa-b818-711a2310c6cd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:05.275109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5baf52f0-62c8-4daa-b818-711a2310c6cd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:05.276332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5baf52f0-62c8-4daa-b818-711a2310c6cd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148112 May 12 07:11:05.276893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 868/1645] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:05 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:05.512462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e759f5c1-8c82-442a-abba-49a5bf9da968 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:05.513079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e759f5c1-8c82-442a-abba-49a5bf9da968 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:05.519261 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e759f5c1-8c82-442a-abba-49a5bf9da968 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:05.520397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e759f5c1-8c82-442a-abba-49a5bf9da968 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:05.521160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e759f5c1-8c82-442a-abba-49a5bf9da968 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:05.521595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e759f5c1-8c82-442a-abba-49a5bf9da968 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:05.597944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e759f5c1-8c82-442a-abba-49a5bf9da968 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:05.605819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e759f5c1-8c82-442a-abba-49a5bf9da968 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.097173 May 12 07:11:05.606398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 778/1646] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:05 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:05.924050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-75f80943-d292-4d23-afdd-9aaf5ce63029 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:05.924924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-75f80943-d292-4d23-afdd-9aaf5ce63029 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:05.931110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75f80943-d292-4d23-afdd-9aaf5ce63029 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:05.931553 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75f80943-d292-4d23-afdd-9aaf5ce63029 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:05.932452 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75f80943-d292-4d23-afdd-9aaf5ce63029 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:05.932898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75f80943-d292-4d23-afdd-9aaf5ce63029 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:05.961781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-75f80943-d292-4d23-afdd-9aaf5ce63029 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041974 May 12 07:11:05.963481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 869/1647] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:06.294747 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8fd3341a-cc3e-4bc9-8dfc-1f212df76a95 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:06.295342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8fd3341a-cc3e-4bc9-8dfc-1f212df76a95 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:06.302232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fd3341a-cc3e-4bc9-8dfc-1f212df76a95 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:06.302675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fd3341a-cc3e-4bc9-8dfc-1f212df76a95 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:06.303442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fd3341a-cc3e-4bc9-8dfc-1f212df76a95 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:06.303912 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fd3341a-cc3e-4bc9-8dfc-1f212df76a95 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:06.430424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8fd3341a-cc3e-4bc9-8dfc-1f212df76a95 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:06.438659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8fd3341a-cc3e-4bc9-8dfc-1f212df76a95 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:06.440201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8fd3341a-cc3e-4bc9-8dfc-1f212df76a95 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:06.441369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8fd3341a-cc3e-4bc9-8dfc-1f212df76a95 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150618 May 12 07:11:06.441933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 779/1648] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:06 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:06.622327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c61656db-d71c-4fbd-8e15-530807e1db33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:06.622855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c61656db-d71c-4fbd-8e15-530807e1db33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:06.629353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c61656db-d71c-4fbd-8e15-530807e1db33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:06.629799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c61656db-d71c-4fbd-8e15-530807e1db33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:06.630563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c61656db-d71c-4fbd-8e15-530807e1db33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:06.630998 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c61656db-d71c-4fbd-8e15-530807e1db33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:06.690593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c61656db-d71c-4fbd-8e15-530807e1db33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:06.698446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c61656db-d71c-4fbd-8e15-530807e1db33 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080094 May 12 07:11:06.699004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 870/1649] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:06 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:06.973303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-74e0d7e6-3983-4e54-a3e7-182617b10f97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:06.974335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-74e0d7e6-3983-4e54-a3e7-182617b10f97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:06.980748 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74e0d7e6-3983-4e54-a3e7-182617b10f97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:06.981512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74e0d7e6-3983-4e54-a3e7-182617b10f97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:06.981985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74e0d7e6-3983-4e54-a3e7-182617b10f97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:06.982415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74e0d7e6-3983-4e54-a3e7-182617b10f97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:07.011548 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-74e0d7e6-3983-4e54-a3e7-182617b10f97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042259 May 12 07:11:07.016615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 780/1650] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:11:07.459749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9b1217df-92b2-4644-9123-c34461914967 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:07.460358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9b1217df-92b2-4644-9123-c34461914967 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:07.467258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b1217df-92b2-4644-9123-c34461914967 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:07.467727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b1217df-92b2-4644-9123-c34461914967 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:07.468494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b1217df-92b2-4644-9123-c34461914967 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:07.468929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b1217df-92b2-4644-9123-c34461914967 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:07.594531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9b1217df-92b2-4644-9123-c34461914967 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:07.603186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9b1217df-92b2-4644-9123-c34461914967 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:07.604712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9b1217df-92b2-4644-9123-c34461914967 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:07.605875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9b1217df-92b2-4644-9123-c34461914967 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150146 May 12 07:11:07.606440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 871/1651] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:07 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:07.715454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8dc9e509-6b21-4600-b873-3e9eddb38530 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:07.716036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8dc9e509-6b21-4600-b873-3e9eddb38530 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:07.721844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8dc9e509-6b21-4600-b873-3e9eddb38530 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:07.722300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8dc9e509-6b21-4600-b873-3e9eddb38530 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:07.723601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8dc9e509-6b21-4600-b873-3e9eddb38530 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:07.724067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8dc9e509-6b21-4600-b873-3e9eddb38530 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:07.782326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8dc9e509-6b21-4600-b873-3e9eddb38530 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:07.789941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8dc9e509-6b21-4600-b873-3e9eddb38530 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078340 May 12 07:11:07.790501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 781/1652] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:07 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:08.023692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-033bea30-4b26-4627-b175-2db73099a014 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:08.024696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-033bea30-4b26-4627-b175-2db73099a014 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:08.030910 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-033bea30-4b26-4627-b175-2db73099a014 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:08.031360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-033bea30-4b26-4627-b175-2db73099a014 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:08.032166 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-033bea30-4b26-4627-b175-2db73099a014 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:08.032609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-033bea30-4b26-4627-b175-2db73099a014 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:08.061672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-033bea30-4b26-4627-b175-2db73099a014 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042432 May 12 07:11:08.062225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 872/1653] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:08.624955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-699c3243-c29c-4be7-b380-1bf83db06859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:08.625511 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-699c3243-c29c-4be7-b380-1bf83db06859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:08.631738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-699c3243-c29c-4be7-b380-1bf83db06859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:08.632186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-699c3243-c29c-4be7-b380-1bf83db06859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:08.632959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-699c3243-c29c-4be7-b380-1bf83db06859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:08.633380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-699c3243-c29c-4be7-b380-1bf83db06859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:08.756598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-699c3243-c29c-4be7-b380-1bf83db06859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:08.764661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-699c3243-c29c-4be7-b380-1bf83db06859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:08.766145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-699c3243-c29c-4be7-b380-1bf83db06859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:08.767296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-699c3243-c29c-4be7-b380-1bf83db06859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146323 May 12 07:11:08.767884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 782/1654] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:08.806598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-75725ec5-8406-41b5-aad7-7282f7093f8d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:08.807210 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-75725ec5-8406-41b5-aad7-7282f7093f8d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:08.813124 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75725ec5-8406-41b5-aad7-7282f7093f8d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:08.813575 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75725ec5-8406-41b5-aad7-7282f7093f8d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:08.814344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75725ec5-8406-41b5-aad7-7282f7093f8d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:08.814783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75725ec5-8406-41b5-aad7-7282f7093f8d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:08.878027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-75725ec5-8406-41b5-aad7-7282f7093f8d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:08.885371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-75725ec5-8406-41b5-aad7-7282f7093f8d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082601 May 12 07:11:08.885939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 873/1655] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:08 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:09.073476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-33ca5382-bf7e-4ef9-a2b4-211a13b28cee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:09.074424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-33ca5382-bf7e-4ef9-a2b4-211a13b28cee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:09.080343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33ca5382-bf7e-4ef9-a2b4-211a13b28cee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:09.080788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33ca5382-bf7e-4ef9-a2b4-211a13b28cee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:09.081549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33ca5382-bf7e-4ef9-a2b4-211a13b28cee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:09.082621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33ca5382-bf7e-4ef9-a2b4-211a13b28cee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:09.110025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-33ca5382-bf7e-4ef9-a2b4-211a13b28cee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040544 May 12 07:11:09.110569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 783/1656] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:09.786770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1441d895-e83e-4347-a375-cade1471b82d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:09.787408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1441d895-e83e-4347-a375-cade1471b82d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:09.793783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1441d895-e83e-4347-a375-cade1471b82d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:09.794232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1441d895-e83e-4347-a375-cade1471b82d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:09.795005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1441d895-e83e-4347-a375-cade1471b82d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:09.795443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1441d895-e83e-4347-a375-cade1471b82d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:09.901476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-33e08acd-8f36-4fef-997f-cae01dd0cba1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:09.902094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-33e08acd-8f36-4fef-997f-cae01dd0cba1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:09.908502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33e08acd-8f36-4fef-997f-cae01dd0cba1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:09.908955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33e08acd-8f36-4fef-997f-cae01dd0cba1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:09.910452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33e08acd-8f36-4fef-997f-cae01dd0cba1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:09.910883 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33e08acd-8f36-4fef-997f-cae01dd0cba1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:09.922946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1441d895-e83e-4347-a375-cade1471b82d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:09.934298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1441d895-e83e-4347-a375-cade1471b82d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:09.936175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1441d895-e83e-4347-a375-cade1471b82d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:09.937490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1441d895-e83e-4347-a375-cade1471b82d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.155112 May 12 07:11:09.938181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 874/1657] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:09.973571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-33e08acd-8f36-4fef-997f-cae01dd0cba1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:09.980869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-33e08acd-8f36-4fef-997f-cae01dd0cba1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083311 May 12 07:11:09.981424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 784/1658] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:09 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:11:10.121678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b88e2abc-3450-42cd-b888-cfada6d6d5ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:10.122526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b88e2abc-3450-42cd-b888-cfada6d6d5ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:10.128499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b88e2abc-3450-42cd-b888-cfada6d6d5ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:10.128951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b88e2abc-3450-42cd-b888-cfada6d6d5ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:10.129725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b88e2abc-3450-42cd-b888-cfada6d6d5ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:10.130160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b88e2abc-3450-42cd-b888-cfada6d6d5ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:10.158226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b88e2abc-3450-42cd-b888-cfada6d6d5ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040646 May 12 07:11:10.158775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 875/1659] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:10.956321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5f2c583c-19c4-4ab8-83bf-df99e5ce3869 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:10.957003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5f2c583c-19c4-4ab8-83bf-df99e5ce3869 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:10.963461 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f2c583c-19c4-4ab8-83bf-df99e5ce3869 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:10.963935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f2c583c-19c4-4ab8-83bf-df99e5ce3869 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:10.964708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f2c583c-19c4-4ab8-83bf-df99e5ce3869 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:10.965138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5f2c583c-19c4-4ab8-83bf-df99e5ce3869 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:10.997754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-55126679-940a-4408-a5d3-3ce3943c8ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:10.998368 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-55126679-940a-4408-a5d3-3ce3943c8ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:11.005369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55126679-940a-4408-a5d3-3ce3943c8ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:11.005817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55126679-940a-4408-a5d3-3ce3943c8ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:11.006590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55126679-940a-4408-a5d3-3ce3943c8ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:11.007065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55126679-940a-4408-a5d3-3ce3943c8ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:11.081544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-55126679-940a-4408-a5d3-3ce3943c8ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:11.089187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-55126679-940a-4408-a5d3-3ce3943c8ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.095224 May 12 07:11:11.089772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 876/1660] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:10 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:11:11.117404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5f2c583c-19c4-4ab8-83bf-df99e5ce3869 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:11.125293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5f2c583c-19c4-4ab8-83bf-df99e5ce3869 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:11.126817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5f2c583c-19c4-4ab8-83bf-df99e5ce3869 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:11.128023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5f2c583c-19c4-4ab8-83bf-df99e5ce3869 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.175549 May 12 07:11:11.128580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 785/1661] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:10 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:11.170260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-473215dd-3ac8-438c-bbd1-041b12e5d8a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:11.171191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-473215dd-3ac8-438c-bbd1-041b12e5d8a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:11.177946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-473215dd-3ac8-438c-bbd1-041b12e5d8a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:11.178397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-473215dd-3ac8-438c-bbd1-041b12e5d8a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:11.179178 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-473215dd-3ac8-438c-bbd1-041b12e5d8a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:11.179623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-473215dd-3ac8-438c-bbd1-041b12e5d8a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:11.209364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-473215dd-3ac8-438c-bbd1-041b12e5d8a9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 May 12 07:11:11.209843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 877/1662] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:12.105790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-84b6a071-3385-4a55-9881-0e109cab8b93 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:12.106402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-84b6a071-3385-4a55-9881-0e109cab8b93 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:12.112699 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84b6a071-3385-4a55-9881-0e109cab8b93 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:12.113146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84b6a071-3385-4a55-9881-0e109cab8b93 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:12.113905 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84b6a071-3385-4a55-9881-0e109cab8b93 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:12.114339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84b6a071-3385-4a55-9881-0e109cab8b93 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:12.150177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9d409b99-8ac2-43d9-a4ad-5d95926b85a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:12.151414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9d409b99-8ac2-43d9-a4ad-5d95926b85a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:12.161311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d409b99-8ac2-43d9-a4ad-5d95926b85a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:12.162185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d409b99-8ac2-43d9-a4ad-5d95926b85a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:12.163641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d409b99-8ac2-43d9-a4ad-5d95926b85a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:12.164544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d409b99-8ac2-43d9-a4ad-5d95926b85a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:12.189877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-84b6a071-3385-4a55-9881-0e109cab8b93 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:12.197795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-84b6a071-3385-4a55-9881-0e109cab8b93 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.095852 May 12 07:11:12.198365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 786/1663] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:12 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:12.220536 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b0c39a75-16ca-4016-9586-caceefc7c00a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:12.221473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b0c39a75-16ca-4016-9586-caceefc7c00a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:12.227353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0c39a75-16ca-4016-9586-caceefc7c00a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:12.227944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0c39a75-16ca-4016-9586-caceefc7c00a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:12.228712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0c39a75-16ca-4016-9586-caceefc7c00a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:12.229144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0c39a75-16ca-4016-9586-caceefc7c00a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:12.257830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b0c39a75-16ca-4016-9586-caceefc7c00a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041114 May 12 07:11:12.258395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 787/1664] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:12 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:11:12.304916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9d409b99-8ac2-43d9-a4ad-5d95926b85a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:12.313016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9d409b99-8ac2-43d9-a4ad-5d95926b85a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:12.314504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9d409b99-8ac2-43d9-a4ad-5d95926b85a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:12.315658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9d409b99-8ac2-43d9-a4ad-5d95926b85a8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.173133 May 12 07:11:12.316249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 878/1665] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:12 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:11:13.214293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-58a78b3a-fcd9-4351-b669-d64c54b96586 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:13.214904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-58a78b3a-fcd9-4351-b669-d64c54b96586 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:13.221188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58a78b3a-fcd9-4351-b669-d64c54b96586 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:13.221635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58a78b3a-fcd9-4351-b669-d64c54b96586 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:13.222399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58a78b3a-fcd9-4351-b669-d64c54b96586 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:13.222835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58a78b3a-fcd9-4351-b669-d64c54b96586 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:13.269447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f91fc21c-a044-4e8e-aab1-9d93436465a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:13.270783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f91fc21c-a044-4e8e-aab1-9d93436465a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:13.277121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f91fc21c-a044-4e8e-aab1-9d93436465a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:13.277570 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f91fc21c-a044-4e8e-aab1-9d93436465a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:13.278444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f91fc21c-a044-4e8e-aab1-9d93436465a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:13.278882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f91fc21c-a044-4e8e-aab1-9d93436465a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:13.282162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-58a78b3a-fcd9-4351-b669-d64c54b96586 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:13.290230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-58a78b3a-fcd9-4351-b669-d64c54b96586 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079826 May 12 07:11:13.290789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 788/1666] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:13 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:13.310229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f91fc21c-a044-4e8e-aab1-9d93436465a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 May 12 07:11:13.310787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 879/1667] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:11:13.334548 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-44732b7c-d5f5-4d5c-a353-2d9cf7fa90b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:13.335159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-44732b7c-d5f5-4d5c-a353-2d9cf7fa90b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:13.340957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44732b7c-d5f5-4d5c-a353-2d9cf7fa90b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:13.341410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44732b7c-d5f5-4d5c-a353-2d9cf7fa90b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:13.342166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44732b7c-d5f5-4d5c-a353-2d9cf7fa90b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:13.342599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44732b7c-d5f5-4d5c-a353-2d9cf7fa90b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:13.466068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-44732b7c-d5f5-4d5c-a353-2d9cf7fa90b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:13.474159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-44732b7c-d5f5-4d5c-a353-2d9cf7fa90b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:13.475664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-44732b7c-d5f5-4d5c-a353-2d9cf7fa90b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:13.476838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-44732b7c-d5f5-4d5c-a353-2d9cf7fa90b4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146568 May 12 07:11:13.477402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 789/1668] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:14.307714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-21b4c90d-8ec1-45f8-ae92-b2a518dd530c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:14.308253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-21b4c90d-8ec1-45f8-ae92-b2a518dd530c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:14.314543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21b4c90d-8ec1-45f8-ae92-b2a518dd530c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:14.315001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21b4c90d-8ec1-45f8-ae92-b2a518dd530c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:14.315794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21b4c90d-8ec1-45f8-ae92-b2a518dd530c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:14.316237 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21b4c90d-8ec1-45f8-ae92-b2a518dd530c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:14.321665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-79f3e17e-9c81-4d1e-ae1e-de94c967c53c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:14.322595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-79f3e17e-9c81-4d1e-ae1e-de94c967c53c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:14.328906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79f3e17e-9c81-4d1e-ae1e-de94c967c53c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:14.329360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79f3e17e-9c81-4d1e-ae1e-de94c967c53c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:14.330135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79f3e17e-9c81-4d1e-ae1e-de94c967c53c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:14.330576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79f3e17e-9c81-4d1e-ae1e-de94c967c53c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:14.359610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-79f3e17e-9c81-4d1e-ae1e-de94c967c53c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041858 May 12 07:11:14.360220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 790/1669] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:11:14.376699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-21b4c90d-8ec1-45f8-ae92-b2a518dd530c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:14.384027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-21b4c90d-8ec1-45f8-ae92-b2a518dd530c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080277 May 12 07:11:14.384585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 880/1670] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:14 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:14.495724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2674de9a-8e80-4952-8ba2-e38d05866a91 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:14.496332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2674de9a-8e80-4952-8ba2-e38d05866a91 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:14.502159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2674de9a-8e80-4952-8ba2-e38d05866a91 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:14.502602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2674de9a-8e80-4952-8ba2-e38d05866a91 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:14.503367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2674de9a-8e80-4952-8ba2-e38d05866a91 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:14.503828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2674de9a-8e80-4952-8ba2-e38d05866a91 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:14.629825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2674de9a-8e80-4952-8ba2-e38d05866a91 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:14.637969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2674de9a-8e80-4952-8ba2-e38d05866a91 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:14.639458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2674de9a-8e80-4952-8ba2-e38d05866a91 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:14.640635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2674de9a-8e80-4952-8ba2-e38d05866a91 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148875 May 12 07:11:14.641192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 791/1671] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:14 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:15.371544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-85d3a4cb-9bff-4646-aade-0805e52c98af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:15.372415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-85d3a4cb-9bff-4646-aade-0805e52c98af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:15.378733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85d3a4cb-9bff-4646-aade-0805e52c98af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:15.379186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85d3a4cb-9bff-4646-aade-0805e52c98af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:15.380020 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85d3a4cb-9bff-4646-aade-0805e52c98af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:15.380525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85d3a4cb-9bff-4646-aade-0805e52c98af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:15.400671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-128c91f9-57ab-423b-838b-0236f0e539f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:15.401295 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-128c91f9-57ab-423b-838b-0236f0e539f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:15.407632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-128c91f9-57ab-423b-838b-0236f0e539f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:15.408147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-128c91f9-57ab-423b-838b-0236f0e539f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:15.408926 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-128c91f9-57ab-423b-838b-0236f0e539f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:15.409288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-85d3a4cb-9bff-4646-aade-0805e52c98af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041850 May 12 07:11:15.409402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-128c91f9-57ab-423b-838b-0236f0e539f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:15.410050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 881/1672] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:15.469380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-128c91f9-57ab-423b-838b-0236f0e539f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:15.477265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-128c91f9-57ab-423b-838b-0236f0e539f6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080498 May 12 07:11:15.477837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 792/1673] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:15 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:11:15.658746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c5997192-ef49-43af-884c-548a49ffb69f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:15.659287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c5997192-ef49-43af-884c-548a49ffb69f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:15.665804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5997192-ef49-43af-884c-548a49ffb69f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:15.666255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5997192-ef49-43af-884c-548a49ffb69f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:15.667064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5997192-ef49-43af-884c-548a49ffb69f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:15.667463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5997192-ef49-43af-884c-548a49ffb69f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:15.795321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c5997192-ef49-43af-884c-548a49ffb69f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:15.803707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c5997192-ef49-43af-884c-548a49ffb69f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:15.805193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c5997192-ef49-43af-884c-548a49ffb69f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:15.806382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c5997192-ef49-43af-884c-548a49ffb69f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151694 May 12 07:11:15.806944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 882/1674] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:16.421642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d0c1962a-3e01-4dcb-be96-8e8157e67edd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:16.422506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d0c1962a-3e01-4dcb-be96-8e8157e67edd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:16.429541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0c1962a-3e01-4dcb-be96-8e8157e67edd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:16.429969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0c1962a-3e01-4dcb-be96-8e8157e67edd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:16.430732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0c1962a-3e01-4dcb-be96-8e8157e67edd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:16.431184 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0c1962a-3e01-4dcb-be96-8e8157e67edd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:16.459674 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d0c1962a-3e01-4dcb-be96-8e8157e67edd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042112 May 12 07:11:16.460246 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 793/1675] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:16.494332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-74a10cf7-e118-4db3-a36f-7d2841a44cda tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:16.494955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-74a10cf7-e118-4db3-a36f-7d2841a44cda tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:16.501260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-74a10cf7-e118-4db3-a36f-7d2841a44cda tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:16.501711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-74a10cf7-e118-4db3-a36f-7d2841a44cda tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:16.502487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-74a10cf7-e118-4db3-a36f-7d2841a44cda tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:16.502928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-74a10cf7-e118-4db3-a36f-7d2841a44cda tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:16.562409 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-74a10cf7-e118-4db3-a36f-7d2841a44cda tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:16.569642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-74a10cf7-e118-4db3-a36f-7d2841a44cda tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079165 May 12 07:11:16.570212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 883/1676] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:16 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:11:16.824712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0e564f15-71f0-4965-a12c-db7583856955 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:16.825319 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0e564f15-71f0-4965-a12c-db7583856955 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:16.831092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e564f15-71f0-4965-a12c-db7583856955 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:16.831533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e564f15-71f0-4965-a12c-db7583856955 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:16.832329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e564f15-71f0-4965-a12c-db7583856955 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:16.833254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0e564f15-71f0-4965-a12c-db7583856955 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:16.954557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0e564f15-71f0-4965-a12c-db7583856955 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:16.963317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0e564f15-71f0-4965-a12c-db7583856955 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:16.964851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0e564f15-71f0-4965-a12c-db7583856955 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:16.966020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0e564f15-71f0-4965-a12c-db7583856955 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.145190 May 12 07:11:16.966583 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 794/1677] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:11:17.470283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8335088b-c815-4532-86aa-a458c458f50f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:17.471222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8335088b-c815-4532-86aa-a458c458f50f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:17.477197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8335088b-c815-4532-86aa-a458c458f50f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:17.477655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8335088b-c815-4532-86aa-a458c458f50f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:17.478431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8335088b-c815-4532-86aa-a458c458f50f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:17.478873 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8335088b-c815-4532-86aa-a458c458f50f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:17.507512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8335088b-c815-4532-86aa-a458c458f50f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041240 May 12 07:11:17.508112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 884/1678] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:17 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:17.586122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5e127d8a-bac5-4da0-ab05-47990f581464 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:17.586739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5e127d8a-bac5-4da0-ab05-47990f581464 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:17.593070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e127d8a-bac5-4da0-ab05-47990f581464 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:17.593523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e127d8a-bac5-4da0-ab05-47990f581464 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:17.594293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e127d8a-bac5-4da0-ab05-47990f581464 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:17.594731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e127d8a-bac5-4da0-ab05-47990f581464 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:17.654504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5e127d8a-bac5-4da0-ab05-47990f581464 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:17.661727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5e127d8a-bac5-4da0-ab05-47990f581464 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079448 May 12 07:11:17.662293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 795/1679] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:17 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:17.985030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-73afeddf-9e2f-451b-9102-394acbc657bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:17.985671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-73afeddf-9e2f-451b-9102-394acbc657bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:17.992577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73afeddf-9e2f-451b-9102-394acbc657bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:17.993523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73afeddf-9e2f-451b-9102-394acbc657bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:17.993799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73afeddf-9e2f-451b-9102-394acbc657bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:17.994241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73afeddf-9e2f-451b-9102-394acbc657bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:18.121701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-73afeddf-9e2f-451b-9102-394acbc657bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:18.130080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-73afeddf-9e2f-451b-9102-394acbc657bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:18.131574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-73afeddf-9e2f-451b-9102-394acbc657bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:18.132762 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-73afeddf-9e2f-451b-9102-394acbc657bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151774 May 12 07:11:18.133327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 885/1680] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:17 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:18.518960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0af046aa-3ce2-48b2-943b-c4a31f830d10 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:18.520432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0af046aa-3ce2-48b2-943b-c4a31f830d10 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:18.526357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0af046aa-3ce2-48b2-943b-c4a31f830d10 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:18.526810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0af046aa-3ce2-48b2-943b-c4a31f830d10 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:18.527584 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0af046aa-3ce2-48b2-943b-c4a31f830d10 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:18.528070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0af046aa-3ce2-48b2-943b-c4a31f830d10 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:18.556989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0af046aa-3ce2-48b2-943b-c4a31f830d10 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042041 May 12 07:11:18.557535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 796/1681] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:18.678283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-269c24d1-7c51-4edc-b450-9943e2eb9d9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:18.678901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-269c24d1-7c51-4edc-b450-9943e2eb9d9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:18.685390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-269c24d1-7c51-4edc-b450-9943e2eb9d9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:18.685845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-269c24d1-7c51-4edc-b450-9943e2eb9d9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:18.686627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-269c24d1-7c51-4edc-b450-9943e2eb9d9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:18.687067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-269c24d1-7c51-4edc-b450-9943e2eb9d9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:18.747171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-269c24d1-7c51-4edc-b450-9943e2eb9d9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:18.754893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-269c24d1-7c51-4edc-b450-9943e2eb9d9a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079905 May 12 07:11:18.755469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 886/1682] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:18 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:19.151507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f55e608f-bfbf-4022-b9ce-23471d7723ef tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:19.152139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f55e608f-bfbf-4022-b9ce-23471d7723ef tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:19.158386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f55e608f-bfbf-4022-b9ce-23471d7723ef tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:19.158835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f55e608f-bfbf-4022-b9ce-23471d7723ef tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:19.159594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f55e608f-bfbf-4022-b9ce-23471d7723ef tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:19.160050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f55e608f-bfbf-4022-b9ce-23471d7723ef tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:19.285884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f55e608f-bfbf-4022-b9ce-23471d7723ef tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:19.294003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f55e608f-bfbf-4022-b9ce-23471d7723ef tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:19.295494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f55e608f-bfbf-4022-b9ce-23471d7723ef tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:19.296677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f55e608f-bfbf-4022-b9ce-23471d7723ef tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149081 May 12 07:11:19.297235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 797/1683] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:19 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:19.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-69aca148-1422-4a75-83c1-ca59be9718ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:19.569453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-69aca148-1422-4a75-83c1-ca59be9718ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:19.575395 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69aca148-1422-4a75-83c1-ca59be9718ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:19.575885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69aca148-1422-4a75-83c1-ca59be9718ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:19.576672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69aca148-1422-4a75-83c1-ca59be9718ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:19.577114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69aca148-1422-4a75-83c1-ca59be9718ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:19.605131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-69aca148-1422-4a75-83c1-ca59be9718ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040616 May 12 07:11:19.605672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 887/1684] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:19.770684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-39bf4a5f-e194-4934-a963-3afd9e8a64d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:19.771300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-39bf4a5f-e194-4934-a963-3afd9e8a64d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:19.777194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39bf4a5f-e194-4934-a963-3afd9e8a64d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:19.777644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39bf4a5f-e194-4934-a963-3afd9e8a64d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:19.778406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39bf4a5f-e194-4934-a963-3afd9e8a64d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:19.778859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39bf4a5f-e194-4934-a963-3afd9e8a64d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:19.838247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-39bf4a5f-e194-4934-a963-3afd9e8a64d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:19.845548 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-39bf4a5f-e194-4934-a963-3afd9e8a64d4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078645 May 12 07:11:19.846112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 798/1685] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:19 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:20.315611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ee3f315d-e091-4115-a8e8-a87699dada72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:20.316397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ee3f315d-e091-4115-a8e8-a87699dada72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:20.323215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee3f315d-e091-4115-a8e8-a87699dada72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:20.330730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee3f315d-e091-4115-a8e8-a87699dada72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:20.330730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee3f315d-e091-4115-a8e8-a87699dada72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:20.330730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee3f315d-e091-4115-a8e8-a87699dada72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:20.451609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ee3f315d-e091-4115-a8e8-a87699dada72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:20.460484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ee3f315d-e091-4115-a8e8-a87699dada72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:20.462054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ee3f315d-e091-4115-a8e8-a87699dada72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:20.463220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ee3f315d-e091-4115-a8e8-a87699dada72 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151533 May 12 07:11:20.463813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 888/1686] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:20.617090 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e6422c1b-c3db-446b-b8cd-5631deb5d0fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:20.617960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e6422c1b-c3db-446b-b8cd-5631deb5d0fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:20.624274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6422c1b-c3db-446b-b8cd-5631deb5d0fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:20.624723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6422c1b-c3db-446b-b8cd-5631deb5d0fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:20.625483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6422c1b-c3db-446b-b8cd-5631deb5d0fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:20.625918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6422c1b-c3db-446b-b8cd-5631deb5d0fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:20.654063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e6422c1b-c3db-446b-b8cd-5631deb5d0fc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041533 May 12 07:11:20.654601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 799/1687] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:20 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:20.862217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6b1c9b8f-5201-4d2a-89f2-842cf2b80629 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:20.862840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6b1c9b8f-5201-4d2a-89f2-842cf2b80629 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:20.869425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b1c9b8f-5201-4d2a-89f2-842cf2b80629 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:20.869836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b1c9b8f-5201-4d2a-89f2-842cf2b80629 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:20.870606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b1c9b8f-5201-4d2a-89f2-842cf2b80629 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:20.871048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b1c9b8f-5201-4d2a-89f2-842cf2b80629 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:20.931142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6b1c9b8f-5201-4d2a-89f2-842cf2b80629 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:20.938441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6b1c9b8f-5201-4d2a-89f2-842cf2b80629 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080080 May 12 07:11:20.939010 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 889/1688] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:20 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:21.482136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b520046e-adfb-4d05-91db-8aec0692ff0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:21.482757 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b520046e-adfb-4d05-91db-8aec0692ff0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:21.488867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b520046e-adfb-4d05-91db-8aec0692ff0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:21.489321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b520046e-adfb-4d05-91db-8aec0692ff0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:21.490088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b520046e-adfb-4d05-91db-8aec0692ff0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:21.490523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b520046e-adfb-4d05-91db-8aec0692ff0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:21.615080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b520046e-adfb-4d05-91db-8aec0692ff0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:21.623587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b520046e-adfb-4d05-91db-8aec0692ff0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:21.625107 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b520046e-adfb-4d05-91db-8aec0692ff0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:21.626251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b520046e-adfb-4d05-91db-8aec0692ff0b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148142 May 12 07:11:21.626804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 800/1689] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:21.666121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d782305d-4c6f-4095-8995-5a713c630899 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:21.667045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d782305d-4c6f-4095-8995-5a713c630899 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:21.672937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d782305d-4c6f-4095-8995-5a713c630899 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:21.673380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d782305d-4c6f-4095-8995-5a713c630899 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:21.674397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d782305d-4c6f-4095-8995-5a713c630899 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:21.674830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d782305d-4c6f-4095-8995-5a713c630899 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:21.703231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d782305d-4c6f-4095-8995-5a713c630899 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041216 May 12 07:11:21.703793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 890/1690] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:21 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:21.954918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5b56a475-0815-41fa-b61a-c220db3698a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:21.955531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5b56a475-0815-41fa-b61a-c220db3698a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:21.962073 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b56a475-0815-41fa-b61a-c220db3698a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:21.962517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b56a475-0815-41fa-b61a-c220db3698a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:21.963282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b56a475-0815-41fa-b61a-c220db3698a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:21.963733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b56a475-0815-41fa-b61a-c220db3698a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:22.023596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5b56a475-0815-41fa-b61a-c220db3698a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:22.030939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5b56a475-0815-41fa-b61a-c220db3698a4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079874 May 12 07:11:22.031507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 801/1691] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:21 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:22.644459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c0cf94a8-65bb-44a4-8889-3ee2430dceac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:22.645087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c0cf94a8-65bb-44a4-8889-3ee2430dceac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:22.650894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0cf94a8-65bb-44a4-8889-3ee2430dceac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:22.651340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0cf94a8-65bb-44a4-8889-3ee2430dceac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:22.652131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0cf94a8-65bb-44a4-8889-3ee2430dceac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:22.652563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0cf94a8-65bb-44a4-8889-3ee2430dceac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:22.714482 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9e8cb00b-26ed-483f-9b69-f8ababf68f36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:22.715505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9e8cb00b-26ed-483f-9b69-f8ababf68f36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:22.721842 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e8cb00b-26ed-483f-9b69-f8ababf68f36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:22.722370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e8cb00b-26ed-483f-9b69-f8ababf68f36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:22.723716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e8cb00b-26ed-483f-9b69-f8ababf68f36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:22.724166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e8cb00b-26ed-483f-9b69-f8ababf68f36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:22.753236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9e8cb00b-26ed-483f-9b69-f8ababf68f36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042637 May 12 07:11:22.754026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 802/1692] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:11:22.781203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c0cf94a8-65bb-44a4-8889-3ee2430dceac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:22.790081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c0cf94a8-65bb-44a4-8889-3ee2430dceac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:22.791601 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c0cf94a8-65bb-44a4-8889-3ee2430dceac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:22.792798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c0cf94a8-65bb-44a4-8889-3ee2430dceac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152210 May 12 07:11:22.793392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 891/1693] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:22 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:23.047654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c8098fa2-a511-44a4-be62-7707a8349e9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:23.048314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c8098fa2-a511-44a4-be62-7707a8349e9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:23.054499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8098fa2-a511-44a4-be62-7707a8349e9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:23.054932 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8098fa2-a511-44a4-be62-7707a8349e9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:23.055722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8098fa2-a511-44a4-be62-7707a8349e9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:23.056163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8098fa2-a511-44a4-be62-7707a8349e9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:23.115134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c8098fa2-a511-44a4-be62-7707a8349e9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:23.122406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c8098fa2-a511-44a4-be62-7707a8349e9e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078586 May 12 07:11:23.122972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 803/1694] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:23 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:23.765403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e624b714-b0b4-43b3-8002-f0c41417e243 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:23.766394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e624b714-b0b4-43b3-8002-f0c41417e243 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:23.772746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e624b714-b0b4-43b3-8002-f0c41417e243 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:23.773201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e624b714-b0b4-43b3-8002-f0c41417e243 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:23.773977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e624b714-b0b4-43b3-8002-f0c41417e243 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:23.774420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e624b714-b0b4-43b3-8002-f0c41417e243 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:23.803543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e624b714-b0b4-43b3-8002-f0c41417e243 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 May 12 07:11:23.804182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 892/1695] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:23.811946 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4595fdd0-6787-4133-875f-195877c737b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:23.812557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4595fdd0-6787-4133-875f-195877c737b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:23.819449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4595fdd0-6787-4133-875f-195877c737b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:23.819924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4595fdd0-6787-4133-875f-195877c737b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:23.820687 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4595fdd0-6787-4133-875f-195877c737b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:23.821120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4595fdd0-6787-4133-875f-195877c737b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:23.943477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4595fdd0-6787-4133-875f-195877c737b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:23.951571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4595fdd0-6787-4133-875f-195877c737b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:23.953097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4595fdd0-6787-4133-875f-195877c737b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:23.954257 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4595fdd0-6787-4133-875f-195877c737b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146148 May 12 07:11:23.954809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 804/1696] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:23 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:24.139096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c229506b-2da9-4d4d-bc0c-5a4d9d75b9bd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:24.139639 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c229506b-2da9-4d4d-bc0c-5a4d9d75b9bd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:24.145583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c229506b-2da9-4d4d-bc0c-5a4d9d75b9bd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:24.146033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c229506b-2da9-4d4d-bc0c-5a4d9d75b9bd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:24.146802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c229506b-2da9-4d4d-bc0c-5a4d9d75b9bd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:24.147244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c229506b-2da9-4d4d-bc0c-5a4d9d75b9bd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:24.206443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c229506b-2da9-4d4d-bc0c-5a4d9d75b9bd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:24.213828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c229506b-2da9-4d4d-bc0c-5a4d9d75b9bd tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078738 May 12 07:11:24.214405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 893/1697] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:24 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:24.814969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7483465b-2407-447c-8b6a-7b0b5e4190a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:24.815913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7483465b-2407-447c-8b6a-7b0b5e4190a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:24.822653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7483465b-2407-447c-8b6a-7b0b5e4190a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:24.823104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7483465b-2407-447c-8b6a-7b0b5e4190a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:24.823903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7483465b-2407-447c-8b6a-7b0b5e4190a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:24.824343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7483465b-2407-447c-8b6a-7b0b5e4190a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:24.853553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7483465b-2407-447c-8b6a-7b0b5e4190a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042563 May 12 07:11:24.854107 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 805/1698] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:24.972157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5b29cce7-0951-4481-b4fd-f3cc8b694c80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:24.972785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5b29cce7-0951-4481-b4fd-f3cc8b694c80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:24.979106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b29cce7-0951-4481-b4fd-f3cc8b694c80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:24.979557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b29cce7-0951-4481-b4fd-f3cc8b694c80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:24.980366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b29cce7-0951-4481-b4fd-f3cc8b694c80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:24.980810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b29cce7-0951-4481-b4fd-f3cc8b694c80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:25.107752 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5b29cce7-0951-4481-b4fd-f3cc8b694c80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:25.116338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5b29cce7-0951-4481-b4fd-f3cc8b694c80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:25.117852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5b29cce7-0951-4481-b4fd-f3cc8b694c80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:25.119001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5b29cce7-0951-4481-b4fd-f3cc8b694c80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150746 May 12 07:11:25.119568 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 894/1699] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:24 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:11:25.231320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d5587023-ba7d-422f-b445-fc14ccfbf14b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:25.231953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d5587023-ba7d-422f-b445-fc14ccfbf14b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:25.237791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5587023-ba7d-422f-b445-fc14ccfbf14b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:25.238238 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5587023-ba7d-422f-b445-fc14ccfbf14b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:25.239491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5587023-ba7d-422f-b445-fc14ccfbf14b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:25.239953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5587023-ba7d-422f-b445-fc14ccfbf14b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:25.299370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d5587023-ba7d-422f-b445-fc14ccfbf14b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:25.307212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d5587023-ba7d-422f-b445-fc14ccfbf14b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079706 May 12 07:11:25.307735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 806/1700] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:25 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:25.865262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b8301dd6-103b-4ee2-bdd8-cd16b46ab4c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:25.866181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b8301dd6-103b-4ee2-bdd8-cd16b46ab4c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:25.872055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8301dd6-103b-4ee2-bdd8-cd16b46ab4c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:25.872498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8301dd6-103b-4ee2-bdd8-cd16b46ab4c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:25.873288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8301dd6-103b-4ee2-bdd8-cd16b46ab4c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:25.873718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8301dd6-103b-4ee2-bdd8-cd16b46ab4c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:25.901745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b8301dd6-103b-4ee2-bdd8-cd16b46ab4c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040417 May 12 07:11:25.902291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 895/1701] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:26.138100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-650b254c-2dc5-48c5-b3d2-79a0f0798e1d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:26.138640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-650b254c-2dc5-48c5-b3d2-79a0f0798e1d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:26.145402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-650b254c-2dc5-48c5-b3d2-79a0f0798e1d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:26.145845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-650b254c-2dc5-48c5-b3d2-79a0f0798e1d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:26.146611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-650b254c-2dc5-48c5-b3d2-79a0f0798e1d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:26.147042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-650b254c-2dc5-48c5-b3d2-79a0f0798e1d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:26.273867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-650b254c-2dc5-48c5-b3d2-79a0f0798e1d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:26.282053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-650b254c-2dc5-48c5-b3d2-79a0f0798e1d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:26.283564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-650b254c-2dc5-48c5-b3d2-79a0f0798e1d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:26.284755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-650b254c-2dc5-48c5-b3d2-79a0f0798e1d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150654 May 12 07:11:26.285314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 807/1702] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:26 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:26.324155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-075a1d2d-aae0-4c2a-b3c4-85f776909852 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:26.324767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-075a1d2d-aae0-4c2a-b3c4-85f776909852 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:26.330998 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-075a1d2d-aae0-4c2a-b3c4-85f776909852 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:26.331444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-075a1d2d-aae0-4c2a-b3c4-85f776909852 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:26.332239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-075a1d2d-aae0-4c2a-b3c4-85f776909852 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:26.333328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-075a1d2d-aae0-4c2a-b3c4-85f776909852 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:26.391613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-075a1d2d-aae0-4c2a-b3c4-85f776909852 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:26.399518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-075a1d2d-aae0-4c2a-b3c4-85f776909852 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079113 May 12 07:11:26.400104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 896/1703] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:26 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:26.913756 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2daad8c1-bd6f-458a-8783-0bd7dc4e1eb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:26.914684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2daad8c1-bd6f-458a-8783-0bd7dc4e1eb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:26.920674 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2daad8c1-bd6f-458a-8783-0bd7dc4e1eb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:26.921127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2daad8c1-bd6f-458a-8783-0bd7dc4e1eb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:26.921899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2daad8c1-bd6f-458a-8783-0bd7dc4e1eb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:26.922342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2daad8c1-bd6f-458a-8783-0bd7dc4e1eb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:26.951288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2daad8c1-bd6f-458a-8783-0bd7dc4e1eb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 May 12 07:11:26.951884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 808/1704] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:27.303227 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fce8b259-86a8-4458-811d-195a38b62174 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:27.303856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fce8b259-86a8-4458-811d-195a38b62174 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:27.309712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fce8b259-86a8-4458-811d-195a38b62174 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:27.310156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fce8b259-86a8-4458-811d-195a38b62174 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:27.310915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fce8b259-86a8-4458-811d-195a38b62174 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:27.311346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fce8b259-86a8-4458-811d-195a38b62174 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:27.416358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c700fcf6-bf16-499e-8814-be91f8413727 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:27.416975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c700fcf6-bf16-499e-8814-be91f8413727 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:27.423152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c700fcf6-bf16-499e-8814-be91f8413727 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:27.423886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c700fcf6-bf16-499e-8814-be91f8413727 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:27.424652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c700fcf6-bf16-499e-8814-be91f8413727 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:27.425089 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c700fcf6-bf16-499e-8814-be91f8413727 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:27.436996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fce8b259-86a8-4458-811d-195a38b62174 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:27.445168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fce8b259-86a8-4458-811d-195a38b62174 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:27.446669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fce8b259-86a8-4458-811d-195a38b62174 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:27.447871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fce8b259-86a8-4458-811d-195a38b62174 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149351 May 12 07:11:27.448444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 897/1705] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:27 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:27.485209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c700fcf6-bf16-499e-8814-be91f8413727 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:27.492440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c700fcf6-bf16-499e-8814-be91f8413727 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079865 May 12 07:11:27.493008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 809/1706] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:27 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:11:27.963335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-353da2b3-f2da-47f1-803b-4f510a2004c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:27.964285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-353da2b3-f2da-47f1-803b-4f510a2004c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:27.970044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-353da2b3-f2da-47f1-803b-4f510a2004c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:27.970490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-353da2b3-f2da-47f1-803b-4f510a2004c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:27.971255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-353da2b3-f2da-47f1-803b-4f510a2004c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:27.971730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-353da2b3-f2da-47f1-803b-4f510a2004c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:28.003890 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-353da2b3-f2da-47f1-803b-4f510a2004c4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044422 May 12 07:11:28.013293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 898/1707] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:28.466956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a02b0f97-8d0d-4518-95ba-a1e36e197ef9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:28.467570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a02b0f97-8d0d-4518-95ba-a1e36e197ef9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:28.474335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a02b0f97-8d0d-4518-95ba-a1e36e197ef9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:28.474779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a02b0f97-8d0d-4518-95ba-a1e36e197ef9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:28.475538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a02b0f97-8d0d-4518-95ba-a1e36e197ef9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:28.476004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a02b0f97-8d0d-4518-95ba-a1e36e197ef9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:28.508475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1c275fdd-f8a1-4940-8935-38a93d97b0a6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:28.509087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1c275fdd-f8a1-4940-8935-38a93d97b0a6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:28.515455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c275fdd-f8a1-4940-8935-38a93d97b0a6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:28.515935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c275fdd-f8a1-4940-8935-38a93d97b0a6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:28.516712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c275fdd-f8a1-4940-8935-38a93d97b0a6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:28.517147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c275fdd-f8a1-4940-8935-38a93d97b0a6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:28.594772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1c275fdd-f8a1-4940-8935-38a93d97b0a6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:28.602637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1c275fdd-f8a1-4940-8935-38a93d97b0a6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.097942 May 12 07:11:28.603217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 899/1708] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:28 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:11:28.623821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a02b0f97-8d0d-4518-95ba-a1e36e197ef9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:28.631892 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a02b0f97-8d0d-4518-95ba-a1e36e197ef9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:28.633383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a02b0f97-8d0d-4518-95ba-a1e36e197ef9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:28.634531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a02b0f97-8d0d-4518-95ba-a1e36e197ef9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.171547 May 12 07:11:28.635083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 810/1709] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:28 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:29.016063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6ebc3487-0cf7-4ba5-9c69-742baa9072dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:29.016981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6ebc3487-0cf7-4ba5-9c69-742baa9072dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:29.023343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ebc3487-0cf7-4ba5-9c69-742baa9072dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:29.023825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ebc3487-0cf7-4ba5-9c69-742baa9072dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:29.024590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ebc3487-0cf7-4ba5-9c69-742baa9072dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:29.025020 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ebc3487-0cf7-4ba5-9c69-742baa9072dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:29.053533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6ebc3487-0cf7-4ba5-9c69-742baa9072dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041492 May 12 07:11:29.054076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 900/1710] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:29.619707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6258d7ee-c6e5-453c-b981-2057b29e9da4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:29.620343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6258d7ee-c6e5-453c-b981-2057b29e9da4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:29.626596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6258d7ee-c6e5-453c-b981-2057b29e9da4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:29.627045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6258d7ee-c6e5-453c-b981-2057b29e9da4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:29.627843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6258d7ee-c6e5-453c-b981-2057b29e9da4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:29.628277 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6258d7ee-c6e5-453c-b981-2057b29e9da4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:29.652655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-468af6a7-8207-449a-95db-fd461e6254b1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:29.653269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-468af6a7-8207-449a-95db-fd461e6254b1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:29.659510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-468af6a7-8207-449a-95db-fd461e6254b1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:29.659993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-468af6a7-8207-449a-95db-fd461e6254b1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:29.660815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-468af6a7-8207-449a-95db-fd461e6254b1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:29.661260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-468af6a7-8207-449a-95db-fd461e6254b1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:29.688601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6258d7ee-c6e5-453c-b981-2057b29e9da4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:29.696586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6258d7ee-c6e5-453c-b981-2057b29e9da4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080788 May 12 07:11:29.697399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 811/1711] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:29 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:29.787874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-468af6a7-8207-449a-95db-fd461e6254b1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:29.796008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-468af6a7-8207-449a-95db-fd461e6254b1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:29.797501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-468af6a7-8207-449a-95db-fd461e6254b1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:29.798915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-468af6a7-8207-449a-95db-fd461e6254b1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149887 May 12 07:11:29.799471 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 901/1712] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:29 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:11:30.064894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-be4cde69-ff57-4a73-85bf-30837b70f85a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:30.065851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-be4cde69-ff57-4a73-85bf-30837b70f85a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:30.071809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-be4cde69-ff57-4a73-85bf-30837b70f85a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:30.072262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-be4cde69-ff57-4a73-85bf-30837b70f85a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:30.073029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-be4cde69-ff57-4a73-85bf-30837b70f85a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:30.073469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-be4cde69-ff57-4a73-85bf-30837b70f85a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:30.101876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-be4cde69-ff57-4a73-85bf-30837b70f85a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040894 May 12 07:11:30.102434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 812/1713] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:30.712956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f2d65596-1c4a-4275-978e-74c0cf76fc4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:30.713565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f2d65596-1c4a-4275-978e-74c0cf76fc4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:30.719834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f2d65596-1c4a-4275-978e-74c0cf76fc4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:30.720280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f2d65596-1c4a-4275-978e-74c0cf76fc4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:30.721048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f2d65596-1c4a-4275-978e-74c0cf76fc4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:30.721481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f2d65596-1c4a-4275-978e-74c0cf76fc4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:30.780694 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f2d65596-1c4a-4275-978e-74c0cf76fc4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:30.788651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f2d65596-1c4a-4275-978e-74c0cf76fc4b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079534 May 12 07:11:30.789234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 902/1714] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:30 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:30.817412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-85558fb8-999c-4e5a-a3c9-0704926afe9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:30.818066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-85558fb8-999c-4e5a-a3c9-0704926afe9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:30.824304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85558fb8-999c-4e5a-a3c9-0704926afe9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:30.824755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85558fb8-999c-4e5a-a3c9-0704926afe9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:30.825520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85558fb8-999c-4e5a-a3c9-0704926afe9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:30.825956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85558fb8-999c-4e5a-a3c9-0704926afe9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:30.950775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-85558fb8-999c-4e5a-a3c9-0704926afe9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:30.958850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-85558fb8-999c-4e5a-a3c9-0704926afe9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:30.960368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-85558fb8-999c-4e5a-a3c9-0704926afe9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:30.961524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-85558fb8-999c-4e5a-a3c9-0704926afe9e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147932 May 12 07:11:30.962093 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 813/1715] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:30 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:31.113422 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6bcbd9b2-08bf-4af6-be80-5c3b1c9b6059 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:31.114360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6bcbd9b2-08bf-4af6-be80-5c3b1c9b6059 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:31.120286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bcbd9b2-08bf-4af6-be80-5c3b1c9b6059 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:31.120741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bcbd9b2-08bf-4af6-be80-5c3b1c9b6059 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:31.121518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bcbd9b2-08bf-4af6-be80-5c3b1c9b6059 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:31.121960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bcbd9b2-08bf-4af6-be80-5c3b1c9b6059 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:31.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6bcbd9b2-08bf-4af6-be80-5c3b1c9b6059 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041318 May 12 07:11:31.151241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 903/1716] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:31.805691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d3ba3c24-d07a-42c7-9b8b-e675b5459489 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:31.806306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d3ba3c24-d07a-42c7-9b8b-e675b5459489 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:31.812342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d3ba3c24-d07a-42c7-9b8b-e675b5459489 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:31.812792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d3ba3c24-d07a-42c7-9b8b-e675b5459489 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:31.813555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d3ba3c24-d07a-42c7-9b8b-e675b5459489 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:31.813991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d3ba3c24-d07a-42c7-9b8b-e675b5459489 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:31.875897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d3ba3c24-d07a-42c7-9b8b-e675b5459489 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:31.883816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d3ba3c24-d07a-42c7-9b8b-e675b5459489 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082481 May 12 07:11:31.884379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 814/1717] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:31 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:31.979774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-16a8bdc1-778f-470e-a5ab-6db9e8de916e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:31.980388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-16a8bdc1-778f-470e-a5ab-6db9e8de916e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:31.986670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16a8bdc1-778f-470e-a5ab-6db9e8de916e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:31.987131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16a8bdc1-778f-470e-a5ab-6db9e8de916e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:31.987943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16a8bdc1-778f-470e-a5ab-6db9e8de916e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:31.988389 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16a8bdc1-778f-470e-a5ab-6db9e8de916e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:32.112501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-16a8bdc1-778f-470e-a5ab-6db9e8de916e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:32.121303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-16a8bdc1-778f-470e-a5ab-6db9e8de916e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:32.122822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-16a8bdc1-778f-470e-a5ab-6db9e8de916e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:32.124039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-16a8bdc1-778f-470e-a5ab-6db9e8de916e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148120 May 12 07:11:32.124599 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 904/1718] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:31 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:32.162741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ab111fea-07bc-4d59-b8b1-3309a646a0bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:32.163700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ab111fea-07bc-4d59-b8b1-3309a646a0bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:32.169495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab111fea-07bc-4d59-b8b1-3309a646a0bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:32.169943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab111fea-07bc-4d59-b8b1-3309a646a0bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:32.170703 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab111fea-07bc-4d59-b8b1-3309a646a0bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:32.171137 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ab111fea-07bc-4d59-b8b1-3309a646a0bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:32.199651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ab111fea-07bc-4d59-b8b1-3309a646a0bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041320 May 12 07:11:32.200291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 815/1719] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:32.900820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-460a1444-23cf-4d42-8404-516c5e5467f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:32.901435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-460a1444-23cf-4d42-8404-516c5e5467f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:32.907448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-460a1444-23cf-4d42-8404-516c5e5467f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:32.907941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-460a1444-23cf-4d42-8404-516c5e5467f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:32.908722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-460a1444-23cf-4d42-8404-516c5e5467f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:32.909166 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-460a1444-23cf-4d42-8404-516c5e5467f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:32.970333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-460a1444-23cf-4d42-8404-516c5e5467f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:32.977696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-460a1444-23cf-4d42-8404-516c5e5467f5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080761 May 12 07:11:32.978271 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 905/1720] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:32 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:33.142833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d5133b32-2122-42b8-ae5e-cf2f0566ab03 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:33.143451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d5133b32-2122-42b8-ae5e-cf2f0566ab03 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:33.149795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5133b32-2122-42b8-ae5e-cf2f0566ab03 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:33.150240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5133b32-2122-42b8-ae5e-cf2f0566ab03 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:33.151056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5133b32-2122-42b8-ae5e-cf2f0566ab03 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:33.151441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5133b32-2122-42b8-ae5e-cf2f0566ab03 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:33.210545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a77f2fa0-7d86-4132-b14b-ad27e4e94a61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:33.211616 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a77f2fa0-7d86-4132-b14b-ad27e4e94a61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:33.218005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a77f2fa0-7d86-4132-b14b-ad27e4e94a61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:33.218462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a77f2fa0-7d86-4132-b14b-ad27e4e94a61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:33.219249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a77f2fa0-7d86-4132-b14b-ad27e4e94a61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:33.219791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a77f2fa0-7d86-4132-b14b-ad27e4e94a61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:33.249861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a77f2fa0-7d86-4132-b14b-ad27e4e94a61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043250 May 12 07:11:33.250458 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 906/1721] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:33 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:11:33.511480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d5133b32-2122-42b8-ae5e-cf2f0566ab03 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:33.519679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d5133b32-2122-42b8-ae5e-cf2f0566ab03 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:33.521703 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d5133b32-2122-42b8-ae5e-cf2f0566ab03 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:33.522872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d5133b32-2122-42b8-ae5e-cf2f0566ab03 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.383977 May 12 07:11:33.523437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 816/1722] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:33 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:33.994636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2a3108fa-3a2b-4d6f-af6f-700e94755ced tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:33.995251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2a3108fa-3a2b-4d6f-af6f-700e94755ced tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:34.001237 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a3108fa-3a2b-4d6f-af6f-700e94755ced tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:34.001680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a3108fa-3a2b-4d6f-af6f-700e94755ced tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:34.002442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a3108fa-3a2b-4d6f-af6f-700e94755ced tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:34.002874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a3108fa-3a2b-4d6f-af6f-700e94755ced tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:34.061523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2a3108fa-3a2b-4d6f-af6f-700e94755ced tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:34.068726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2a3108fa-3a2b-4d6f-af6f-700e94755ced tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.077935 May 12 07:11:34.069296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 907/1723] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:33 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:34.262031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8ebcefcd-15da-4a5c-80ec-92b4ebf855c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:34.262911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8ebcefcd-15da-4a5c-80ec-92b4ebf855c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:34.269293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ebcefcd-15da-4a5c-80ec-92b4ebf855c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:34.269735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ebcefcd-15da-4a5c-80ec-92b4ebf855c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:34.270486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ebcefcd-15da-4a5c-80ec-92b4ebf855c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:34.270918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ebcefcd-15da-4a5c-80ec-92b4ebf855c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:34.298175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8ebcefcd-15da-4a5c-80ec-92b4ebf855c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040154 May 12 07:11:34.298968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 817/1724] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:34.540990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bca6c11c-824d-4610-9609-6772ff5a68e8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:34.541620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bca6c11c-824d-4610-9609-6772ff5a68e8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:34.547838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bca6c11c-824d-4610-9609-6772ff5a68e8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:34.548284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bca6c11c-824d-4610-9609-6772ff5a68e8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:34.549313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bca6c11c-824d-4610-9609-6772ff5a68e8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:34.549749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bca6c11c-824d-4610-9609-6772ff5a68e8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:34.674227 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bca6c11c-824d-4610-9609-6772ff5a68e8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:34.683142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bca6c11c-824d-4610-9609-6772ff5a68e8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:34.684870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bca6c11c-824d-4610-9609-6772ff5a68e8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:34.686044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bca6c11c-824d-4610-9609-6772ff5a68e8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149096 May 12 07:11:34.686661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 908/1725] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:34 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:11:35.085623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-51b1360c-b75c-4019-b04c-57c85112dfe9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:35.086297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-51b1360c-b75c-4019-b04c-57c85112dfe9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:35.092168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51b1360c-b75c-4019-b04c-57c85112dfe9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:35.092612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51b1360c-b75c-4019-b04c-57c85112dfe9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:35.093367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51b1360c-b75c-4019-b04c-57c85112dfe9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:35.093801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51b1360c-b75c-4019-b04c-57c85112dfe9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:35.155788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-51b1360c-b75c-4019-b04c-57c85112dfe9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:35.163550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-51b1360c-b75c-4019-b04c-57c85112dfe9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082268 May 12 07:11:35.164136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 818/1726] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:35 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:35.310437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5fff1a3c-2312-4825-82eb-0e9edca4471e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:35.311332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5fff1a3c-2312-4825-82eb-0e9edca4471e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:35.317171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fff1a3c-2312-4825-82eb-0e9edca4471e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:35.318116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fff1a3c-2312-4825-82eb-0e9edca4471e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:35.318887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fff1a3c-2312-4825-82eb-0e9edca4471e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:35.319325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5fff1a3c-2312-4825-82eb-0e9edca4471e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:35.347626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5fff1a3c-2312-4825-82eb-0e9edca4471e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041215 May 12 07:11:35.348198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 909/1727] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:35 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:35.704589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cd0aa5d1-d511-4599-b91d-0481515ba6a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:35.705146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cd0aa5d1-d511-4599-b91d-0481515ba6a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:35.711386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd0aa5d1-d511-4599-b91d-0481515ba6a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:35.711867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd0aa5d1-d511-4599-b91d-0481515ba6a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:35.712630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd0aa5d1-d511-4599-b91d-0481515ba6a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:35.713067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd0aa5d1-d511-4599-b91d-0481515ba6a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:35.836007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cd0aa5d1-d511-4599-b91d-0481515ba6a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:35.844177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cd0aa5d1-d511-4599-b91d-0481515ba6a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:35.845659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cd0aa5d1-d511-4599-b91d-0481515ba6a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:35.846812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cd0aa5d1-d511-4599-b91d-0481515ba6a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146179 May 12 07:11:35.847375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 819/1728] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:35 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:36.180877 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5b7a43be-6104-4a28-9ada-266cade48b4a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:36.181499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5b7a43be-6104-4a28-9ada-266cade48b4a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:36.187933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b7a43be-6104-4a28-9ada-266cade48b4a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:36.188422 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b7a43be-6104-4a28-9ada-266cade48b4a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:36.189159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b7a43be-6104-4a28-9ada-266cade48b4a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:36.189598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b7a43be-6104-4a28-9ada-266cade48b4a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:36.250406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5b7a43be-6104-4a28-9ada-266cade48b4a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:36.258855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5b7a43be-6104-4a28-9ada-266cade48b4a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082467 May 12 07:11:36.259428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 910/1729] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:36 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:36.359067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8fe99b3d-6e94-4a4b-8560-ee0a83c52dee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:36.360073 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8fe99b3d-6e94-4a4b-8560-ee0a83c52dee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:36.366726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fe99b3d-6e94-4a4b-8560-ee0a83c52dee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:36.367181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fe99b3d-6e94-4a4b-8560-ee0a83c52dee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:36.367980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fe99b3d-6e94-4a4b-8560-ee0a83c52dee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:36.368416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fe99b3d-6e94-4a4b-8560-ee0a83c52dee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:36.396488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8fe99b3d-6e94-4a4b-8560-ee0a83c52dee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041417 May 12 07:11:36.397034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 820/1730] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:36.865116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-af653b25-1dbb-44a8-830e-98b853bf7b58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:36.865726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-af653b25-1dbb-44a8-830e-98b853bf7b58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:36.871619 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af653b25-1dbb-44a8-830e-98b853bf7b58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:36.872099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af653b25-1dbb-44a8-830e-98b853bf7b58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:36.872863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af653b25-1dbb-44a8-830e-98b853bf7b58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:36.873302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af653b25-1dbb-44a8-830e-98b853bf7b58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:37.000753 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-af653b25-1dbb-44a8-830e-98b853bf7b58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:37.009528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-af653b25-1dbb-44a8-830e-98b853bf7b58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:37.011033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-af653b25-1dbb-44a8-830e-98b853bf7b58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:37.012237 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-af653b25-1dbb-44a8-830e-98b853bf7b58 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151058 May 12 07:11:37.012797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 911/1731] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:36 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:37.276148 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-aa864dd6-0175-4d8e-a2fe-1730222157fa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:37.276763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-aa864dd6-0175-4d8e-a2fe-1730222157fa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:37.283003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa864dd6-0175-4d8e-a2fe-1730222157fa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:37.283486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa864dd6-0175-4d8e-a2fe-1730222157fa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:37.284278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa864dd6-0175-4d8e-a2fe-1730222157fa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:37.284710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aa864dd6-0175-4d8e-a2fe-1730222157fa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:37.344024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aa864dd6-0175-4d8e-a2fe-1730222157fa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:37.351362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-aa864dd6-0175-4d8e-a2fe-1730222157fa tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079029 May 12 07:11:37.352151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 821/1732] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:37 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:37.407916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-52c36296-08ae-4342-9c17-28ac48ac9a9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:37.408852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-52c36296-08ae-4342-9c17-28ac48ac9a9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:37.416341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52c36296-08ae-4342-9c17-28ac48ac9a9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:37.416793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52c36296-08ae-4342-9c17-28ac48ac9a9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:37.417563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52c36296-08ae-4342-9c17-28ac48ac9a9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:37.418002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52c36296-08ae-4342-9c17-28ac48ac9a9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:37.447628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-52c36296-08ae-4342-9c17-28ac48ac9a9a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043632 May 12 07:11:37.448213 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 912/1733] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:38.030414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b8eab851-db2f-481b-be9d-e91f516650d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:38.031035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b8eab851-db2f-481b-be9d-e91f516650d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:38.038168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8eab851-db2f-481b-be9d-e91f516650d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:38.038622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8eab851-db2f-481b-be9d-e91f516650d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:38.039389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8eab851-db2f-481b-be9d-e91f516650d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:38.039861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8eab851-db2f-481b-be9d-e91f516650d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:38.165510 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8eab851-db2f-481b-be9d-e91f516650d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:38.173910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8eab851-db2f-481b-be9d-e91f516650d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:38.175420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8eab851-db2f-481b-be9d-e91f516650d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:38.176617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b8eab851-db2f-481b-be9d-e91f516650d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150136 May 12 07:11:38.177816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 822/1734] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:38 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:38.368532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0a92a19c-c6fa-4cf2-b669-992b0d8324ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:38.369146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0a92a19c-c6fa-4cf2-b669-992b0d8324ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:38.375206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a92a19c-c6fa-4cf2-b669-992b0d8324ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:38.375652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a92a19c-c6fa-4cf2-b669-992b0d8324ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:38.376465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a92a19c-c6fa-4cf2-b669-992b0d8324ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:38.376905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a92a19c-c6fa-4cf2-b669-992b0d8324ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:38.441066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0a92a19c-c6fa-4cf2-b669-992b0d8324ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:38.448683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0a92a19c-c6fa-4cf2-b669-992b0d8324ad tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084599 May 12 07:11:38.449266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 913/1735] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:38 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:38.458476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a5dc18bd-50d1-4187-86f9-55d8ca67384d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:38.459439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a5dc18bd-50d1-4187-86f9-55d8ca67384d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:38.465539 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5dc18bd-50d1-4187-86f9-55d8ca67384d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:38.465996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5dc18bd-50d1-4187-86f9-55d8ca67384d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:38.466822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5dc18bd-50d1-4187-86f9-55d8ca67384d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:38.467284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a5dc18bd-50d1-4187-86f9-55d8ca67384d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:38.496658 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a5dc18bd-50d1-4187-86f9-55d8ca67384d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042261 May 12 07:11:38.497217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 823/1736] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:38 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:39.196818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b92d2abc-eebf-4f9d-9cb3-fd0cadcb4492 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:39.197429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b92d2abc-eebf-4f9d-9cb3-fd0cadcb4492 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:39.203307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b92d2abc-eebf-4f9d-9cb3-fd0cadcb4492 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:39.203823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b92d2abc-eebf-4f9d-9cb3-fd0cadcb4492 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:39.204596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b92d2abc-eebf-4f9d-9cb3-fd0cadcb4492 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:39.205030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b92d2abc-eebf-4f9d-9cb3-fd0cadcb4492 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:39.328290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b92d2abc-eebf-4f9d-9cb3-fd0cadcb4492 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:39.336475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b92d2abc-eebf-4f9d-9cb3-fd0cadcb4492 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:39.337974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b92d2abc-eebf-4f9d-9cb3-fd0cadcb4492 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:39.339125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b92d2abc-eebf-4f9d-9cb3-fd0cadcb4492 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146729 May 12 07:11:39.339701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 914/1737] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:39 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:39.465141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-80ee21d7-d3cd-49af-9e64-e0f53c53817a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:39.465750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-80ee21d7-d3cd-49af-9e64-e0f53c53817a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:39.472098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80ee21d7-d3cd-49af-9e64-e0f53c53817a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:39.472543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80ee21d7-d3cd-49af-9e64-e0f53c53817a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:39.473304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80ee21d7-d3cd-49af-9e64-e0f53c53817a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:39.473735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80ee21d7-d3cd-49af-9e64-e0f53c53817a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:39.509027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-14fb6d5a-0b72-48a5-a216-c660c57cac03 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:39.509957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-14fb6d5a-0b72-48a5-a216-c660c57cac03 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:39.516477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14fb6d5a-0b72-48a5-a216-c660c57cac03 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:39.516949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14fb6d5a-0b72-48a5-a216-c660c57cac03 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:39.517810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14fb6d5a-0b72-48a5-a216-c660c57cac03 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:39.518264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14fb6d5a-0b72-48a5-a216-c660c57cac03 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:39.533311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-80ee21d7-d3cd-49af-9e64-e0f53c53817a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:39.540611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-80ee21d7-d3cd-49af-9e64-e0f53c53817a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079413 May 12 07:11:39.541175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 824/1738] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:39 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:39.548784 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-14fb6d5a-0b72-48a5-a216-c660c57cac03 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044120 May 12 07:11:39.549339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 915/1739] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:11:40.357095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-91fa08c9-d0a1-482b-89ea-c6a248356fa9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:40.357740 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-91fa08c9-d0a1-482b-89ea-c6a248356fa9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:40.363702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91fa08c9-d0a1-482b-89ea-c6a248356fa9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:40.364643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91fa08c9-d0a1-482b-89ea-c6a248356fa9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:40.365399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91fa08c9-d0a1-482b-89ea-c6a248356fa9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:40.365830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91fa08c9-d0a1-482b-89ea-c6a248356fa9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:40.491396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-91fa08c9-d0a1-482b-89ea-c6a248356fa9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:40.499557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-91fa08c9-d0a1-482b-89ea-c6a248356fa9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:40.501087 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-91fa08c9-d0a1-482b-89ea-c6a248356fa9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:40.502276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-91fa08c9-d0a1-482b-89ea-c6a248356fa9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149116 May 12 07:11:40.502839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 825/1740] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:40 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:40.558075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cb028b6d-5377-46ad-8322-80482201bc04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:40.558687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cb028b6d-5377-46ad-8322-80482201bc04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:40.560263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-30a159e0-d962-455e-ae97-1671ce568092 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:40.561176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-30a159e0-d962-455e-ae97-1671ce568092 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:40.564963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb028b6d-5377-46ad-8322-80482201bc04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:40.565509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb028b6d-5377-46ad-8322-80482201bc04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:40.566208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb028b6d-5377-46ad-8322-80482201bc04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:40.566643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb028b6d-5377-46ad-8322-80482201bc04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:40.566930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30a159e0-d962-455e-ae97-1671ce568092 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:40.567382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30a159e0-d962-455e-ae97-1671ce568092 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:40.568177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30a159e0-d962-455e-ae97-1671ce568092 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:40.568614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-30a159e0-d962-455e-ae97-1671ce568092 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:40.596708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-30a159e0-d962-455e-ae97-1671ce568092 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040151 May 12 07:11:40.597273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 826/1741] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:40 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:11:40.626992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cb028b6d-5377-46ad-8322-80482201bc04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:40.634328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cb028b6d-5377-46ad-8322-80482201bc04 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080074 May 12 07:11:40.634932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 916/1742] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:40 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:41.521161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1ed8ec0b-7554-4794-bc30-3c915f5676b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:41.521776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1ed8ec0b-7554-4794-bc30-3c915f5676b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:41.528095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1ed8ec0b-7554-4794-bc30-3c915f5676b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:41.528545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1ed8ec0b-7554-4794-bc30-3c915f5676b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:41.529312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1ed8ec0b-7554-4794-bc30-3c915f5676b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:41.529751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1ed8ec0b-7554-4794-bc30-3c915f5676b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:41.608173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ec977a9d-3ce0-446c-a55f-75650c9425b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:41.609108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ec977a9d-3ce0-446c-a55f-75650c9425b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:41.615962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec977a9d-3ce0-446c-a55f-75650c9425b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:41.616417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec977a9d-3ce0-446c-a55f-75650c9425b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:41.617230 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec977a9d-3ce0-446c-a55f-75650c9425b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:41.617739 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec977a9d-3ce0-446c-a55f-75650c9425b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:41.646565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ec977a9d-3ce0-446c-a55f-75650c9425b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042378 May 12 07:11:41.650226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 917/1743] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:41 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:11:41.652253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-26782c24-0aeb-4b99-a1cd-70f8217a223d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:41.652253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-26782c24-0aeb-4b99-a1cd-70f8217a223d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:41.654384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1ed8ec0b-7554-4794-bc30-3c915f5676b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:41.658029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-26782c24-0aeb-4b99-a1cd-70f8217a223d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:41.658482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-26782c24-0aeb-4b99-a1cd-70f8217a223d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:41.659256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-26782c24-0aeb-4b99-a1cd-70f8217a223d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:41.659706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-26782c24-0aeb-4b99-a1cd-70f8217a223d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:41.662614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1ed8ec0b-7554-4794-bc30-3c915f5676b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:41.664143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1ed8ec0b-7554-4794-bc30-3c915f5676b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:41.665318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1ed8ec0b-7554-4794-bc30-3c915f5676b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148698 May 12 07:11:41.665871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 827/1744] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:41 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:41.722645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-26782c24-0aeb-4b99-a1cd-70f8217a223d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:41.730003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-26782c24-0aeb-4b99-a1cd-70f8217a223d tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081923 May 12 07:11:41.730580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 918/1745] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:41 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:42.658040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-78157c72-ac69-45aa-b2bc-eb8248d2f34a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:42.658992 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-78157c72-ac69-45aa-b2bc-eb8248d2f34a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:42.665415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78157c72-ac69-45aa-b2bc-eb8248d2f34a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:42.665861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78157c72-ac69-45aa-b2bc-eb8248d2f34a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:42.666619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78157c72-ac69-45aa-b2bc-eb8248d2f34a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:42.667054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78157c72-ac69-45aa-b2bc-eb8248d2f34a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:42.683639 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a49cc305-30ee-4462-8d9b-b9a4c5225f90 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:42.684278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a49cc305-30ee-4462-8d9b-b9a4c5225f90 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:42.690496 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a49cc305-30ee-4462-8d9b-b9a4c5225f90 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:42.690955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a49cc305-30ee-4462-8d9b-b9a4c5225f90 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:42.691741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a49cc305-30ee-4462-8d9b-b9a4c5225f90 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:42.692713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a49cc305-30ee-4462-8d9b-b9a4c5225f90 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:42.695705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-78157c72-ac69-45aa-b2bc-eb8248d2f34a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041591 May 12 07:11:42.696451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 828/1746] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:42 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:42.746526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3374e092-3a74-4e8f-babd-3b76bf908269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:42.747143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3374e092-3a74-4e8f-babd-3b76bf908269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:42.753987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3374e092-3a74-4e8f-babd-3b76bf908269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:42.754443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3374e092-3a74-4e8f-babd-3b76bf908269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:42.756061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3374e092-3a74-4e8f-babd-3b76bf908269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:42.756503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3374e092-3a74-4e8f-babd-3b76bf908269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:42.825579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3374e092-3a74-4e8f-babd-3b76bf908269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:42.836845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3374e092-3a74-4e8f-babd-3b76bf908269 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.094163 May 12 07:11:42.837424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 829/1747] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:42 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:11:42.844307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a49cc305-30ee-4462-8d9b-b9a4c5225f90 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:42.852566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a49cc305-30ee-4462-8d9b-b9a4c5225f90 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:42.854057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a49cc305-30ee-4462-8d9b-b9a4c5225f90 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:42.855208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a49cc305-30ee-4462-8d9b-b9a4c5225f90 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.175417 May 12 07:11:42.855786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 919/1748] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:42 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:11:43.707217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-181e4914-382d-4c7a-b4b0-03b1a34e0526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:43.708767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-181e4914-382d-4c7a-b4b0-03b1a34e0526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:43.715119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-181e4914-382d-4c7a-b4b0-03b1a34e0526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:43.715563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-181e4914-382d-4c7a-b4b0-03b1a34e0526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:43.716355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-181e4914-382d-4c7a-b4b0-03b1a34e0526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:43.716787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-181e4914-382d-4c7a-b4b0-03b1a34e0526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:43.744322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-181e4914-382d-4c7a-b4b0-03b1a34e0526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041160 May 12 07:11:43.744864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 830/1749] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:43.853488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-73d3b797-0003-42e6-b420-213987ea7be9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:43.854102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-73d3b797-0003-42e6-b420-213987ea7be9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:43.860517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73d3b797-0003-42e6-b420-213987ea7be9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:43.860965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73d3b797-0003-42e6-b420-213987ea7be9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:43.861736 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73d3b797-0003-42e6-b420-213987ea7be9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:43.862169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73d3b797-0003-42e6-b420-213987ea7be9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:43.873370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d5f9830c-183a-4342-9478-fc5afda5e37c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:43.873981 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d5f9830c-183a-4342-9478-fc5afda5e37c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:43.881561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5f9830c-183a-4342-9478-fc5afda5e37c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:43.882002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5f9830c-183a-4342-9478-fc5afda5e37c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:43.882778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5f9830c-183a-4342-9478-fc5afda5e37c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:43.883212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d5f9830c-183a-4342-9478-fc5afda5e37c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:43.924533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-73d3b797-0003-42e6-b420-213987ea7be9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:43.932522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-73d3b797-0003-42e6-b420-213987ea7be9 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082963 May 12 07:11:43.933101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 920/1750] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:43 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:44.018586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d5f9830c-183a-4342-9478-fc5afda5e37c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:44.026756 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d5f9830c-183a-4342-9478-fc5afda5e37c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:44.028305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d5f9830c-183a-4342-9478-fc5afda5e37c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:44.029469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d5f9830c-183a-4342-9478-fc5afda5e37c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.159972 May 12 07:11:44.030028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 831/1751] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:43 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:11:44.756419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1eb68e78-6753-44aa-a515-5fd9ed0ae120 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:44.757369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1eb68e78-6753-44aa-a515-5fd9ed0ae120 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:44.763140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1eb68e78-6753-44aa-a515-5fd9ed0ae120 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:44.767907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1eb68e78-6753-44aa-a515-5fd9ed0ae120 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:44.767907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1eb68e78-6753-44aa-a515-5fd9ed0ae120 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:44.767907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1eb68e78-6753-44aa-a515-5fd9ed0ae120 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:44.793060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1eb68e78-6753-44aa-a515-5fd9ed0ae120 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041264 May 12 07:11:44.793632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 921/1752] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:44.949246 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bfa2dedb-9184-45a4-8ffe-358adfd351e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:44.949860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bfa2dedb-9184-45a4-8ffe-358adfd351e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:44.956143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bfa2dedb-9184-45a4-8ffe-358adfd351e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:44.956587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bfa2dedb-9184-45a4-8ffe-358adfd351e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:44.957357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bfa2dedb-9184-45a4-8ffe-358adfd351e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:44.957795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bfa2dedb-9184-45a4-8ffe-358adfd351e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:45.018655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bfa2dedb-9184-45a4-8ffe-358adfd351e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:45.026043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bfa2dedb-9184-45a4-8ffe-358adfd351e8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080820 May 12 07:11:45.026607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 832/1753] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:44 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:45.047711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7d318503-13ed-42fe-a906-2ce490ce3aa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:45.048591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7d318503-13ed-42fe-a906-2ce490ce3aa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:45.055332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7d318503-13ed-42fe-a906-2ce490ce3aa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:45.055811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7d318503-13ed-42fe-a906-2ce490ce3aa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:45.056592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7d318503-13ed-42fe-a906-2ce490ce3aa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:45.057037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7d318503-13ed-42fe-a906-2ce490ce3aa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:45.183950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7d318503-13ed-42fe-a906-2ce490ce3aa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:45.192148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7d318503-13ed-42fe-a906-2ce490ce3aa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:45.193662 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7d318503-13ed-42fe-a906-2ce490ce3aa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:45.194823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7d318503-13ed-42fe-a906-2ce490ce3aa1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150960 May 12 07:11:45.195383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 922/1754] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:45 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:45.806849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d41764ad-bb36-4e73-acd1-4204689d2ccf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:45.807773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d41764ad-bb36-4e73-acd1-4204689d2ccf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:45.813608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d41764ad-bb36-4e73-acd1-4204689d2ccf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:45.814056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d41764ad-bb36-4e73-acd1-4204689d2ccf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:45.814813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d41764ad-bb36-4e73-acd1-4204689d2ccf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:45.815243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d41764ad-bb36-4e73-acd1-4204689d2ccf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:45.843655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d41764ad-bb36-4e73-acd1-4204689d2ccf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042281 May 12 07:11:45.844249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 833/1755] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:45 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:46.042853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dba1662b-313c-45dd-96b3-98c3e38c2dd4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:46.043477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dba1662b-313c-45dd-96b3-98c3e38c2dd4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:46.050036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dba1662b-313c-45dd-96b3-98c3e38c2dd4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:46.050579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dba1662b-313c-45dd-96b3-98c3e38c2dd4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:46.051240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dba1662b-313c-45dd-96b3-98c3e38c2dd4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:46.051675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dba1662b-313c-45dd-96b3-98c3e38c2dd4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:46.112929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dba1662b-313c-45dd-96b3-98c3e38c2dd4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:46.120232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dba1662b-313c-45dd-96b3-98c3e38c2dd4 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081282 May 12 07:11:46.120794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 923/1756] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:46 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:46.213750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f81cfa2f-a52a-4de1-b933-54b8dcc6b780 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:46.214359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f81cfa2f-a52a-4de1-b933-54b8dcc6b780 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:46.220590 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f81cfa2f-a52a-4de1-b933-54b8dcc6b780 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:46.221039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f81cfa2f-a52a-4de1-b933-54b8dcc6b780 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:46.221797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f81cfa2f-a52a-4de1-b933-54b8dcc6b780 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:46.222232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f81cfa2f-a52a-4de1-b933-54b8dcc6b780 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:46.345251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f81cfa2f-a52a-4de1-b933-54b8dcc6b780 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:46.353963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f81cfa2f-a52a-4de1-b933-54b8dcc6b780 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:46.355456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f81cfa2f-a52a-4de1-b933-54b8dcc6b780 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:46.356634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f81cfa2f-a52a-4de1-b933-54b8dcc6b780 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146844 May 12 07:11:46.357190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 834/1757] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:46 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:46.854852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4be2efc7-4f9f-4e66-bd91-faac77473c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:46.855804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4be2efc7-4f9f-4e66-bd91-faac77473c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:46.861721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4be2efc7-4f9f-4e66-bd91-faac77473c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:46.862170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4be2efc7-4f9f-4e66-bd91-faac77473c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:46.862939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4be2efc7-4f9f-4e66-bd91-faac77473c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:46.863376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4be2efc7-4f9f-4e66-bd91-faac77473c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:46.891171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4be2efc7-4f9f-4e66-bd91-faac77473c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040310 May 12 07:11:46.891740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 924/1758] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:46 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:47.136900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1c10a25e-d70b-4670-b37b-6045eae03e72 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:47.137452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1c10a25e-d70b-4670-b37b-6045eae03e72 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:47.143355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c10a25e-d70b-4670-b37b-6045eae03e72 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:47.143832 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c10a25e-d70b-4670-b37b-6045eae03e72 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:47.144598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c10a25e-d70b-4670-b37b-6045eae03e72 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:47.145030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c10a25e-d70b-4670-b37b-6045eae03e72 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:47.203822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1c10a25e-d70b-4670-b37b-6045eae03e72 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:47.211536 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1c10a25e-d70b-4670-b37b-6045eae03e72 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078518 May 12 07:11:47.212128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 835/1759] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:47 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:47.374262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0b672e36-7590-46b3-ba36-2361e45dedba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:47.374871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0b672e36-7590-46b3-ba36-2361e45dedba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:47.381677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b672e36-7590-46b3-ba36-2361e45dedba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:47.382126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b672e36-7590-46b3-ba36-2361e45dedba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:47.382891 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b672e36-7590-46b3-ba36-2361e45dedba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:47.383330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b672e36-7590-46b3-ba36-2361e45dedba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:47.509448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0b672e36-7590-46b3-ba36-2361e45dedba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:47.517530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0b672e36-7590-46b3-ba36-2361e45dedba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:47.519022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0b672e36-7590-46b3-ba36-2361e45dedba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:47.520202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0b672e36-7590-46b3-ba36-2361e45dedba tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149847 May 12 07:11:47.520764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 925/1760] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:47 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:47.902633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0eb9a0b4-085f-455e-bd9d-8526a3948cb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:47.903558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0eb9a0b4-085f-455e-bd9d-8526a3948cb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:47.909925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0eb9a0b4-085f-455e-bd9d-8526a3948cb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:47.910376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0eb9a0b4-085f-455e-bd9d-8526a3948cb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:47.911644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0eb9a0b4-085f-455e-bd9d-8526a3948cb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:47.912115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0eb9a0b4-085f-455e-bd9d-8526a3948cb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:47.940966 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0eb9a0b4-085f-455e-bd9d-8526a3948cb0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042327 May 12 07:11:47.941671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 836/1761] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:48.228544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e932874f-54bd-40a5-9605-e71a6f921d55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:48.229084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e932874f-54bd-40a5-9605-e71a6f921d55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:48.235022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e932874f-54bd-40a5-9605-e71a6f921d55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:48.235475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e932874f-54bd-40a5-9605-e71a6f921d55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:48.236279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e932874f-54bd-40a5-9605-e71a6f921d55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:48.236720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e932874f-54bd-40a5-9605-e71a6f921d55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:48.295920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e932874f-54bd-40a5-9605-e71a6f921d55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:48.303390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e932874f-54bd-40a5-9605-e71a6f921d55 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078785 May 12 07:11:48.303986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 926/1762] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:48 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:48.538183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-90cf1cc0-a338-422f-87e9-5df11ce6792c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:48.538797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-90cf1cc0-a338-422f-87e9-5df11ce6792c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:48.544715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90cf1cc0-a338-422f-87e9-5df11ce6792c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:48.545168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90cf1cc0-a338-422f-87e9-5df11ce6792c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:48.545939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90cf1cc0-a338-422f-87e9-5df11ce6792c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:48.546379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90cf1cc0-a338-422f-87e9-5df11ce6792c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:48.671546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-90cf1cc0-a338-422f-87e9-5df11ce6792c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:48.680067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-90cf1cc0-a338-422f-87e9-5df11ce6792c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:48.681572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-90cf1cc0-a338-422f-87e9-5df11ce6792c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:48.682732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-90cf1cc0-a338-422f-87e9-5df11ce6792c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149015 May 12 07:11:48.683299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 837/1763] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:48 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:48.952469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f08dae99-634b-40b9-afd0-b60c1a6786e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:48.953313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f08dae99-634b-40b9-afd0-b60c1a6786e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:48.960588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f08dae99-634b-40b9-afd0-b60c1a6786e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:48.961043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f08dae99-634b-40b9-afd0-b60c1a6786e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:48.961948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f08dae99-634b-40b9-afd0-b60c1a6786e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:48.962392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f08dae99-634b-40b9-afd0-b60c1a6786e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:48.992071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f08dae99-634b-40b9-afd0-b60c1a6786e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043633 May 12 07:11:48.992644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 927/1764] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:48 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:49.320160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e1a49c9b-dfda-4459-bd73-24c226db033a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:49.320791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e1a49c9b-dfda-4459-bd73-24c226db033a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:49.327002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1a49c9b-dfda-4459-bd73-24c226db033a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:49.327565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1a49c9b-dfda-4459-bd73-24c226db033a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:49.328361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1a49c9b-dfda-4459-bd73-24c226db033a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:49.328793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1a49c9b-dfda-4459-bd73-24c226db033a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:49.389991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e1a49c9b-dfda-4459-bd73-24c226db033a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:49.397274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e1a49c9b-dfda-4459-bd73-24c226db033a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081684 May 12 07:11:49.397833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 838/1765] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:49 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:49.701818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fe4369a5-4545-45c0-b379-a36c0e3f1d5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:49.702350 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fe4369a5-4545-45c0-b379-a36c0e3f1d5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:49.708240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe4369a5-4545-45c0-b379-a36c0e3f1d5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:49.708690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe4369a5-4545-45c0-b379-a36c0e3f1d5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:49.709461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe4369a5-4545-45c0-b379-a36c0e3f1d5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:49.709897 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe4369a5-4545-45c0-b379-a36c0e3f1d5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:49.832329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fe4369a5-4545-45c0-b379-a36c0e3f1d5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:49.840933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fe4369a5-4545-45c0-b379-a36c0e3f1d5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:49.842429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fe4369a5-4545-45c0-b379-a36c0e3f1d5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:49.843589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fe4369a5-4545-45c0-b379-a36c0e3f1d5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.145741 May 12 07:11:49.844186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 928/1766] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:49 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:50.003855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-92580eaf-dac8-4e52-8e10-289e5bfc61ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:50.004782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-92580eaf-dac8-4e52-8e10-289e5bfc61ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:50.010684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92580eaf-dac8-4e52-8e10-289e5bfc61ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:50.011131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92580eaf-dac8-4e52-8e10-289e5bfc61ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:50.011927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92580eaf-dac8-4e52-8e10-289e5bfc61ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:50.012365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92580eaf-dac8-4e52-8e10-289e5bfc61ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:50.041640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-92580eaf-dac8-4e52-8e10-289e5bfc61ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041795 May 12 07:11:50.042177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 839/1767] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:49 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:50.413832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-69b23c2f-4753-4568-b158-8dfda0afec31 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:50.414359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-69b23c2f-4753-4568-b158-8dfda0afec31 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:50.420774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69b23c2f-4753-4568-b158-8dfda0afec31 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:50.421233 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69b23c2f-4753-4568-b158-8dfda0afec31 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:50.422041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69b23c2f-4753-4568-b158-8dfda0afec31 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:50.422482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69b23c2f-4753-4568-b158-8dfda0afec31 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:50.482663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-69b23c2f-4753-4568-b158-8dfda0afec31 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:50.490521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-69b23c2f-4753-4568-b158-8dfda0afec31 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080659 May 12 07:11:50.491094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 929/1768] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:50 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:50.862430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5c07be59-7fb1-41c5-926b-e8f9eec8f6d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:50.863034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5c07be59-7fb1-41c5-926b-e8f9eec8f6d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:50.870155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c07be59-7fb1-41c5-926b-e8f9eec8f6d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:50.870601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c07be59-7fb1-41c5-926b-e8f9eec8f6d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:50.871358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c07be59-7fb1-41c5-926b-e8f9eec8f6d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:50.871846 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c07be59-7fb1-41c5-926b-e8f9eec8f6d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:51.000603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5c07be59-7fb1-41c5-926b-e8f9eec8f6d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:51.008921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5c07be59-7fb1-41c5-926b-e8f9eec8f6d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:51.010437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5c07be59-7fb1-41c5-926b-e8f9eec8f6d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:51.011610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5c07be59-7fb1-41c5-926b-e8f9eec8f6d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.153046 May 12 07:11:51.012212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 840/1769] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:50 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:51.053883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0a0740fa-ee27-43bd-a845-03016da8214c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:51.055059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0a0740fa-ee27-43bd-a845-03016da8214c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:51.060705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0740fa-ee27-43bd-a845-03016da8214c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:51.061161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0740fa-ee27-43bd-a845-03016da8214c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:51.061937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0740fa-ee27-43bd-a845-03016da8214c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:51.062382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0740fa-ee27-43bd-a845-03016da8214c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:51.089951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0a0740fa-ee27-43bd-a845-03016da8214c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040688 May 12 07:11:51.090503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 930/1770] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:51.506256 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-85636713-f7e4-45a6-93a2-bb1d67e49b99 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:51.506874 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-85636713-f7e4-45a6-93a2-bb1d67e49b99 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:51.512896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85636713-f7e4-45a6-93a2-bb1d67e49b99 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:51.513352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85636713-f7e4-45a6-93a2-bb1d67e49b99 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:51.514115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85636713-f7e4-45a6-93a2-bb1d67e49b99 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:51.514553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85636713-f7e4-45a6-93a2-bb1d67e49b99 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:51.575163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-85636713-f7e4-45a6-93a2-bb1d67e49b99 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:51.582402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-85636713-f7e4-45a6-93a2-bb1d67e49b99 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079972 May 12 07:11:51.583474 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 841/1771] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:51 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:52.030055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0aef4bc1-b5f6-44b5-946e-0cebb6d2dd87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:52.030668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0aef4bc1-b5f6-44b5-946e-0cebb6d2dd87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:52.036764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0aef4bc1-b5f6-44b5-946e-0cebb6d2dd87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:52.037223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0aef4bc1-b5f6-44b5-946e-0cebb6d2dd87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:52.037991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0aef4bc1-b5f6-44b5-946e-0cebb6d2dd87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:52.038430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0aef4bc1-b5f6-44b5-946e-0cebb6d2dd87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:52.101079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-95551d2d-9afd-40a2-9ef3-8b8677fcfa62 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:52.102039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-95551d2d-9afd-40a2-9ef3-8b8677fcfa62 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:52.108533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-95551d2d-9afd-40a2-9ef3-8b8677fcfa62 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:52.108983 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-95551d2d-9afd-40a2-9ef3-8b8677fcfa62 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:52.109755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-95551d2d-9afd-40a2-9ef3-8b8677fcfa62 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:52.110191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-95551d2d-9afd-40a2-9ef3-8b8677fcfa62 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:52.139872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-95551d2d-9afd-40a2-9ef3-8b8677fcfa62 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042720 May 12 07:11:52.140435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 842/1772] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:11:52.167210 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0aef4bc1-b5f6-44b5-946e-0cebb6d2dd87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:52.175571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0aef4bc1-b5f6-44b5-946e-0cebb6d2dd87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:52.177591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0aef4bc1-b5f6-44b5-946e-0cebb6d2dd87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:52.178747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0aef4bc1-b5f6-44b5-946e-0cebb6d2dd87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152743 May 12 07:11:52.179301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 931/1773] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:52 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:52.599713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-32fc7327-dd11-4db6-8cf0-4883bdf98289 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:52.600318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-32fc7327-dd11-4db6-8cf0-4883bdf98289 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:52.606157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32fc7327-dd11-4db6-8cf0-4883bdf98289 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:52.606600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32fc7327-dd11-4db6-8cf0-4883bdf98289 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:52.607358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32fc7327-dd11-4db6-8cf0-4883bdf98289 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:52.607827 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32fc7327-dd11-4db6-8cf0-4883bdf98289 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:52.645362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:11:52.645557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:11:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:11:52.668188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-32fc7327-dd11-4db6-8cf0-4883bdf98289 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:52.675664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-32fc7327-dd11-4db6-8cf0-4883bdf98289 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080316 May 12 07:11:52.676253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 843/1774] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:52 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:53.151997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ff7eb7b5-9737-40de-b2f9-4ff01479ad23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:53.152927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ff7eb7b5-9737-40de-b2f9-4ff01479ad23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:53.159216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff7eb7b5-9737-40de-b2f9-4ff01479ad23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:53.159666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff7eb7b5-9737-40de-b2f9-4ff01479ad23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:53.160468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff7eb7b5-9737-40de-b2f9-4ff01479ad23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:53.160909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff7eb7b5-9737-40de-b2f9-4ff01479ad23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:53.190732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ff7eb7b5-9737-40de-b2f9-4ff01479ad23 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042755 May 12 07:11:53.191279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 932/1775] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:53.197612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fb9c0778-592d-4304-b911-c0bcfd79aa87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:53.198222 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fb9c0778-592d-4304-b911-c0bcfd79aa87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:53.204407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fb9c0778-592d-4304-b911-c0bcfd79aa87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:53.204853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fb9c0778-592d-4304-b911-c0bcfd79aa87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:53.205614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fb9c0778-592d-4304-b911-c0bcfd79aa87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:53.206041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fb9c0778-592d-4304-b911-c0bcfd79aa87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:53.329538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fb9c0778-592d-4304-b911-c0bcfd79aa87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:53.338272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fb9c0778-592d-4304-b911-c0bcfd79aa87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:53.339793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fb9c0778-592d-4304-b911-c0bcfd79aa87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:53.340971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fb9c0778-592d-4304-b911-c0bcfd79aa87 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147238 May 12 07:11:53.341718 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 844/1776] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:53 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:53.693334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-621c53d5-fd95-4d97-9331-8b9533d3e129 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:53.693870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-621c53d5-fd95-4d97-9331-8b9533d3e129 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:53.699748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-621c53d5-fd95-4d97-9331-8b9533d3e129 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:53.700197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-621c53d5-fd95-4d97-9331-8b9533d3e129 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:53.700967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-621c53d5-fd95-4d97-9331-8b9533d3e129 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:53.701401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-621c53d5-fd95-4d97-9331-8b9533d3e129 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:53.760109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-621c53d5-fd95-4d97-9331-8b9533d3e129 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:53.767400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-621c53d5-fd95-4d97-9331-8b9533d3e129 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078610 May 12 07:11:53.768000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 933/1777] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:53 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:54.202924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-04db260e-6c0d-4fe6-a16a-fbaefe93d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:54.203878 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-04db260e-6c0d-4fe6-a16a-fbaefe93d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:54.210186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04db260e-6c0d-4fe6-a16a-fbaefe93d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:54.210640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04db260e-6c0d-4fe6-a16a-fbaefe93d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:54.211408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04db260e-6c0d-4fe6-a16a-fbaefe93d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:54.211879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-04db260e-6c0d-4fe6-a16a-fbaefe93d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:54.240489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-04db260e-6c0d-4fe6-a16a-fbaefe93d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041533 May 12 07:11:54.241031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 845/1778] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:54.359399 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-de08706b-5802-4501-b142-912f39631cc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:54.359963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-de08706b-5802-4501-b142-912f39631cc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:54.366235 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de08706b-5802-4501-b142-912f39631cc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:54.366681 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de08706b-5802-4501-b142-912f39631cc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:54.367446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de08706b-5802-4501-b142-912f39631cc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:54.367914 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de08706b-5802-4501-b142-912f39631cc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:54.495028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de08706b-5802-4501-b142-912f39631cc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:54.503293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de08706b-5802-4501-b142-912f39631cc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:54.504807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de08706b-5802-4501-b142-912f39631cc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:54.505968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-de08706b-5802-4501-b142-912f39631cc8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150542 May 12 07:11:54.506527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 934/1779] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:54 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:54.783809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-725ffb2a-e0e9-4483-8a57-1a0a2f8a5aa5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:54.784434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-725ffb2a-e0e9-4483-8a57-1a0a2f8a5aa5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:54.790386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-725ffb2a-e0e9-4483-8a57-1a0a2f8a5aa5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:54.790842 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-725ffb2a-e0e9-4483-8a57-1a0a2f8a5aa5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:54.791617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-725ffb2a-e0e9-4483-8a57-1a0a2f8a5aa5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:54.792089 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-725ffb2a-e0e9-4483-8a57-1a0a2f8a5aa5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:54.851554 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-725ffb2a-e0e9-4483-8a57-1a0a2f8a5aa5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:54.858968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-725ffb2a-e0e9-4483-8a57-1a0a2f8a5aa5 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079030 May 12 07:11:54.859540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 846/1780] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:54 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:11:55.251337 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b058f384-e7e8-4c83-97e5-3ef2dbd43747 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:55.252326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b058f384-e7e8-4c83-97e5-3ef2dbd43747 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:55.258832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b058f384-e7e8-4c83-97e5-3ef2dbd43747 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:55.259286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b058f384-e7e8-4c83-97e5-3ef2dbd43747 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:55.260120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b058f384-e7e8-4c83-97e5-3ef2dbd43747 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:55.260566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b058f384-e7e8-4c83-97e5-3ef2dbd43747 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:55.288369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b058f384-e7e8-4c83-97e5-3ef2dbd43747 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041025 May 12 07:11:55.288922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 935/1781] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:55 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:55.524878 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-307e1214-9614-4059-b1c8-60dace0e18a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:55.525485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-307e1214-9614-4059-b1c8-60dace0e18a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:55.531857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-307e1214-9614-4059-b1c8-60dace0e18a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:55.532304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-307e1214-9614-4059-b1c8-60dace0e18a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:55.533063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-307e1214-9614-4059-b1c8-60dace0e18a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:55.533496 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-307e1214-9614-4059-b1c8-60dace0e18a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:55.663629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-307e1214-9614-4059-b1c8-60dace0e18a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:55.671788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-307e1214-9614-4059-b1c8-60dace0e18a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:55.673524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-307e1214-9614-4059-b1c8-60dace0e18a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:55.674679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-307e1214-9614-4059-b1c8-60dace0e18a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.154284 May 12 07:11:55.675239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 847/1782] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:55 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:55.875430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9e3b2ce5-13aa-4126-ae5d-2dbc722be782 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:55.876073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9e3b2ce5-13aa-4126-ae5d-2dbc722be782 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:55.882959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e3b2ce5-13aa-4126-ae5d-2dbc722be782 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:55.883411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e3b2ce5-13aa-4126-ae5d-2dbc722be782 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:55.884215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e3b2ce5-13aa-4126-ae5d-2dbc722be782 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:55.884656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9e3b2ce5-13aa-4126-ae5d-2dbc722be782 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:55.947462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9e3b2ce5-13aa-4126-ae5d-2dbc722be782 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:55.954929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9e3b2ce5-13aa-4126-ae5d-2dbc722be782 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083352 May 12 07:11:55.955494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 936/1783] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:55 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:56.303077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-db75f783-5c92-486a-8b94-b0514ed9a9b8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:56.304021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-db75f783-5c92-486a-8b94-b0514ed9a9b8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:56.309876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db75f783-5c92-486a-8b94-b0514ed9a9b8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:56.310322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db75f783-5c92-486a-8b94-b0514ed9a9b8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:56.311074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db75f783-5c92-486a-8b94-b0514ed9a9b8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:56.311506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db75f783-5c92-486a-8b94-b0514ed9a9b8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:56.338737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-db75f783-5c92-486a-8b94-b0514ed9a9b8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042099 May 12 07:11:56.339274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 848/1784] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:56.693792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7389f5c4-b44d-48d8-9e2a-a45f1a398b49 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:56.694330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7389f5c4-b44d-48d8-9e2a-a45f1a398b49 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:56.700352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7389f5c4-b44d-48d8-9e2a-a45f1a398b49 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:56.700807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7389f5c4-b44d-48d8-9e2a-a45f1a398b49 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:56.701591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7389f5c4-b44d-48d8-9e2a-a45f1a398b49 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:56.702035 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7389f5c4-b44d-48d8-9e2a-a45f1a398b49 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:56.826544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7389f5c4-b44d-48d8-9e2a-a45f1a398b49 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:56.835163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7389f5c4-b44d-48d8-9e2a-a45f1a398b49 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:56.836700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7389f5c4-b44d-48d8-9e2a-a45f1a398b49 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:56.837933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7389f5c4-b44d-48d8-9e2a-a45f1a398b49 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148274 May 12 07:11:56.838503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 937/1785] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:56 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:56.972522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0d2a0400-0080-421d-a231-50a12f6cd56c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:56.973088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0d2a0400-0080-421d-a231-50a12f6cd56c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:56.979431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d2a0400-0080-421d-a231-50a12f6cd56c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:56.979909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d2a0400-0080-421d-a231-50a12f6cd56c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:56.980678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d2a0400-0080-421d-a231-50a12f6cd56c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:56.981108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0d2a0400-0080-421d-a231-50a12f6cd56c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:57.040613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0d2a0400-0080-421d-a231-50a12f6cd56c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:57.048025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0d2a0400-0080-421d-a231-50a12f6cd56c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079390 May 12 07:11:57.048843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 849/1786] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:56 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:57.350060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cdcfc62a-90ac-4ba4-9fe2-9125e17349a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:57.351013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cdcfc62a-90ac-4ba4-9fe2-9125e17349a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:57.357297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cdcfc62a-90ac-4ba4-9fe2-9125e17349a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:57.357739 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cdcfc62a-90ac-4ba4-9fe2-9125e17349a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:57.358501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cdcfc62a-90ac-4ba4-9fe2-9125e17349a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:57.358933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cdcfc62a-90ac-4ba4-9fe2-9125e17349a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:57.389063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cdcfc62a-90ac-4ba4-9fe2-9125e17349a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 May 12 07:11:57.389629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 938/1787] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:57.856886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2d1b391a-cfb6-4b00-9366-912ee3d63918 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:57.857488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2d1b391a-cfb6-4b00-9366-912ee3d63918 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:57.863367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d1b391a-cfb6-4b00-9366-912ee3d63918 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:57.864409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d1b391a-cfb6-4b00-9366-912ee3d63918 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:57.865174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d1b391a-cfb6-4b00-9366-912ee3d63918 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:57.865608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d1b391a-cfb6-4b00-9366-912ee3d63918 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:57.999340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2d1b391a-cfb6-4b00-9366-912ee3d63918 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:58.002703 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2d1b391a-cfb6-4b00-9366-912ee3d63918 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:58.004270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2d1b391a-cfb6-4b00-9366-912ee3d63918 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:58.005435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2d1b391a-cfb6-4b00-9366-912ee3d63918 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152428 May 12 07:11:58.005989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 850/1788] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:57 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:58.064599 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5d0075c0-2fd5-4d0c-bfb6-4a03fbe1a3ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:58.065221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5d0075c0-2fd5-4d0c-bfb6-4a03fbe1a3ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:58.071104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d0075c0-2fd5-4d0c-bfb6-4a03fbe1a3ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:58.071563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d0075c0-2fd5-4d0c-bfb6-4a03fbe1a3ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:58.072360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d0075c0-2fd5-4d0c-bfb6-4a03fbe1a3ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:58.072833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d0075c0-2fd5-4d0c-bfb6-4a03fbe1a3ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:58.132602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5d0075c0-2fd5-4d0c-bfb6-4a03fbe1a3ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:58.139879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5d0075c0-2fd5-4d0c-bfb6-4a03fbe1a3ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079272 May 12 07:11:58.140451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 939/1789] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:58 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:11:58.401169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0a385aac-7a67-465a-9484-11fd9fd2da80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:58.402055 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0a385aac-7a67-465a-9484-11fd9fd2da80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:58.408059 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0a385aac-7a67-465a-9484-11fd9fd2da80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:58.408513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0a385aac-7a67-465a-9484-11fd9fd2da80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:58.409289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0a385aac-7a67-465a-9484-11fd9fd2da80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:58.409731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0a385aac-7a67-465a-9484-11fd9fd2da80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:58.438917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0a385aac-7a67-465a-9484-11fd9fd2da80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041753 May 12 07:11:58.439500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 851/1790] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:11:59.023674 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bc4da77c-70fa-42c2-ad65-d47d743eaa3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:59.024313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bc4da77c-70fa-42c2-ad65-d47d743eaa3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:59.030842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc4da77c-70fa-42c2-ad65-d47d743eaa3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:59.031292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc4da77c-70fa-42c2-ad65-d47d743eaa3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:59.032100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc4da77c-70fa-42c2-ad65-d47d743eaa3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:59.032538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc4da77c-70fa-42c2-ad65-d47d743eaa3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:59.157266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-672082c9-fb14-4a23-a65c-982f46728ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:59.157655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-672082c9-fb14-4a23-a65c-982f46728ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:59.159079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bc4da77c-70fa-42c2-ad65-d47d743eaa3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:59.164403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-672082c9-fb14-4a23-a65c-982f46728ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:59.164847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-672082c9-fb14-4a23-a65c-982f46728ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:59.165615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-672082c9-fb14-4a23-a65c-982f46728ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:59.166047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-672082c9-fb14-4a23-a65c-982f46728ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:59.168051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bc4da77c-70fa-42c2-ad65-d47d743eaa3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:59.169571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bc4da77c-70fa-42c2-ad65-d47d743eaa3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:59.170745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bc4da77c-70fa-42c2-ad65-d47d743eaa3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151025 May 12 07:11:59.171312 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 940/1791] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:11:59 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:11:59.226436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-672082c9-fb14-4a23-a65c-982f46728ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:11:59.233618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-672082c9-fb14-4a23-a65c-982f46728ef3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080418 May 12 07:11:59.234172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 852/1792] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:11:59 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:11:59.450529 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-454abf3c-5aa0-4f5e-b45d-822985691354 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:11:59.451388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-454abf3c-5aa0-4f5e-b45d-822985691354 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:11:59.457269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-454abf3c-5aa0-4f5e-b45d-822985691354 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:59.457717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-454abf3c-5aa0-4f5e-b45d-822985691354 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:59.458483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-454abf3c-5aa0-4f5e-b45d-822985691354 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:11:59.458941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-454abf3c-5aa0-4f5e-b45d-822985691354 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:11:59.488617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-454abf3c-5aa0-4f5e-b45d-822985691354 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042188 May 12 07:11:59.489739 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 941/1793] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:11:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:00.190282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ee750b3b-6010-4be8-972e-54e556a2a419 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:00.190855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ee750b3b-6010-4be8-972e-54e556a2a419 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:00.196987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee750b3b-6010-4be8-972e-54e556a2a419 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:00.197439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee750b3b-6010-4be8-972e-54e556a2a419 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:00.198215 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee750b3b-6010-4be8-972e-54e556a2a419 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:00.198656 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee750b3b-6010-4be8-972e-54e556a2a419 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:00.250471 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9780a94b-952e-43e5-9834-492cef2a6591 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:00.251020 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9780a94b-952e-43e5-9834-492cef2a6591 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:00.257493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9780a94b-952e-43e5-9834-492cef2a6591 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:00.257946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9780a94b-952e-43e5-9834-492cef2a6591 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:00.258737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9780a94b-952e-43e5-9834-492cef2a6591 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:00.259244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9780a94b-952e-43e5-9834-492cef2a6591 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:00.332049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9780a94b-952e-43e5-9834-492cef2a6591 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:00.339760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9780a94b-952e-43e5-9834-492cef2a6591 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.093290 May 12 07:12:00.340331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 942/1794] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:00 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:12:00.349102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ee750b3b-6010-4be8-972e-54e556a2a419 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:00.357233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ee750b3b-6010-4be8-972e-54e556a2a419 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:00.358735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ee750b3b-6010-4be8-972e-54e556a2a419 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:00.359944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ee750b3b-6010-4be8-972e-54e556a2a419 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.173732 May 12 07:12:00.360494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 853/1795] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:00 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:00.500897 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a507f6a8-db1b-403e-a46b-ab70b4d65509 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:00.501874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a507f6a8-db1b-403e-a46b-ab70b4d65509 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:00.507813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a507f6a8-db1b-403e-a46b-ab70b4d65509 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:00.508371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a507f6a8-db1b-403e-a46b-ab70b4d65509 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:00.509221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a507f6a8-db1b-403e-a46b-ab70b4d65509 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:00.509730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a507f6a8-db1b-403e-a46b-ab70b4d65509 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:00.540535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a507f6a8-db1b-403e-a46b-ab70b4d65509 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043729 May 12 07:12:00.541112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 943/1796] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:01.357009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c05ceeaf-0993-42ce-9fc2-32a2ef52d62a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:01.357642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c05ceeaf-0993-42ce-9fc2-32a2ef52d62a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:01.364065 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c05ceeaf-0993-42ce-9fc2-32a2ef52d62a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:01.364527 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c05ceeaf-0993-42ce-9fc2-32a2ef52d62a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:01.365293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c05ceeaf-0993-42ce-9fc2-32a2ef52d62a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:01.365761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c05ceeaf-0993-42ce-9fc2-32a2ef52d62a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:01.378055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4b6d77b6-b5b1-464a-893c-d79e067d127c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:01.378668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4b6d77b6-b5b1-464a-893c-d79e067d127c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:01.385486 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b6d77b6-b5b1-464a-893c-d79e067d127c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:01.385934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b6d77b6-b5b1-464a-893c-d79e067d127c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:01.386706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b6d77b6-b5b1-464a-893c-d79e067d127c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:01.387143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b6d77b6-b5b1-464a-893c-d79e067d127c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:01.431479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c05ceeaf-0993-42ce-9fc2-32a2ef52d62a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:01.439086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c05ceeaf-0993-42ce-9fc2-32a2ef52d62a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.085948 May 12 07:12:01.439669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 854/1797] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:01 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:01.521619 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4b6d77b6-b5b1-464a-893c-d79e067d127c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:01.529696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4b6d77b6-b5b1-464a-893c-d79e067d127c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:01.531183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4b6d77b6-b5b1-464a-893c-d79e067d127c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:01.532386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4b6d77b6-b5b1-464a-893c-d79e067d127c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.158188 May 12 07:12:01.532946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 944/1798] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:01 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:12:01.552940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-88738fec-e183-4201-af1d-109d965103f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:01.553897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-88738fec-e183-4201-af1d-109d965103f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:01.559775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88738fec-e183-4201-af1d-109d965103f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:01.560390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88738fec-e183-4201-af1d-109d965103f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:01.561170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88738fec-e183-4201-af1d-109d965103f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:01.561613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-88738fec-e183-4201-af1d-109d965103f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:01.590641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-88738fec-e183-4201-af1d-109d965103f7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042701 May 12 07:12:01.591196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 855/1799] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:02.456046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1d348228-1351-4d38-b468-2a1c4bf932a1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:02.456588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1d348228-1351-4d38-b468-2a1c4bf932a1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:02.463475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d348228-1351-4d38-b468-2a1c4bf932a1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:02.463955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d348228-1351-4d38-b468-2a1c4bf932a1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:02.464733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d348228-1351-4d38-b468-2a1c4bf932a1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:02.465175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d348228-1351-4d38-b468-2a1c4bf932a1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:02.524704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1d348228-1351-4d38-b468-2a1c4bf932a1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:02.531888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1d348228-1351-4d38-b468-2a1c4bf932a1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079782 May 12 07:12:02.532460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 945/1800] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:02 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:02.550938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6e59b4d9-67dd-478b-b455-62696224ef26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:02.551546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6e59b4d9-67dd-478b-b455-62696224ef26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:02.557823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e59b4d9-67dd-478b-b455-62696224ef26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:02.558269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e59b4d9-67dd-478b-b455-62696224ef26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:02.559034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e59b4d9-67dd-478b-b455-62696224ef26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:02.559468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e59b4d9-67dd-478b-b455-62696224ef26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:02.601981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-061f58d3-03e1-4560-87af-bd4dfb0902b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:02.602905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-061f58d3-03e1-4560-87af-bd4dfb0902b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:02.608809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-061f58d3-03e1-4560-87af-bd4dfb0902b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:02.609257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-061f58d3-03e1-4560-87af-bd4dfb0902b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:02.610029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-061f58d3-03e1-4560-87af-bd4dfb0902b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:02.610462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-061f58d3-03e1-4560-87af-bd4dfb0902b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:02.639130 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-061f58d3-03e1-4560-87af-bd4dfb0902b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040977 May 12 07:12:02.639703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 946/1801] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:02.689486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6e59b4d9-67dd-478b-b455-62696224ef26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:02.698197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6e59b4d9-67dd-478b-b455-62696224ef26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:02.699716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6e59b4d9-67dd-478b-b455-62696224ef26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:02.700856 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6e59b4d9-67dd-478b-b455-62696224ef26 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.154030 May 12 07:12:02.701407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 856/1802] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:02 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:03.548117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c7bbe7be-6c85-4ca1-999c-688ba06a4106 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:03.548999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c7bbe7be-6c85-4ca1-999c-688ba06a4106 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:03.555960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7bbe7be-6c85-4ca1-999c-688ba06a4106 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:03.556410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7bbe7be-6c85-4ca1-999c-688ba06a4106 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:03.557179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7bbe7be-6c85-4ca1-999c-688ba06a4106 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:03.557615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7bbe7be-6c85-4ca1-999c-688ba06a4106 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:03.617870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c7bbe7be-6c85-4ca1-999c-688ba06a4106 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:03.625287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c7bbe7be-6c85-4ca1-999c-688ba06a4106 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081006 May 12 07:12:03.635937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 947/1803] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:03 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:03.653884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-77497a38-1b07-4737-8baf-0f65b0c5c913 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:03.654859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-77497a38-1b07-4737-8baf-0f65b0c5c913 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:03.661672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77497a38-1b07-4737-8baf-0f65b0c5c913 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:03.662119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77497a38-1b07-4737-8baf-0f65b0c5c913 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:03.664564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77497a38-1b07-4737-8baf-0f65b0c5c913 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:03.664564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77497a38-1b07-4737-8baf-0f65b0c5c913 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:03.692035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-77497a38-1b07-4737-8baf-0f65b0c5c913 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 May 12 07:12:03.692601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 857/1804] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:03.719952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8080b97b-28fc-4f31-b9e4-6d787090f881 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:03.720561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8080b97b-28fc-4f31-b9e4-6d787090f881 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:03.726968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8080b97b-28fc-4f31-b9e4-6d787090f881 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:03.727414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8080b97b-28fc-4f31-b9e4-6d787090f881 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:03.728207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8080b97b-28fc-4f31-b9e4-6d787090f881 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:03.728649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8080b97b-28fc-4f31-b9e4-6d787090f881 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:03.854066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8080b97b-28fc-4f31-b9e4-6d787090f881 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:03.862433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8080b97b-28fc-4f31-b9e4-6d787090f881 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:03.864006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8080b97b-28fc-4f31-b9e4-6d787090f881 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:03.865173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8080b97b-28fc-4f31-b9e4-6d787090f881 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149145 May 12 07:12:03.865742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 948/1805] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:04.651402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c94b846f-fe64-481a-affc-eee138856fdb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:04.652047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c94b846f-fe64-481a-affc-eee138856fdb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:04.658317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c94b846f-fe64-481a-affc-eee138856fdb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:04.658877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c94b846f-fe64-481a-affc-eee138856fdb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:04.659505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c94b846f-fe64-481a-affc-eee138856fdb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:04.659965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c94b846f-fe64-481a-affc-eee138856fdb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:04.703717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-962e9695-b7be-4966-b6ad-716145e4d172 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:04.704679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-962e9695-b7be-4966-b6ad-716145e4d172 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:04.710927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-962e9695-b7be-4966-b6ad-716145e4d172 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:04.711379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-962e9695-b7be-4966-b6ad-716145e4d172 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:04.712325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-962e9695-b7be-4966-b6ad-716145e4d172 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:04.712761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-962e9695-b7be-4966-b6ad-716145e4d172 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:04.735064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c94b846f-fe64-481a-affc-eee138856fdb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:04.735064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c94b846f-fe64-481a-affc-eee138856fdb tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.087256 May 12 07:12:04.735388 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 858/1806] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:04.743014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-962e9695-b7be-4966-b6ad-716145e4d172 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043462 May 12 07:12:04.743573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 949/1807] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:04.883362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-64e30043-324e-4831-814f-4de59098922e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:04.883991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-64e30043-324e-4831-814f-4de59098922e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:04.889954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64e30043-324e-4831-814f-4de59098922e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:04.890402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64e30043-324e-4831-814f-4de59098922e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:04.891168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64e30043-324e-4831-814f-4de59098922e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:04.891602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64e30043-324e-4831-814f-4de59098922e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:05.017180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-64e30043-324e-4831-814f-4de59098922e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:05.025488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-64e30043-324e-4831-814f-4de59098922e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:05.026967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-64e30043-324e-4831-814f-4de59098922e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:05.028162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-64e30043-324e-4831-814f-4de59098922e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148670 May 12 07:12:05.028726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 859/1808] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:04 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:05.752427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-88337032-e990-48d7-91b1-2e85f6c98801 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:05.753040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-88337032-e990-48d7-91b1-2e85f6c98801 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:05.754172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-14f5190f-e149-41ce-9ae3-5405a4f81bca tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:05.755598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-14f5190f-e149-41ce-9ae3-5405a4f81bca tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:05.760136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88337032-e990-48d7-91b1-2e85f6c98801 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:05.760584 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88337032-e990-48d7-91b1-2e85f6c98801 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:05.761381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88337032-e990-48d7-91b1-2e85f6c98801 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:05.761821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88337032-e990-48d7-91b1-2e85f6c98801 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:05.761946 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14f5190f-e149-41ce-9ae3-5405a4f81bca tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:05.762312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14f5190f-e149-41ce-9ae3-5405a4f81bca tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:05.763084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14f5190f-e149-41ce-9ae3-5405a4f81bca tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:05.763524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14f5190f-e149-41ce-9ae3-5405a4f81bca tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:05.792610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-14f5190f-e149-41ce-9ae3-5405a4f81bca tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042280 May 12 07:12:05.793172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 860/1809] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:05.822361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-88337032-e990-48d7-91b1-2e85f6c98801 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:05.829759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-88337032-e990-48d7-91b1-2e85f6c98801 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081413 May 12 07:12:05.830317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 950/1810] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:05 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:06.046990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-91372d83-6117-4eba-b3af-0b70b148f2e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:06.047759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-91372d83-6117-4eba-b3af-0b70b148f2e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:06.054487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91372d83-6117-4eba-b3af-0b70b148f2e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:06.055056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91372d83-6117-4eba-b3af-0b70b148f2e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:06.055896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91372d83-6117-4eba-b3af-0b70b148f2e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:06.056363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91372d83-6117-4eba-b3af-0b70b148f2e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:06.187100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-91372d83-6117-4eba-b3af-0b70b148f2e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:06.195948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-91372d83-6117-4eba-b3af-0b70b148f2e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:06.197454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-91372d83-6117-4eba-b3af-0b70b148f2e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:06.198614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-91372d83-6117-4eba-b3af-0b70b148f2e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.155579 May 12 07:12:06.199170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 861/1811] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:06 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:06.804536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-becb6ad4-dc42-4ff3-9d3c-6b55d582f184 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:06.805451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-becb6ad4-dc42-4ff3-9d3c-6b55d582f184 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:06.811702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-becb6ad4-dc42-4ff3-9d3c-6b55d582f184 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:06.812153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-becb6ad4-dc42-4ff3-9d3c-6b55d582f184 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:06.812922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-becb6ad4-dc42-4ff3-9d3c-6b55d582f184 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:06.813357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-becb6ad4-dc42-4ff3-9d3c-6b55d582f184 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:06.841557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-becb6ad4-dc42-4ff3-9d3c-6b55d582f184 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041488 May 12 07:12:06.842105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 951/1812] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:06.846197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d7716964-fb98-4f4e-b235-d5738162efe7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:06.846812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d7716964-fb98-4f4e-b235-d5738162efe7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:06.853239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7716964-fb98-4f4e-b235-d5738162efe7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:06.853687 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7716964-fb98-4f4e-b235-d5738162efe7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:06.854452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7716964-fb98-4f4e-b235-d5738162efe7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:06.854894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d7716964-fb98-4f4e-b235-d5738162efe7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:06.917819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d7716964-fb98-4f4e-b235-d5738162efe7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:06.925832 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d7716964-fb98-4f4e-b235-d5738162efe7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083416 May 12 07:12:06.926398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 862/1813] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:06 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:12:07.217266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9eea6280-9d18-4538-ad0b-8395b4b4e4a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:07.217882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9eea6280-9d18-4538-ad0b-8395b4b4e4a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:07.225149 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9eea6280-9d18-4538-ad0b-8395b4b4e4a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:07.225697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9eea6280-9d18-4538-ad0b-8395b4b4e4a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:07.226475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9eea6280-9d18-4538-ad0b-8395b4b4e4a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:07.226917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9eea6280-9d18-4538-ad0b-8395b4b4e4a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:07.351411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9eea6280-9d18-4538-ad0b-8395b4b4e4a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:07.359633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9eea6280-9d18-4538-ad0b-8395b4b4e4a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:07.361153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9eea6280-9d18-4538-ad0b-8395b4b4e4a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:07.362311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9eea6280-9d18-4538-ad0b-8395b4b4e4a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148998 May 12 07:12:07.362868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 952/1814] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:07 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:07.853378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-621d8e12-2d33-4755-8560-d5c554ae5a97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:07.854434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-621d8e12-2d33-4755-8560-d5c554ae5a97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:07.860798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-621d8e12-2d33-4755-8560-d5c554ae5a97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:07.861236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-621d8e12-2d33-4755-8560-d5c554ae5a97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:07.861991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-621d8e12-2d33-4755-8560-d5c554ae5a97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:07.862420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-621d8e12-2d33-4755-8560-d5c554ae5a97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:07.890339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-621d8e12-2d33-4755-8560-d5c554ae5a97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 May 12 07:12:07.890885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 863/1815] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:07 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:07.943165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-60989880-3b1a-4d79-a2fd-d202c43b6698 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:07.943859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-60989880-3b1a-4d79-a2fd-d202c43b6698 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:07.949848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60989880-3b1a-4d79-a2fd-d202c43b6698 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:07.950300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60989880-3b1a-4d79-a2fd-d202c43b6698 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:07.951074 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60989880-3b1a-4d79-a2fd-d202c43b6698 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:07.951597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60989880-3b1a-4d79-a2fd-d202c43b6698 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:08.015495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-60989880-3b1a-4d79-a2fd-d202c43b6698 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:08.023548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-60989880-3b1a-4d79-a2fd-d202c43b6698 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084797 May 12 07:12:08.024147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 953/1816] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:07 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:08.381563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-058a5ae0-b09f-4595-aab9-d2108a4aa8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:08.382173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-058a5ae0-b09f-4595-aab9-d2108a4aa8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:08.388029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-058a5ae0-b09f-4595-aab9-d2108a4aa8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:08.388478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-058a5ae0-b09f-4595-aab9-d2108a4aa8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:08.389248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-058a5ae0-b09f-4595-aab9-d2108a4aa8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:08.389685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-058a5ae0-b09f-4595-aab9-d2108a4aa8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:08.512950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-058a5ae0-b09f-4595-aab9-d2108a4aa8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:08.521076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-058a5ae0-b09f-4595-aab9-d2108a4aa8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:08.522576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-058a5ae0-b09f-4595-aab9-d2108a4aa8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:08.523764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-058a5ae0-b09f-4595-aab9-d2108a4aa8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146715 May 12 07:12:08.524325 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 864/1817] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:08.901231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8bacb9d6-c623-42c5-8f5d-580b21bab513 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:08.902134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8bacb9d6-c623-42c5-8f5d-580b21bab513 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:08.908028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8bacb9d6-c623-42c5-8f5d-580b21bab513 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:08.908482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8bacb9d6-c623-42c5-8f5d-580b21bab513 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:08.909390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8bacb9d6-c623-42c5-8f5d-580b21bab513 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:08.909863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8bacb9d6-c623-42c5-8f5d-580b21bab513 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:08.939267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8bacb9d6-c623-42c5-8f5d-580b21bab513 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042118 May 12 07:12:08.939852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 954/1818] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:09.042794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-34c08a24-e073-432f-9d41-e07a1dead389 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:09.043438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-34c08a24-e073-432f-9d41-e07a1dead389 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:09.049980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34c08a24-e073-432f-9d41-e07a1dead389 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:09.050422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34c08a24-e073-432f-9d41-e07a1dead389 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:09.051184 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34c08a24-e073-432f-9d41-e07a1dead389 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:09.051614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34c08a24-e073-432f-9d41-e07a1dead389 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:09.111578 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-34c08a24-e073-432f-9d41-e07a1dead389 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:09.119015 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-34c08a24-e073-432f-9d41-e07a1dead389 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080048 May 12 07:12:09.119579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 865/1819] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:09 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:09.542239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5624c4f8-e908-450d-95a5-d4a8652a063d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:09.542849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5624c4f8-e908-450d-95a5-d4a8652a063d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:09.549487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5624c4f8-e908-450d-95a5-d4a8652a063d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:09.549934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5624c4f8-e908-450d-95a5-d4a8652a063d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:09.550704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5624c4f8-e908-450d-95a5-d4a8652a063d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:09.551137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5624c4f8-e908-450d-95a5-d4a8652a063d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:09.677847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5624c4f8-e908-450d-95a5-d4a8652a063d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:09.686004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5624c4f8-e908-450d-95a5-d4a8652a063d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:09.687507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5624c4f8-e908-450d-95a5-d4a8652a063d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:09.688708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5624c4f8-e908-450d-95a5-d4a8652a063d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150560 May 12 07:12:09.689274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 955/1820] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:09.950925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ea866771-0659-40f9-b14e-53079e744364 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:09.951889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ea866771-0659-40f9-b14e-53079e744364 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:09.958056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea866771-0659-40f9-b14e-53079e744364 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:09.958511 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea866771-0659-40f9-b14e-53079e744364 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:09.959298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea866771-0659-40f9-b14e-53079e744364 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:09.959765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea866771-0659-40f9-b14e-53079e744364 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:09.990564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ea866771-0659-40f9-b14e-53079e744364 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041509 May 12 07:12:09.990564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 866/1821] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:10.134348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e5b14e94-aa38-4c1e-bc27-bd5c917999c2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:10.134966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e5b14e94-aa38-4c1e-bc27-bd5c917999c2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:10.140838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5b14e94-aa38-4c1e-bc27-bd5c917999c2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:10.141287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5b14e94-aa38-4c1e-bc27-bd5c917999c2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:10.142054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5b14e94-aa38-4c1e-bc27-bd5c917999c2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:10.142519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5b14e94-aa38-4c1e-bc27-bd5c917999c2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:10.204518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e5b14e94-aa38-4c1e-bc27-bd5c917999c2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:10.210519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e5b14e94-aa38-4c1e-bc27-bd5c917999c2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079953 May 12 07:12:10.211103 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 956/1822] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:10 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:10.707437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-07716246-cb8c-44b1-aced-0eb932bb1ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:10.708637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-07716246-cb8c-44b1-aced-0eb932bb1ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:10.714903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07716246-cb8c-44b1-aced-0eb932bb1ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:10.715350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07716246-cb8c-44b1-aced-0eb932bb1ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:10.716139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07716246-cb8c-44b1-aced-0eb932bb1ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:10.716574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07716246-cb8c-44b1-aced-0eb932bb1ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:10.841177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-07716246-cb8c-44b1-aced-0eb932bb1ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:10.849473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-07716246-cb8c-44b1-aced-0eb932bb1ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:10.851004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-07716246-cb8c-44b1-aced-0eb932bb1ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:10.852206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-07716246-cb8c-44b1-aced-0eb932bb1ca7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148644 May 12 07:12:10.852768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 867/1823] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:10 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:11.000346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-44f5b24e-b1ec-44dc-b424-2fbf15c5cf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:11.001270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-44f5b24e-b1ec-44dc-b424-2fbf15c5cf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:11.008174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-44f5b24e-b1ec-44dc-b424-2fbf15c5cf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:11.008623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-44f5b24e-b1ec-44dc-b424-2fbf15c5cf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:11.009391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-44f5b24e-b1ec-44dc-b424-2fbf15c5cf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:11.009824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-44f5b24e-b1ec-44dc-b424-2fbf15c5cf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:11.039511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-44f5b24e-b1ec-44dc-b424-2fbf15c5cf25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 May 12 07:12:11.040095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 957/1824] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:11.227449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-beb820c4-9c23-4f0c-82f5-f7c1b600e2f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:11.228122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-beb820c4-9c23-4f0c-82f5-f7c1b600e2f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:11.233964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-beb820c4-9c23-4f0c-82f5-f7c1b600e2f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:11.234413 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-beb820c4-9c23-4f0c-82f5-f7c1b600e2f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:11.235181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-beb820c4-9c23-4f0c-82f5-f7c1b600e2f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:11.235622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-beb820c4-9c23-4f0c-82f5-f7c1b600e2f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:11.299967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-beb820c4-9c23-4f0c-82f5-f7c1b600e2f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:11.307672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-beb820c4-9c23-4f0c-82f5-f7c1b600e2f7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084282 May 12 07:12:11.308258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 868/1825] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:11 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:11.870961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-feee6b67-00e6-4cfb-ab45-105a1c75690f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:11.871564 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-feee6b67-00e6-4cfb-ab45-105a1c75690f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:11.877460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feee6b67-00e6-4cfb-ab45-105a1c75690f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:11.877905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feee6b67-00e6-4cfb-ab45-105a1c75690f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:11.878665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feee6b67-00e6-4cfb-ab45-105a1c75690f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:11.879099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feee6b67-00e6-4cfb-ab45-105a1c75690f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:12.006369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-feee6b67-00e6-4cfb-ab45-105a1c75690f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:12.015033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-feee6b67-00e6-4cfb-ab45-105a1c75690f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:12.016561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-feee6b67-00e6-4cfb-ab45-105a1c75690f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:12.017731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-feee6b67-00e6-4cfb-ab45-105a1c75690f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150704 May 12 07:12:12.018297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 958/1826] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:12.051164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-497b07b3-ee71-46a0-8d53-0e0ae4c7a551 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:12.052286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-497b07b3-ee71-46a0-8d53-0e0ae4c7a551 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:12.058497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-497b07b3-ee71-46a0-8d53-0e0ae4c7a551 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:12.058941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-497b07b3-ee71-46a0-8d53-0e0ae4c7a551 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:12.059710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-497b07b3-ee71-46a0-8d53-0e0ae4c7a551 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:12.060153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-497b07b3-ee71-46a0-8d53-0e0ae4c7a551 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:12.088249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-497b07b3-ee71-46a0-8d53-0e0ae4c7a551 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 May 12 07:12:12.088790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 869/1827] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:12 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:12.324474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9d392fa1-8e49-4eb5-a7c4-2b04d36585ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:12.325114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9d392fa1-8e49-4eb5-a7c4-2b04d36585ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:12.330969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d392fa1-8e49-4eb5-a7c4-2b04d36585ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:12.331444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d392fa1-8e49-4eb5-a7c4-2b04d36585ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:12.332235 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d392fa1-8e49-4eb5-a7c4-2b04d36585ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:12.332669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d392fa1-8e49-4eb5-a7c4-2b04d36585ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:12.392241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9d392fa1-8e49-4eb5-a7c4-2b04d36585ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:12.400164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9d392fa1-8e49-4eb5-a7c4-2b04d36585ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079523 May 12 07:12:12.400738 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 959/1828] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:12 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:13.037199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-78e4fab8-b392-4619-9faa-be8ee8d99472 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:13.037811 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-78e4fab8-b392-4619-9faa-be8ee8d99472 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:13.043678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78e4fab8-b392-4619-9faa-be8ee8d99472 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:13.044151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78e4fab8-b392-4619-9faa-be8ee8d99472 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:13.044912 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78e4fab8-b392-4619-9faa-be8ee8d99472 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:13.045343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78e4fab8-b392-4619-9faa-be8ee8d99472 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:13.100301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-92b24d86-901a-47fa-8bd1-991947bb9644 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:13.101228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-92b24d86-901a-47fa-8bd1-991947bb9644 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:13.107540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92b24d86-901a-47fa-8bd1-991947bb9644 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:13.108016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92b24d86-901a-47fa-8bd1-991947bb9644 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:13.108795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92b24d86-901a-47fa-8bd1-991947bb9644 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:13.109234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92b24d86-901a-47fa-8bd1-991947bb9644 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:13.138418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-92b24d86-901a-47fa-8bd1-991947bb9644 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042625 May 12 07:12:13.138999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 960/1829] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:13.173814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-78e4fab8-b392-4619-9faa-be8ee8d99472 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:13.182581 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-78e4fab8-b392-4619-9faa-be8ee8d99472 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:13.184100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-78e4fab8-b392-4619-9faa-be8ee8d99472 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:13.185254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-78e4fab8-b392-4619-9faa-be8ee8d99472 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152475 May 12 07:12:13.185799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 870/1830] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:13.416431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-281ee0f7-6e54-4c16-bce3-a0126dca0e7b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:13.416974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-281ee0f7-6e54-4c16-bce3-a0126dca0e7b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:13.422989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-281ee0f7-6e54-4c16-bce3-a0126dca0e7b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:13.423721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-281ee0f7-6e54-4c16-bce3-a0126dca0e7b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:13.424497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-281ee0f7-6e54-4c16-bce3-a0126dca0e7b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:13.424940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-281ee0f7-6e54-4c16-bce3-a0126dca0e7b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:13.484158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-281ee0f7-6e54-4c16-bce3-a0126dca0e7b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:13.491419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-281ee0f7-6e54-4c16-bce3-a0126dca0e7b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078932 May 12 07:12:13.492017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 961/1831] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:13 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:14.150396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a0a89875-bf92-4062-8632-761b90efa0df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:14.151322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a0a89875-bf92-4062-8632-761b90efa0df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:14.157719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0a89875-bf92-4062-8632-761b90efa0df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:14.158176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0a89875-bf92-4062-8632-761b90efa0df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:14.158950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0a89875-bf92-4062-8632-761b90efa0df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:14.159416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0a89875-bf92-4062-8632-761b90efa0df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:14.187960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a0a89875-bf92-4062-8632-761b90efa0df tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042157 May 12 07:12:14.188559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 871/1832] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:14.203899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-070953a9-c716-4cc4-a806-3058e05c61d8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:14.204506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-070953a9-c716-4cc4-a806-3058e05c61d8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:14.210776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-070953a9-c716-4cc4-a806-3058e05c61d8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:14.211221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-070953a9-c716-4cc4-a806-3058e05c61d8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:14.212053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-070953a9-c716-4cc4-a806-3058e05c61d8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:14.212488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-070953a9-c716-4cc4-a806-3058e05c61d8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:14.337710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-070953a9-c716-4cc4-a806-3058e05c61d8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:14.345870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-070953a9-c716-4cc4-a806-3058e05c61d8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:14.347374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-070953a9-c716-4cc4-a806-3058e05c61d8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:14.348565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-070953a9-c716-4cc4-a806-3058e05c61d8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148567 May 12 07:12:14.349133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 962/1833] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:14 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:14.507797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-42291d76-6359-4822-9c3c-d803dd6b0c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:14.508408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-42291d76-6359-4822-9c3c-d803dd6b0c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:14.514383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42291d76-6359-4822-9c3c-d803dd6b0c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:14.514834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42291d76-6359-4822-9c3c-d803dd6b0c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:14.515636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42291d76-6359-4822-9c3c-d803dd6b0c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:14.516097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42291d76-6359-4822-9c3c-d803dd6b0c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:14.579594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-42291d76-6359-4822-9c3c-d803dd6b0c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:14.587018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-42291d76-6359-4822-9c3c-d803dd6b0c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083811 May 12 07:12:14.587577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 872/1834] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:14 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:15.198443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1ebfdd84-3f5a-4687-bf7b-93014bfd3d0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:15.199397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1ebfdd84-3f5a-4687-bf7b-93014bfd3d0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:15.205307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ebfdd84-3f5a-4687-bf7b-93014bfd3d0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:15.205860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ebfdd84-3f5a-4687-bf7b-93014bfd3d0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:15.206514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ebfdd84-3f5a-4687-bf7b-93014bfd3d0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:15.206953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1ebfdd84-3f5a-4687-bf7b-93014bfd3d0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:15.235901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1ebfdd84-3f5a-4687-bf7b-93014bfd3d0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041404 May 12 07:12:15.236448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 963/1835] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:15.367071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8a6761c5-d621-424a-a0ec-0e0e862e28f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:15.367616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8a6761c5-d621-424a-a0ec-0e0e862e28f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:15.373951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8a6761c5-d621-424a-a0ec-0e0e862e28f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:15.374405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8a6761c5-d621-424a-a0ec-0e0e862e28f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:15.375173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8a6761c5-d621-424a-a0ec-0e0e862e28f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:15.375619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8a6761c5-d621-424a-a0ec-0e0e862e28f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:15.500104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8a6761c5-d621-424a-a0ec-0e0e862e28f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:15.508896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8a6761c5-d621-424a-a0ec-0e0e862e28f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:15.510400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8a6761c5-d621-424a-a0ec-0e0e862e28f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:15.511566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8a6761c5-d621-424a-a0ec-0e0e862e28f4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148659 May 12 07:12:15.512155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 873/1836] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:15.603373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-51c1d363-c58d-429c-b5a9-dd7f131758bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:15.604029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-51c1d363-c58d-429c-b5a9-dd7f131758bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:15.609810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51c1d363-c58d-429c-b5a9-dd7f131758bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:15.610256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51c1d363-c58d-429c-b5a9-dd7f131758bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:15.611018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51c1d363-c58d-429c-b5a9-dd7f131758bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:15.611451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51c1d363-c58d-429c-b5a9-dd7f131758bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:15.670594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-51c1d363-c58d-429c-b5a9-dd7f131758bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:15.678549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-51c1d363-c58d-429c-b5a9-dd7f131758bf tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078990 May 12 07:12:15.679109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 964/1837] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:15 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:16.247976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e14a7299-7068-4a33-9b7b-028e99e983a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:16.248829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e14a7299-7068-4a33-9b7b-028e99e983a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:16.254838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e14a7299-7068-4a33-9b7b-028e99e983a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:16.255283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e14a7299-7068-4a33-9b7b-028e99e983a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:16.256145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e14a7299-7068-4a33-9b7b-028e99e983a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:16.256581 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e14a7299-7068-4a33-9b7b-028e99e983a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:16.284529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e14a7299-7068-4a33-9b7b-028e99e983a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040666 May 12 07:12:16.285082 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 874/1838] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:16.530338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-91668c57-f601-4338-a3ce-0bc4f25197da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:16.530873 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-91668c57-f601-4338-a3ce-0bc4f25197da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:16.537246 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91668c57-f601-4338-a3ce-0bc4f25197da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:16.538356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91668c57-f601-4338-a3ce-0bc4f25197da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:16.539121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91668c57-f601-4338-a3ce-0bc4f25197da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:16.539552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-91668c57-f601-4338-a3ce-0bc4f25197da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:16.666629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-91668c57-f601-4338-a3ce-0bc4f25197da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:16.675034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-91668c57-f601-4338-a3ce-0bc4f25197da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:16.676654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-91668c57-f601-4338-a3ce-0bc4f25197da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:16.677817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-91668c57-f601-4338-a3ce-0bc4f25197da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151447 May 12 07:12:16.678385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 965/1839] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:16.694116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3a0125e6-db5a-4041-94e1-082fb90fb6d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:16.694834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3a0125e6-db5a-4041-94e1-082fb90fb6d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:16.701030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a0125e6-db5a-4041-94e1-082fb90fb6d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:16.701474 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a0125e6-db5a-4041-94e1-082fb90fb6d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:16.702232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a0125e6-db5a-4041-94e1-082fb90fb6d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:16.702662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a0125e6-db5a-4041-94e1-082fb90fb6d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:16.762959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3a0125e6-db5a-4041-94e1-082fb90fb6d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:16.770181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3a0125e6-db5a-4041-94e1-082fb90fb6d2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079839 May 12 07:12:16.770731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 875/1840] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:16 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:17.296644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0524dd68-56f9-49cd-bb1f-117561fb215a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:17.297494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0524dd68-56f9-49cd-bb1f-117561fb215a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:17.304172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0524dd68-56f9-49cd-bb1f-117561fb215a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:17.304622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0524dd68-56f9-49cd-bb1f-117561fb215a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:17.305389 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0524dd68-56f9-49cd-bb1f-117561fb215a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:17.305829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0524dd68-56f9-49cd-bb1f-117561fb215a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:17.333801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0524dd68-56f9-49cd-bb1f-117561fb215a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041184 May 12 07:12:17.334353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 966/1841] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:17 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:17.695999 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-278b362a-e2e9-4c4a-856d-daf249b4f206 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:17.696521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-278b362a-e2e9-4c4a-856d-daf249b4f206 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:17.702904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-278b362a-e2e9-4c4a-856d-daf249b4f206 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:17.703348 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-278b362a-e2e9-4c4a-856d-daf249b4f206 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:17.704136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-278b362a-e2e9-4c4a-856d-daf249b4f206 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:17.704571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-278b362a-e2e9-4c4a-856d-daf249b4f206 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:17.786711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e043c0b9-ddaf-444a-9a2d-4d68fad96562 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:17.787850 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e043c0b9-ddaf-444a-9a2d-4d68fad96562 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:17.794117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e043c0b9-ddaf-444a-9a2d-4d68fad96562 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:17.794566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e043c0b9-ddaf-444a-9a2d-4d68fad96562 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:17.795371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e043c0b9-ddaf-444a-9a2d-4d68fad96562 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:17.795834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e043c0b9-ddaf-444a-9a2d-4d68fad96562 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:17.831142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-278b362a-e2e9-4c4a-856d-daf249b4f206 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:17.839266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-278b362a-e2e9-4c4a-856d-daf249b4f206 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:17.840800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-278b362a-e2e9-4c4a-856d-daf249b4f206 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:17.841955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-278b362a-e2e9-4c4a-856d-daf249b4f206 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149933 May 12 07:12:17.842517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 876/1842] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:17 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:17.861834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e043c0b9-ddaf-444a-9a2d-4d68fad96562 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:17.869825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e043c0b9-ddaf-444a-9a2d-4d68fad96562 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.086944 May 12 07:12:17.870384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 967/1843] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:17 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:18.345428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-191c1308-3948-4d3d-b5b9-e9447c4b8724 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:18.346286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-191c1308-3948-4d3d-b5b9-e9447c4b8724 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:18.352214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-191c1308-3948-4d3d-b5b9-e9447c4b8724 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:18.352660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-191c1308-3948-4d3d-b5b9-e9447c4b8724 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:18.353420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-191c1308-3948-4d3d-b5b9-e9447c4b8724 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:18.353853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-191c1308-3948-4d3d-b5b9-e9447c4b8724 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:18.382146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-191c1308-3948-4d3d-b5b9-e9447c4b8724 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040799 May 12 07:12:18.382682 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 877/1844] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:18.860800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-925e9fc9-b6d4-42ef-b78b-0e9fa386b8da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:18.861445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-925e9fc9-b6d4-42ef-b78b-0e9fa386b8da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:18.868248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-925e9fc9-b6d4-42ef-b78b-0e9fa386b8da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:18.868692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-925e9fc9-b6d4-42ef-b78b-0e9fa386b8da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:18.869460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-925e9fc9-b6d4-42ef-b78b-0e9fa386b8da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:18.869923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-925e9fc9-b6d4-42ef-b78b-0e9fa386b8da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:18.886775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-83e27b1d-ca8c-4c3c-8e44-c2e1cb5c69b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:18.887644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-83e27b1d-ca8c-4c3c-8e44-c2e1cb5c69b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:18.893948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83e27b1d-ca8c-4c3c-8e44-c2e1cb5c69b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:18.894397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83e27b1d-ca8c-4c3c-8e44-c2e1cb5c69b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:18.895175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83e27b1d-ca8c-4c3c-8e44-c2e1cb5c69b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:18.895612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83e27b1d-ca8c-4c3c-8e44-c2e1cb5c69b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:18.964052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-83e27b1d-ca8c-4c3c-8e44-c2e1cb5c69b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:18.971572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-83e27b1d-ca8c-4c3c-8e44-c2e1cb5c69b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.088604 May 12 07:12:18.972315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 878/1845] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:18 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:19.021840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-925e9fc9-b6d4-42ef-b78b-0e9fa386b8da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:19.030117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-925e9fc9-b6d4-42ef-b78b-0e9fa386b8da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:19.031644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-925e9fc9-b6d4-42ef-b78b-0e9fa386b8da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:19.032837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-925e9fc9-b6d4-42ef-b78b-0e9fa386b8da tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.175914 May 12 07:12:19.033403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 968/1846] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:19.393621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b3dda1fd-233b-40c7-9871-bff4abeb9104 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:19.394541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b3dda1fd-233b-40c7-9871-bff4abeb9104 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:19.401012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3dda1fd-233b-40c7-9871-bff4abeb9104 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:19.401458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3dda1fd-233b-40c7-9871-bff4abeb9104 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:19.402221 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3dda1fd-233b-40c7-9871-bff4abeb9104 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:19.402651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3dda1fd-233b-40c7-9871-bff4abeb9104 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:19.431009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b3dda1fd-233b-40c7-9871-bff4abeb9104 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041343 May 12 07:12:19.431549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 879/1847] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:19.988420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-97dc9bc3-2a8b-4589-bbd4-21b6a75a5f88 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:19.989036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-97dc9bc3-2a8b-4589-bbd4-21b6a75a5f88 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:19.995531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97dc9bc3-2a8b-4589-bbd4-21b6a75a5f88 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:19.996016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97dc9bc3-2a8b-4589-bbd4-21b6a75a5f88 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:19.996792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97dc9bc3-2a8b-4589-bbd4-21b6a75a5f88 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:19.997230 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97dc9bc3-2a8b-4589-bbd4-21b6a75a5f88 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:20.052003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a22f9ce2-6792-4688-ae61-e3c224b4c91e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:20.052615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a22f9ce2-6792-4688-ae61-e3c224b4c91e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:20.058849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a22f9ce2-6792-4688-ae61-e3c224b4c91e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:20.059292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a22f9ce2-6792-4688-ae61-e3c224b4c91e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:20.060091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a22f9ce2-6792-4688-ae61-e3c224b4c91e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:20.060524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a22f9ce2-6792-4688-ae61-e3c224b4c91e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:20.061212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97dc9bc3-2a8b-4589-bbd4-21b6a75a5f88 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:20.069158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-97dc9bc3-2a8b-4589-bbd4-21b6a75a5f88 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084165 May 12 07:12:20.069819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 969/1848] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:19 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:20.184788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a22f9ce2-6792-4688-ae61-e3c224b4c91e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:20.192932 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a22f9ce2-6792-4688-ae61-e3c224b4c91e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:20.195131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a22f9ce2-6792-4688-ae61-e3c224b4c91e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:20.196229 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a22f9ce2-6792-4688-ae61-e3c224b4c91e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148443 May 12 07:12:20.196794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 880/1849] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:12:20.441791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9ea1a0f7-7541-4f8b-9a8f-f7355048c006 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:20.442719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9ea1a0f7-7541-4f8b-9a8f-f7355048c006 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:20.449421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ea1a0f7-7541-4f8b-9a8f-f7355048c006 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:20.449896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ea1a0f7-7541-4f8b-9a8f-f7355048c006 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:20.450671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ea1a0f7-7541-4f8b-9a8f-f7355048c006 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:20.451111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ea1a0f7-7541-4f8b-9a8f-f7355048c006 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:20.478934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9ea1a0f7-7541-4f8b-9a8f-f7355048c006 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041111 May 12 07:12:20.479479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 970/1850] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:20 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:21.086746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2173ba8a-fb58-4854-932e-7901fa4c85af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:21.087358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2173ba8a-fb58-4854-932e-7901fa4c85af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:21.093712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2173ba8a-fb58-4854-932e-7901fa4c85af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:21.094155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2173ba8a-fb58-4854-932e-7901fa4c85af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:21.094915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2173ba8a-fb58-4854-932e-7901fa4c85af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:21.095344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2173ba8a-fb58-4854-932e-7901fa4c85af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:21.154341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2173ba8a-fb58-4854-932e-7901fa4c85af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:21.161471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2173ba8a-fb58-4854-932e-7901fa4c85af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079061 May 12 07:12:21.162029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 881/1851] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:21 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:21.215179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f8bd5ad9-8995-45b4-9ffe-a818eb5fc2b2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:21.215840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f8bd5ad9-8995-45b4-9ffe-a818eb5fc2b2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:21.222158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8bd5ad9-8995-45b4-9ffe-a818eb5fc2b2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:21.222609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8bd5ad9-8995-45b4-9ffe-a818eb5fc2b2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:21.223386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8bd5ad9-8995-45b4-9ffe-a818eb5fc2b2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:21.223883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8bd5ad9-8995-45b4-9ffe-a818eb5fc2b2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:21.490587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bcaf26a4-ecdb-4d9e-896c-70e1be1fc82c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:21.491604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bcaf26a4-ecdb-4d9e-896c-70e1be1fc82c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:21.497485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bcaf26a4-ecdb-4d9e-896c-70e1be1fc82c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:21.497938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bcaf26a4-ecdb-4d9e-896c-70e1be1fc82c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:21.498809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bcaf26a4-ecdb-4d9e-896c-70e1be1fc82c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:21.499133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bcaf26a4-ecdb-4d9e-896c-70e1be1fc82c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:21.501261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f8bd5ad9-8995-45b4-9ffe-a818eb5fc2b2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:21.510070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f8bd5ad9-8995-45b4-9ffe-a818eb5fc2b2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:21.511652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f8bd5ad9-8995-45b4-9ffe-a818eb5fc2b2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:21.512782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f8bd5ad9-8995-45b4-9ffe-a818eb5fc2b2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.301601 May 12 07:12:21.513341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 971/1852] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:21.530117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bcaf26a4-ecdb-4d9e-896c-70e1be1fc82c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043446 May 12 07:12:21.530685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 882/1853] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:21 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:22.177879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e678b7db-fa35-45f7-bc61-8d5cf15f2e4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:22.179073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e678b7db-fa35-45f7-bc61-8d5cf15f2e4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:22.185083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e678b7db-fa35-45f7-bc61-8d5cf15f2e4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:22.185532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e678b7db-fa35-45f7-bc61-8d5cf15f2e4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:22.186296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e678b7db-fa35-45f7-bc61-8d5cf15f2e4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:22.186728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e678b7db-fa35-45f7-bc61-8d5cf15f2e4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:22.245708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e678b7db-fa35-45f7-bc61-8d5cf15f2e4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:22.252948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e678b7db-fa35-45f7-bc61-8d5cf15f2e4c tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078940 May 12 07:12:22.253545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 972/1854] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:22 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:22.531807 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9c0b4d19-59d3-4ef8-9593-9c6f02ccb647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:22.532350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9c0b4d19-59d3-4ef8-9593-9c6f02ccb647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:22.539388 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c0b4d19-59d3-4ef8-9593-9c6f02ccb647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:22.539866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c0b4d19-59d3-4ef8-9593-9c6f02ccb647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:22.540634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c0b4d19-59d3-4ef8-9593-9c6f02ccb647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:22.541070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c0b4d19-59d3-4ef8-9593-9c6f02ccb647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:22.542072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-044971f4-edf7-4f54-b1af-d541f9f4ea64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:22.542987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-044971f4-edf7-4f54-b1af-d541f9f4ea64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:22.549356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-044971f4-edf7-4f54-b1af-d541f9f4ea64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:22.549806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-044971f4-edf7-4f54-b1af-d541f9f4ea64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:22.550574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-044971f4-edf7-4f54-b1af-d541f9f4ea64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:22.551007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-044971f4-edf7-4f54-b1af-d541f9f4ea64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:22.579557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-044971f4-edf7-4f54-b1af-d541f9f4ea64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041971 May 12 07:12:22.580362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 973/1855] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:22.664993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c0b4d19-59d3-4ef8-9593-9c6f02ccb647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:22.673130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c0b4d19-59d3-4ef8-9593-9c6f02ccb647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:22.674852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c0b4d19-59d3-4ef8-9593-9c6f02ccb647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:22.676028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9c0b4d19-59d3-4ef8-9593-9c6f02ccb647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148192 May 12 07:12:22.676586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 883/1856] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:22 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:23.269425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-23b7d454-aad7-4938-8f02-de896f63f3b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:23.269962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-23b7d454-aad7-4938-8f02-de896f63f3b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:23.275923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23b7d454-aad7-4938-8f02-de896f63f3b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:23.276430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23b7d454-aad7-4938-8f02-de896f63f3b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:23.277195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23b7d454-aad7-4938-8f02-de896f63f3b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:23.277629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-23b7d454-aad7-4938-8f02-de896f63f3b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:23.342510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-23b7d454-aad7-4938-8f02-de896f63f3b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:23.349843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-23b7d454-aad7-4938-8f02-de896f63f3b0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084399 May 12 07:12:23.350417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 974/1857] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:23 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:23.590619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a65206c7-c885-4041-aabb-38dd97a426ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:23.591457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a65206c7-c885-4041-aabb-38dd97a426ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:23.597761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a65206c7-c885-4041-aabb-38dd97a426ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:23.598202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a65206c7-c885-4041-aabb-38dd97a426ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:23.598956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a65206c7-c885-4041-aabb-38dd97a426ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:23.599389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a65206c7-c885-4041-aabb-38dd97a426ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:23.629588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a65206c7-c885-4041-aabb-38dd97a426ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043040 May 12 07:12:23.630120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 884/1858] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:23.693871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c85824ad-0a7b-44ff-9e2a-7b9396f2b89a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:23.694482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c85824ad-0a7b-44ff-9e2a-7b9396f2b89a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:23.700697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c85824ad-0a7b-44ff-9e2a-7b9396f2b89a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:23.701158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c85824ad-0a7b-44ff-9e2a-7b9396f2b89a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:23.701934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c85824ad-0a7b-44ff-9e2a-7b9396f2b89a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:23.702371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c85824ad-0a7b-44ff-9e2a-7b9396f2b89a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:23.827257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c85824ad-0a7b-44ff-9e2a-7b9396f2b89a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:23.835514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c85824ad-0a7b-44ff-9e2a-7b9396f2b89a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:23.837037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c85824ad-0a7b-44ff-9e2a-7b9396f2b89a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:23.838196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c85824ad-0a7b-44ff-9e2a-7b9396f2b89a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148230 May 12 07:12:23.838755 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 975/1859] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:23 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:24.366382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2898f934-370f-43cd-8813-e51a6aaa1d32 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:24.366927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2898f934-370f-43cd-8813-e51a6aaa1d32 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:24.372829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2898f934-370f-43cd-8813-e51a6aaa1d32 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:24.373285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2898f934-370f-43cd-8813-e51a6aaa1d32 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:24.374050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2898f934-370f-43cd-8813-e51a6aaa1d32 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:24.374488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2898f934-370f-43cd-8813-e51a6aaa1d32 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:24.481841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2898f934-370f-43cd-8813-e51a6aaa1d32 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:24.489161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2898f934-370f-43cd-8813-e51a6aaa1d32 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.126729 May 12 07:12:24.489726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 885/1860] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:24 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:24.640388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-34574846-a259-4cb6-93bd-f8919b2046f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:24.641232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-34574846-a259-4cb6-93bd-f8919b2046f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:24.646999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34574846-a259-4cb6-93bd-f8919b2046f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:24.647455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34574846-a259-4cb6-93bd-f8919b2046f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:24.648265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34574846-a259-4cb6-93bd-f8919b2046f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:24.648704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34574846-a259-4cb6-93bd-f8919b2046f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:24.676747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-34574846-a259-4cb6-93bd-f8919b2046f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040436 May 12 07:12:24.677304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 976/1861] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:24.856395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b8e1ff2e-6240-40f9-8c05-8c909424c604 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:24.857009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b8e1ff2e-6240-40f9-8c05-8c909424c604 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:24.863227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e1ff2e-6240-40f9-8c05-8c909424c604 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:24.863675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e1ff2e-6240-40f9-8c05-8c909424c604 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:24.864459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e1ff2e-6240-40f9-8c05-8c909424c604 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:24.864891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e1ff2e-6240-40f9-8c05-8c909424c604 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:24.992226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8e1ff2e-6240-40f9-8c05-8c909424c604 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:25.000477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8e1ff2e-6240-40f9-8c05-8c909424c604 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:25.001970 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8e1ff2e-6240-40f9-8c05-8c909424c604 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:25.003155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b8e1ff2e-6240-40f9-8c05-8c909424c604 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150621 May 12 07:12:25.003738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 886/1862] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:24 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:25.520404 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-70031095-348d-47b4-a102-37d04ca57c60 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:25.521016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-70031095-348d-47b4-a102-37d04ca57c60 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:25.527662 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70031095-348d-47b4-a102-37d04ca57c60 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:25.528146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70031095-348d-47b4-a102-37d04ca57c60 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:25.528918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70031095-348d-47b4-a102-37d04ca57c60 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:25.529356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70031095-348d-47b4-a102-37d04ca57c60 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:25.589917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-70031095-348d-47b4-a102-37d04ca57c60 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:25.603670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-70031095-348d-47b4-a102-37d04ca57c60 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080695 May 12 07:12:25.603670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 977/1863] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:25 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:25.688654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-98c7b00d-9fcb-4d6b-8cb8-e1fb397c76af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:25.689582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-98c7b00d-9fcb-4d6b-8cb8-e1fb397c76af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:25.695315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98c7b00d-9fcb-4d6b-8cb8-e1fb397c76af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:25.695798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98c7b00d-9fcb-4d6b-8cb8-e1fb397c76af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:25.696569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98c7b00d-9fcb-4d6b-8cb8-e1fb397c76af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:25.697010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-98c7b00d-9fcb-4d6b-8cb8-e1fb397c76af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:25.725639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-98c7b00d-9fcb-4d6b-8cb8-e1fb397c76af tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040257 May 12 07:12:25.726169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 887/1864] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:26.022832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ace64bf3-562a-4087-a0d9-c34c74e77484 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:26.023465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ace64bf3-562a-4087-a0d9-c34c74e77484 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:26.029365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ace64bf3-562a-4087-a0d9-c34c74e77484 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:26.029791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ace64bf3-562a-4087-a0d9-c34c74e77484 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:26.030704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ace64bf3-562a-4087-a0d9-c34c74e77484 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:26.031140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ace64bf3-562a-4087-a0d9-c34c74e77484 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:26.159086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ace64bf3-562a-4087-a0d9-c34c74e77484 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:26.167183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ace64bf3-562a-4087-a0d9-c34c74e77484 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:26.168702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ace64bf3-562a-4087-a0d9-c34c74e77484 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:26.169859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ace64bf3-562a-4087-a0d9-c34c74e77484 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151686 May 12 07:12:26.170419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 978/1865] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:26 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:26.614016 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-431ee70b-4326-4a07-a1c5-f99288bef774 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:26.614635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-431ee70b-4326-4a07-a1c5-f99288bef774 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:26.621644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-431ee70b-4326-4a07-a1c5-f99288bef774 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:26.622100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-431ee70b-4326-4a07-a1c5-f99288bef774 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:26.622876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-431ee70b-4326-4a07-a1c5-f99288bef774 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:26.623319 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-431ee70b-4326-4a07-a1c5-f99288bef774 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:26.686007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-431ee70b-4326-4a07-a1c5-f99288bef774 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:26.693388 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-431ee70b-4326-4a07-a1c5-f99288bef774 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083237 May 12 07:12:26.693955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 888/1866] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:26 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:26.737050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-88cc6b50-85ce-42df-97f8-fbb55804f101 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:26.738011 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-88cc6b50-85ce-42df-97f8-fbb55804f101 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:26.746297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88cc6b50-85ce-42df-97f8-fbb55804f101 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:26.746741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88cc6b50-85ce-42df-97f8-fbb55804f101 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:26.747511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88cc6b50-85ce-42df-97f8-fbb55804f101 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:26.747969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88cc6b50-85ce-42df-97f8-fbb55804f101 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:26.775737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-88cc6b50-85ce-42df-97f8-fbb55804f101 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042585 May 12 07:12:26.776288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 979/1867] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:27.188212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f0ef2d81-43b2-4764-9911-ea541e347fe9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:27.188833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f0ef2d81-43b2-4764-9911-ea541e347fe9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:27.194910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0ef2d81-43b2-4764-9911-ea541e347fe9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:27.195363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0ef2d81-43b2-4764-9911-ea541e347fe9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:27.196165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0ef2d81-43b2-4764-9911-ea541e347fe9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:27.196608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0ef2d81-43b2-4764-9911-ea541e347fe9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:27.320198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f0ef2d81-43b2-4764-9911-ea541e347fe9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:27.328376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f0ef2d81-43b2-4764-9911-ea541e347fe9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:27.329896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f0ef2d81-43b2-4764-9911-ea541e347fe9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:27.331063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f0ef2d81-43b2-4764-9911-ea541e347fe9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146757 May 12 07:12:27.331624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 889/1868] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:27 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:27.710043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2c668de9-ea8b-4dd3-aa47-787bdfdc5c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:27.710597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2c668de9-ea8b-4dd3-aa47-787bdfdc5c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:27.716545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c668de9-ea8b-4dd3-aa47-787bdfdc5c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:27.716995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c668de9-ea8b-4dd3-aa47-787bdfdc5c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:27.717762 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c668de9-ea8b-4dd3-aa47-787bdfdc5c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:27.718203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c668de9-ea8b-4dd3-aa47-787bdfdc5c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:27.778632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2c668de9-ea8b-4dd3-aa47-787bdfdc5c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:27.785962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2c668de9-ea8b-4dd3-aa47-787bdfdc5c3a tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079915 May 12 07:12:27.786302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e69b9ed2-4392-432c-b731-e06a031c7f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:27.786789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 980/1869] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:27 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:27.787239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e69b9ed2-4392-432c-b731-e06a031c7f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:27.793555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e69b9ed2-4392-432c-b731-e06a031c7f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:27.794013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e69b9ed2-4392-432c-b731-e06a031c7f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:27.794789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e69b9ed2-4392-432c-b731-e06a031c7f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:27.795230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e69b9ed2-4392-432c-b731-e06a031c7f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:27.824724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e69b9ed2-4392-432c-b731-e06a031c7f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 May 12 07:12:27.825283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 890/1870] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:28.349261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-41d2527c-bc8d-4d0d-9a17-31fbb4fe624e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:28.349896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-41d2527c-bc8d-4d0d-9a17-31fbb4fe624e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:28.356424 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41d2527c-bc8d-4d0d-9a17-31fbb4fe624e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:28.356869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41d2527c-bc8d-4d0d-9a17-31fbb4fe624e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:28.357630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41d2527c-bc8d-4d0d-9a17-31fbb4fe624e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:28.358061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41d2527c-bc8d-4d0d-9a17-31fbb4fe624e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:28.485055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-41d2527c-bc8d-4d0d-9a17-31fbb4fe624e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:28.493142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-41d2527c-bc8d-4d0d-9a17-31fbb4fe624e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:28.494687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-41d2527c-bc8d-4d0d-9a17-31fbb4fe624e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:28.495909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-41d2527c-bc8d-4d0d-9a17-31fbb4fe624e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150575 May 12 07:12:28.496467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 981/1871] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:28 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:28.802476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-eee0d44a-f54e-487d-8040-06afe28834ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:28.803087 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-eee0d44a-f54e-487d-8040-06afe28834ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:28.809367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eee0d44a-f54e-487d-8040-06afe28834ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:28.809814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eee0d44a-f54e-487d-8040-06afe28834ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:28.810570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eee0d44a-f54e-487d-8040-06afe28834ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:28.811005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eee0d44a-f54e-487d-8040-06afe28834ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:28.837215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d05b94c8-6795-49e6-a337-11cc91e3effe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:28.838139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d05b94c8-6795-49e6-a337-11cc91e3effe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:28.844534 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d05b94c8-6795-49e6-a337-11cc91e3effe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:28.844983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d05b94c8-6795-49e6-a337-11cc91e3effe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:28.845777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d05b94c8-6795-49e6-a337-11cc91e3effe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:28.846191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d05b94c8-6795-49e6-a337-11cc91e3effe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:28.871069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eee0d44a-f54e-487d-8040-06afe28834ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:28.874760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d05b94c8-6795-49e6-a337-11cc91e3effe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 May 12 07:12:28.875335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 982/1872] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:28.878428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-eee0d44a-f54e-487d-8040-06afe28834ea tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079980 May 12 07:12:28.878990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 891/1873] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:28 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:12:29.514151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-52fb2d2a-736e-4dde-86b1-39b38f4e30bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:29.514788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-52fb2d2a-736e-4dde-86b1-39b38f4e30bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:29.520834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52fb2d2a-736e-4dde-86b1-39b38f4e30bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:29.521291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52fb2d2a-736e-4dde-86b1-39b38f4e30bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:29.522053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52fb2d2a-736e-4dde-86b1-39b38f4e30bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:29.522487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-52fb2d2a-736e-4dde-86b1-39b38f4e30bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:29.644973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-52fb2d2a-736e-4dde-86b1-39b38f4e30bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:29.653104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-52fb2d2a-736e-4dde-86b1-39b38f4e30bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:29.654647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-52fb2d2a-736e-4dde-86b1-39b38f4e30bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:29.655828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-52fb2d2a-736e-4dde-86b1-39b38f4e30bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.145627 May 12 07:12:29.656390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 983/1874] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:29 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:29.886869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-99f0fbcb-e357-47b9-b541-b641a988fcf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:29.887747 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-99f0fbcb-e357-47b9-b541-b641a988fcf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:29.894205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99f0fbcb-e357-47b9-b541-b641a988fcf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:29.894659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99f0fbcb-e357-47b9-b541-b641a988fcf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:29.895226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1f9605dc-2e76-4981-9e28-72d6c93f7291 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:29.895678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99f0fbcb-e357-47b9-b541-b641a988fcf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:29.895885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1f9605dc-2e76-4981-9e28-72d6c93f7291 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:29.896013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99f0fbcb-e357-47b9-b541-b641a988fcf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:29.902734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1f9605dc-2e76-4981-9e28-72d6c93f7291 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:29.903189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1f9605dc-2e76-4981-9e28-72d6c93f7291 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:29.904006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1f9605dc-2e76-4981-9e28-72d6c93f7291 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:29.904448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1f9605dc-2e76-4981-9e28-72d6c93f7291 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:29.925368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-99f0fbcb-e357-47b9-b541-b641a988fcf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042630 May 12 07:12:29.925930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 892/1875] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:29.967757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1f9605dc-2e76-4981-9e28-72d6c93f7291 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:29.975101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1f9605dc-2e76-4981-9e28-72d6c93f7291 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083834 May 12 07:12:29.975670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 984/1876] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:29 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:12:30.674869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-335bac5b-b1b6-46e2-a209-c534385553a0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:30.675483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-335bac5b-b1b6-46e2-a209-c534385553a0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:30.681971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-335bac5b-b1b6-46e2-a209-c534385553a0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:30.682419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-335bac5b-b1b6-46e2-a209-c534385553a0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:30.683181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-335bac5b-b1b6-46e2-a209-c534385553a0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:30.683618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-335bac5b-b1b6-46e2-a209-c534385553a0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:30.807263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-335bac5b-b1b6-46e2-a209-c534385553a0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:30.815485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-335bac5b-b1b6-46e2-a209-c534385553a0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:30.817036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-335bac5b-b1b6-46e2-a209-c534385553a0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:30.818198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-335bac5b-b1b6-46e2-a209-c534385553a0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147507 May 12 07:12:30.818767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 893/1877] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:30 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:30.936779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-48d38f70-ecaf-416a-8631-1d7627c60f83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:30.937627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-48d38f70-ecaf-416a-8631-1d7627c60f83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:30.943954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48d38f70-ecaf-416a-8631-1d7627c60f83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:30.945134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48d38f70-ecaf-416a-8631-1d7627c60f83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:30.946041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48d38f70-ecaf-416a-8631-1d7627c60f83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:30.946481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48d38f70-ecaf-416a-8631-1d7627c60f83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:30.976188 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-48d38f70-ecaf-416a-8631-1d7627c60f83 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 May 12 07:12:30.976748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 985/1878] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:30.992825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7b1caa4c-3fc9-4048-b279-990f15df72c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:30.993789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7b1caa4c-3fc9-4048-b279-990f15df72c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:30.999463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b1caa4c-3fc9-4048-b279-990f15df72c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:30.999954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b1caa4c-3fc9-4048-b279-990f15df72c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:31.000726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b1caa4c-3fc9-4048-b279-990f15df72c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:31.001168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b1caa4c-3fc9-4048-b279-990f15df72c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:31.060891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7b1caa4c-3fc9-4048-b279-990f15df72c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:31.068165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7b1caa4c-3fc9-4048-b279-990f15df72c1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079907 May 12 07:12:31.068729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 894/1879] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:30 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:31.838518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d33fb0fd-ea2a-4d73-8936-90e3f17b42de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:31.839122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d33fb0fd-ea2a-4d73-8936-90e3f17b42de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:31.846218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d33fb0fd-ea2a-4d73-8936-90e3f17b42de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:31.846673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d33fb0fd-ea2a-4d73-8936-90e3f17b42de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:31.847457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d33fb0fd-ea2a-4d73-8936-90e3f17b42de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:31.847921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d33fb0fd-ea2a-4d73-8936-90e3f17b42de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:31.978379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d33fb0fd-ea2a-4d73-8936-90e3f17b42de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:31.986507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-55ac2cab-1c84-417d-af9a-67d138b2d37a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:31.987465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-55ac2cab-1c84-417d-af9a-67d138b2d37a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:31.990410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d33fb0fd-ea2a-4d73-8936-90e3f17b42de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:31.992383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d33fb0fd-ea2a-4d73-8936-90e3f17b42de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:31.993521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55ac2cab-1c84-417d-af9a-67d138b2d37a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:31.993969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d33fb0fd-ea2a-4d73-8936-90e3f17b42de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.159630 May 12 07:12:31.994084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55ac2cab-1c84-417d-af9a-67d138b2d37a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:31.994430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 986/1880] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:31 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:31.994737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55ac2cab-1c84-417d-af9a-67d138b2d37a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:31.995172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-55ac2cab-1c84-417d-af9a-67d138b2d37a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:32.024773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-55ac2cab-1c84-417d-af9a-67d138b2d37a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042165 May 12 07:12:32.025314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 895/1881] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:32.084648 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2ae6b3f0-946c-467a-b1bd-6ec30db86ea0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:32.085895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2ae6b3f0-946c-467a-b1bd-6ec30db86ea0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:32.091917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ae6b3f0-946c-467a-b1bd-6ec30db86ea0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:32.092310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ae6b3f0-946c-467a-b1bd-6ec30db86ea0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:32.093076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ae6b3f0-946c-467a-b1bd-6ec30db86ea0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:32.093509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ae6b3f0-946c-467a-b1bd-6ec30db86ea0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:32.153823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2ae6b3f0-946c-467a-b1bd-6ec30db86ea0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:32.160886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2ae6b3f0-946c-467a-b1bd-6ec30db86ea0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080018 May 12 07:12:32.161453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 987/1882] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:32 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:33.012074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ec8b66cb-2a36-4444-ba05-f659ecf2f2e5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:33.012682 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ec8b66cb-2a36-4444-ba05-f659ecf2f2e5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:33.018956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ec8b66cb-2a36-4444-ba05-f659ecf2f2e5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:33.019404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ec8b66cb-2a36-4444-ba05-f659ecf2f2e5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:33.020194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ec8b66cb-2a36-4444-ba05-f659ecf2f2e5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:33.020628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ec8b66cb-2a36-4444-ba05-f659ecf2f2e5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:33.036055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4ae3708f-9326-4cca-9ef1-73059525a536 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:33.036976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4ae3708f-9326-4cca-9ef1-73059525a536 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:33.043872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ae3708f-9326-4cca-9ef1-73059525a536 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:33.044325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ae3708f-9326-4cca-9ef1-73059525a536 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:33.045099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ae3708f-9326-4cca-9ef1-73059525a536 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:33.045528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ae3708f-9326-4cca-9ef1-73059525a536 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:33.074315 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4ae3708f-9326-4cca-9ef1-73059525a536 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042137 May 12 07:12:33.074886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 988/1883] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:33 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:33.145814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ec8b66cb-2a36-4444-ba05-f659ecf2f2e5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:33.154414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ec8b66cb-2a36-4444-ba05-f659ecf2f2e5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:33.155929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ec8b66cb-2a36-4444-ba05-f659ecf2f2e5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:33.157084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ec8b66cb-2a36-4444-ba05-f659ecf2f2e5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148923 May 12 07:12:33.157642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 896/1884] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:33 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:33.176674 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-41392061-5127-46d3-a674-24becd498e65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:33.177282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-41392061-5127-46d3-a674-24becd498e65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:33.183024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41392061-5127-46d3-a674-24becd498e65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:33.183468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41392061-5127-46d3-a674-24becd498e65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:33.184433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41392061-5127-46d3-a674-24becd498e65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:33.184870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41392061-5127-46d3-a674-24becd498e65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:33.246958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-41392061-5127-46d3-a674-24becd498e65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:33.254186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-41392061-5127-46d3-a674-24becd498e65 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081519 May 12 07:12:33.254754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 989/1885] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:33 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:34.085884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-68315670-8388-403e-b153-f4be166db1a7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:34.086811 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-68315670-8388-403e-b153-f4be166db1a7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:34.093141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68315670-8388-403e-b153-f4be166db1a7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:34.093594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68315670-8388-403e-b153-f4be166db1a7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:34.094363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68315670-8388-403e-b153-f4be166db1a7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:34.094801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68315670-8388-403e-b153-f4be166db1a7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:34.123515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-68315670-8388-403e-b153-f4be166db1a7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041650 May 12 07:12:34.124095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 897/1886] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:34.176206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-918bfbe2-a622-44be-9800-970d3055b222 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:34.176833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-918bfbe2-a622-44be-9800-970d3055b222 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:34.183780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-918bfbe2-a622-44be-9800-970d3055b222 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:34.184239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-918bfbe2-a622-44be-9800-970d3055b222 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:34.185056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-918bfbe2-a622-44be-9800-970d3055b222 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:34.185500 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-918bfbe2-a622-44be-9800-970d3055b222 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:34.271357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-39d93de7-9910-46af-b36a-4288346e2a6b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:34.272002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-39d93de7-9910-46af-b36a-4288346e2a6b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:34.277791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39d93de7-9910-46af-b36a-4288346e2a6b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:34.278246 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39d93de7-9910-46af-b36a-4288346e2a6b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:34.279028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39d93de7-9910-46af-b36a-4288346e2a6b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:34.279469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39d93de7-9910-46af-b36a-4288346e2a6b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:34.309836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-918bfbe2-a622-44be-9800-970d3055b222 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:34.318108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-918bfbe2-a622-44be-9800-970d3055b222 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:34.319611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-918bfbe2-a622-44be-9800-970d3055b222 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:34.320834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-918bfbe2-a622-44be-9800-970d3055b222 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148856 May 12 07:12:34.321401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 990/1887] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:34 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:34.338931 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-39d93de7-9910-46af-b36a-4288346e2a6b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:34.346371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-39d93de7-9910-46af-b36a-4288346e2a6b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078787 May 12 07:12:34.346936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 898/1888] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:34 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:12:35.134909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f8318c1a-6c4f-4d8f-959a-35db8fd521ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:35.135864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f8318c1a-6c4f-4d8f-959a-35db8fd521ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:35.141831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8318c1a-6c4f-4d8f-959a-35db8fd521ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:35.142275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8318c1a-6c4f-4d8f-959a-35db8fd521ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:35.143040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8318c1a-6c4f-4d8f-959a-35db8fd521ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:35.143476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8318c1a-6c4f-4d8f-959a-35db8fd521ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:35.172228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f8318c1a-6c4f-4d8f-959a-35db8fd521ef tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041290 May 12 07:12:35.172772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 991/1889] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:35 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:35.339715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1bf7ef3e-87dd-491d-bc44-a7c8379218c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:35.340367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1bf7ef3e-87dd-491d-bc44-a7c8379218c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:35.346613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bf7ef3e-87dd-491d-bc44-a7c8379218c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:35.347057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bf7ef3e-87dd-491d-bc44-a7c8379218c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:35.347851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bf7ef3e-87dd-491d-bc44-a7c8379218c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:35.348285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bf7ef3e-87dd-491d-bc44-a7c8379218c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:35.362646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7922bc26-321c-4a51-869f-9e6f99555bd1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:35.363396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7922bc26-321c-4a51-869f-9e6f99555bd1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:35.369858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7922bc26-321c-4a51-869f-9e6f99555bd1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:35.370314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7922bc26-321c-4a51-869f-9e6f99555bd1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:35.371088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7922bc26-321c-4a51-869f-9e6f99555bd1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:35.371530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7922bc26-321c-4a51-869f-9e6f99555bd1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:35.443347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7922bc26-321c-4a51-869f-9e6f99555bd1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:35.451165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7922bc26-321c-4a51-869f-9e6f99555bd1 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.092283 May 12 07:12:35.451758 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 992/1890] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:35 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:12:35.498786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1bf7ef3e-87dd-491d-bc44-a7c8379218c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:35.507462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1bf7ef3e-87dd-491d-bc44-a7c8379218c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:35.508992 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1bf7ef3e-87dd-491d-bc44-a7c8379218c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:35.510154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1bf7ef3e-87dd-491d-bc44-a7c8379218c8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.175012 May 12 07:12:35.510716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 899/1891] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:35 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:36.184443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fc3afd52-63ba-427a-9e61-9917ff781bcd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:36.185367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fc3afd52-63ba-427a-9e61-9917ff781bcd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:36.191265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fc3afd52-63ba-427a-9e61-9917ff781bcd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:36.191737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fc3afd52-63ba-427a-9e61-9917ff781bcd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:36.192508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fc3afd52-63ba-427a-9e61-9917ff781bcd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:36.192941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fc3afd52-63ba-427a-9e61-9917ff781bcd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:36.221594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fc3afd52-63ba-427a-9e61-9917ff781bcd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041128 May 12 07:12:36.222143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 993/1892] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:36.468480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ec279923-001d-4c3a-98b8-3e373cd1aab6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:36.469049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ec279923-001d-4c3a-98b8-3e373cd1aab6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:36.476323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ec279923-001d-4c3a-98b8-3e373cd1aab6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:36.476772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ec279923-001d-4c3a-98b8-3e373cd1aab6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:36.477566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ec279923-001d-4c3a-98b8-3e373cd1aab6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:36.477999 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ec279923-001d-4c3a-98b8-3e373cd1aab6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:36.529059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0964dd97-fe78-48ad-9e0a-01f149395be3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:36.529792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0964dd97-fe78-48ad-9e0a-01f149395be3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:36.537375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0964dd97-fe78-48ad-9e0a-01f149395be3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:36.537834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0964dd97-fe78-48ad-9e0a-01f149395be3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:36.538675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0964dd97-fe78-48ad-9e0a-01f149395be3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:36.539120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0964dd97-fe78-48ad-9e0a-01f149395be3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:36.551988 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ec279923-001d-4c3a-98b8-3e373cd1aab6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:36.559395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ec279923-001d-4c3a-98b8-3e373cd1aab6 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.095007 May 12 07:12:36.559990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 900/1893] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:36 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:36.668738 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0964dd97-fe78-48ad-9e0a-01f149395be3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:36.677128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0964dd97-fe78-48ad-9e0a-01f149395be3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:36.679112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0964dd97-fe78-48ad-9e0a-01f149395be3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:36.680302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0964dd97-fe78-48ad-9e0a-01f149395be3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.155187 May 12 07:12:36.680859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 994/1894] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:36 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:12:37.233288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-40280a8b-8ed0-4540-9d3b-671c2dcd928a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:37.234160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-40280a8b-8ed0-4540-9d3b-671c2dcd928a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:37.240004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40280a8b-8ed0-4540-9d3b-671c2dcd928a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:37.240454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40280a8b-8ed0-4540-9d3b-671c2dcd928a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:37.241968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40280a8b-8ed0-4540-9d3b-671c2dcd928a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:37.242411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40280a8b-8ed0-4540-9d3b-671c2dcd928a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:37.269643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-40280a8b-8ed0-4540-9d3b-671c2dcd928a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040447 May 12 07:12:37.270180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 901/1895] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:37.575391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-da180376-0604-478c-8ebb-ff4f856a7191 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:37.576038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-da180376-0604-478c-8ebb-ff4f856a7191 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:37.582304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da180376-0604-478c-8ebb-ff4f856a7191 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:37.582755 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da180376-0604-478c-8ebb-ff4f856a7191 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:37.583528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da180376-0604-478c-8ebb-ff4f856a7191 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:37.584003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da180376-0604-478c-8ebb-ff4f856a7191 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:37.643307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-da180376-0604-478c-8ebb-ff4f856a7191 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:37.651113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-da180376-0604-478c-8ebb-ff4f856a7191 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079558 May 12 07:12:37.651677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 995/1896] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:37 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:37.698557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e05cb9c9-7098-4cf3-96d3-336e486546db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:37.699180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e05cb9c9-7098-4cf3-96d3-336e486546db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:37.705501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e05cb9c9-7098-4cf3-96d3-336e486546db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:37.705958 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e05cb9c9-7098-4cf3-96d3-336e486546db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:37.706738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e05cb9c9-7098-4cf3-96d3-336e486546db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:37.707181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e05cb9c9-7098-4cf3-96d3-336e486546db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:37.837180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e05cb9c9-7098-4cf3-96d3-336e486546db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:37.845395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e05cb9c9-7098-4cf3-96d3-336e486546db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:37.846951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e05cb9c9-7098-4cf3-96d3-336e486546db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:37.848143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e05cb9c9-7098-4cf3-96d3-336e486546db tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.153965 May 12 07:12:37.848707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 902/1897] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:37 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:38.281203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5351a36d-7935-4b0b-9593-5db36eb7d7eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:38.282137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5351a36d-7935-4b0b-9593-5db36eb7d7eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:38.287960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5351a36d-7935-4b0b-9593-5db36eb7d7eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:38.288417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5351a36d-7935-4b0b-9593-5db36eb7d7eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:38.289195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5351a36d-7935-4b0b-9593-5db36eb7d7eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:38.289633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5351a36d-7935-4b0b-9593-5db36eb7d7eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:38.318622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5351a36d-7935-4b0b-9593-5db36eb7d7eb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041418 May 12 07:12:38.319845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 996/1898] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:38 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:38.668299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c3da1251-e8a6-43cb-9679-94732bd7273f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:38.668839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c3da1251-e8a6-43cb-9679-94732bd7273f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:38.674984 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3da1251-e8a6-43cb-9679-94732bd7273f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:38.675435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3da1251-e8a6-43cb-9679-94732bd7273f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:38.676227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3da1251-e8a6-43cb-9679-94732bd7273f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:38.676662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3da1251-e8a6-43cb-9679-94732bd7273f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:38.736122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c3da1251-e8a6-43cb-9679-94732bd7273f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:38.743943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c3da1251-e8a6-43cb-9679-94732bd7273f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079586 May 12 07:12:38.744511 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 903/1899] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:38 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:38.866453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fbbce2b7-05c4-4642-bba1-bf10c7d4bcbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:38.867448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fbbce2b7-05c4-4642-bba1-bf10c7d4bcbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:38.873808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fbbce2b7-05c4-4642-bba1-bf10c7d4bcbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:38.874266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fbbce2b7-05c4-4642-bba1-bf10c7d4bcbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:38.875044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fbbce2b7-05c4-4642-bba1-bf10c7d4bcbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:38.875487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fbbce2b7-05c4-4642-bba1-bf10c7d4bcbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:39.004767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fbbce2b7-05c4-4642-bba1-bf10c7d4bcbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:39.013383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fbbce2b7-05c4-4642-bba1-bf10c7d4bcbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:39.014914 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fbbce2b7-05c4-4642-bba1-bf10c7d4bcbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:39.016101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fbbce2b7-05c4-4642-bba1-bf10c7d4bcbf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.153546 May 12 07:12:39.016665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 997/1900] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:38 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:39.330419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e5390cef-c315-4e3a-aa14-1415bc3257f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:39.331357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e5390cef-c315-4e3a-aa14-1415bc3257f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:39.337978 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5390cef-c315-4e3a-aa14-1415bc3257f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:39.338433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5390cef-c315-4e3a-aa14-1415bc3257f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:39.339203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5390cef-c315-4e3a-aa14-1415bc3257f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:39.339641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5390cef-c315-4e3a-aa14-1415bc3257f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:39.367469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e5390cef-c315-4e3a-aa14-1415bc3257f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040995 May 12 07:12:39.368048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 904/1901] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:39.761558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0e99d200-d6dd-4e61-af69-10c6a43035ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:39.762328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0e99d200-d6dd-4e61-af69-10c6a43035ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:39.768293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e99d200-d6dd-4e61-af69-10c6a43035ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:39.768748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e99d200-d6dd-4e61-af69-10c6a43035ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:39.769517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e99d200-d6dd-4e61-af69-10c6a43035ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:39.769956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e99d200-d6dd-4e61-af69-10c6a43035ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:39.830169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0e99d200-d6dd-4e61-af69-10c6a43035ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:39.838586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0e99d200-d6dd-4e61-af69-10c6a43035ee tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080874 May 12 07:12:39.839199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 998/1902] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:39 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:40.034299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6c8aae63-4da6-4c9d-b86a-1f29b04a11de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:40.034870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6c8aae63-4da6-4c9d-b86a-1f29b04a11de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:40.041754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6c8aae63-4da6-4c9d-b86a-1f29b04a11de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:40.042210 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6c8aae63-4da6-4c9d-b86a-1f29b04a11de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:40.042982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6c8aae63-4da6-4c9d-b86a-1f29b04a11de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:40.043426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6c8aae63-4da6-4c9d-b86a-1f29b04a11de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:40.168212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6c8aae63-4da6-4c9d-b86a-1f29b04a11de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:40.176616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6c8aae63-4da6-4c9d-b86a-1f29b04a11de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:40.178102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6c8aae63-4da6-4c9d-b86a-1f29b04a11de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:40.179922 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6c8aae63-4da6-4c9d-b86a-1f29b04a11de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149548 May 12 07:12:40.180489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 905/1903] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:40 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:40.379189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3375cc3e-2dfe-4b25-a07c-4b662d2459e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:40.380080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3375cc3e-2dfe-4b25-a07c-4b662d2459e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:40.386379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3375cc3e-2dfe-4b25-a07c-4b662d2459e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:40.386836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3375cc3e-2dfe-4b25-a07c-4b662d2459e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:40.387614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3375cc3e-2dfe-4b25-a07c-4b662d2459e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:40.388081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3375cc3e-2dfe-4b25-a07c-4b662d2459e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:40.417132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3375cc3e-2dfe-4b25-a07c-4b662d2459e1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042085 May 12 07:12:40.417678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 999/1904] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:40 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:40.855123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7d9f83a4-2dae-4823-a81c-ee9ed1d1b6da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:40.855765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7d9f83a4-2dae-4823-a81c-ee9ed1d1b6da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:40.861674 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d9f83a4-2dae-4823-a81c-ee9ed1d1b6da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:40.862118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d9f83a4-2dae-4823-a81c-ee9ed1d1b6da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:40.862883 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d9f83a4-2dae-4823-a81c-ee9ed1d1b6da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:40.863319 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d9f83a4-2dae-4823-a81c-ee9ed1d1b6da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:40.922644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7d9f83a4-2dae-4823-a81c-ee9ed1d1b6da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:40.933536 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7d9f83a4-2dae-4823-a81c-ee9ed1d1b6da tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079010 May 12 07:12:40.933536 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 906/1905] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:40 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:41.199102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f5888065-79c9-49f2-8b5f-1dd07ec4c6d4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:41.199769 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f5888065-79c9-49f2-8b5f-1dd07ec4c6d4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:41.206571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5888065-79c9-49f2-8b5f-1dd07ec4c6d4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:41.206571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5888065-79c9-49f2-8b5f-1dd07ec4c6d4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:41.206795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5888065-79c9-49f2-8b5f-1dd07ec4c6d4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:41.207226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5888065-79c9-49f2-8b5f-1dd07ec4c6d4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:41.333298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f5888065-79c9-49f2-8b5f-1dd07ec4c6d4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:41.341576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f5888065-79c9-49f2-8b5f-1dd07ec4c6d4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:41.343098 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f5888065-79c9-49f2-8b5f-1dd07ec4c6d4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:41.344306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f5888065-79c9-49f2-8b5f-1dd07ec4c6d4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149149 May 12 07:12:41.344871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1000/1906] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:41 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:41.429406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-10c1f289-c527-4f3b-9a52-71b0519aad6d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:41.430334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-10c1f289-c527-4f3b-9a52-71b0519aad6d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:41.436756 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10c1f289-c527-4f3b-9a52-71b0519aad6d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:41.437201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10c1f289-c527-4f3b-9a52-71b0519aad6d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:41.437963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10c1f289-c527-4f3b-9a52-71b0519aad6d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:41.438429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-10c1f289-c527-4f3b-9a52-71b0519aad6d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:41.467271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-10c1f289-c527-4f3b-9a52-71b0519aad6d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 May 12 07:12:41.467769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 907/1907] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:41 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:41.948238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3472b082-8a5e-42e6-b9ae-b79ca48c8b07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:41.948847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3472b082-8a5e-42e6-b9ae-b79ca48c8b07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:41.955062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3472b082-8a5e-42e6-b9ae-b79ca48c8b07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:41.955509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3472b082-8a5e-42e6-b9ae-b79ca48c8b07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:41.956302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3472b082-8a5e-42e6-b9ae-b79ca48c8b07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:41.956740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3472b082-8a5e-42e6-b9ae-b79ca48c8b07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:42.018829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3472b082-8a5e-42e6-b9ae-b79ca48c8b07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:42.026642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3472b082-8a5e-42e6-b9ae-b79ca48c8b07 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082607 May 12 07:12:42.027217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1001/1908] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:41 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:42.362638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-38389686-1f5d-4931-9464-01e804aea5b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:42.363248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-38389686-1f5d-4931-9464-01e804aea5b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:42.369139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-38389686-1f5d-4931-9464-01e804aea5b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:42.369586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-38389686-1f5d-4931-9464-01e804aea5b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:42.370343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-38389686-1f5d-4931-9464-01e804aea5b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:42.370780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-38389686-1f5d-4931-9464-01e804aea5b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:42.478112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-94e7d9de-a235-4136-a014-24e24f59212a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:42.479055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-94e7d9de-a235-4136-a014-24e24f59212a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:42.484865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94e7d9de-a235-4136-a014-24e24f59212a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:42.485320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94e7d9de-a235-4136-a014-24e24f59212a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:42.486094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94e7d9de-a235-4136-a014-24e24f59212a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:42.486544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94e7d9de-a235-4136-a014-24e24f59212a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:42.496616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-38389686-1f5d-4931-9464-01e804aea5b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:42.504945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-38389686-1f5d-4931-9464-01e804aea5b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:42.507002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-38389686-1f5d-4931-9464-01e804aea5b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:42.508197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-38389686-1f5d-4931-9464-01e804aea5b6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149453 May 12 07:12:42.508756 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 908/1909] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:42 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:12:42.515809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-94e7d9de-a235-4136-a014-24e24f59212a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 May 12 07:12:42.516371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1002/1910] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:42 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:43.043821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-86d80764-5c47-4db9-bee6-795c1009012e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:43.044480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-86d80764-5c47-4db9-bee6-795c1009012e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:43.050662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86d80764-5c47-4db9-bee6-795c1009012e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:43.051110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86d80764-5c47-4db9-bee6-795c1009012e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:43.051910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86d80764-5c47-4db9-bee6-795c1009012e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:43.052347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-86d80764-5c47-4db9-bee6-795c1009012e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:43.112049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-86d80764-5c47-4db9-bee6-795c1009012e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:43.119930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-86d80764-5c47-4db9-bee6-795c1009012e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080056 May 12 07:12:43.120497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 909/1911] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:43 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:43.527146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a6ea20a1-2b81-41f5-b14b-63a3724714b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:43.527738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-14c833f5-5872-404c-9f11-27850b0d0e78 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:43.528128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a6ea20a1-2b81-41f5-b14b-63a3724714b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:43.528537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-14c833f5-5872-404c-9f11-27850b0d0e78 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:43.534115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6ea20a1-2b81-41f5-b14b-63a3724714b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:43.534561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6ea20a1-2b81-41f5-b14b-63a3724714b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:43.534683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14c833f5-5872-404c-9f11-27850b0d0e78 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:43.535101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14c833f5-5872-404c-9f11-27850b0d0e78 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:43.535334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6ea20a1-2b81-41f5-b14b-63a3724714b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:43.535797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6ea20a1-2b81-41f5-b14b-63a3724714b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:43.535901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14c833f5-5872-404c-9f11-27850b0d0e78 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:43.536314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14c833f5-5872-404c-9f11-27850b0d0e78 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:43.565060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-14c833f5-5872-404c-9f11-27850b0d0e78 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041363 May 12 07:12:43.565827 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 910/1912] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:43.662823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a6ea20a1-2b81-41f5-b14b-63a3724714b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:43.671655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a6ea20a1-2b81-41f5-b14b-63a3724714b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:43.673447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a6ea20a1-2b81-41f5-b14b-63a3724714b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:43.674614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a6ea20a1-2b81-41f5-b14b-63a3724714b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151959 May 12 07:12:43.675176 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1003/1913] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:43 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:44.137088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9649ffb6-c9ff-4673-a35f-53ab31f87df7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:44.137711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9649ffb6-c9ff-4673-a35f-53ab31f87df7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:44.143599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9649ffb6-c9ff-4673-a35f-53ab31f87df7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:44.144088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9649ffb6-c9ff-4673-a35f-53ab31f87df7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:44.144862 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9649ffb6-c9ff-4673-a35f-53ab31f87df7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:44.145305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9649ffb6-c9ff-4673-a35f-53ab31f87df7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:44.204347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9649ffb6-c9ff-4673-a35f-53ab31f87df7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:44.212262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9649ffb6-c9ff-4673-a35f-53ab31f87df7 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079976 May 12 07:12:44.212829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 911/1914] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:44 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:44.576808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-15a7a6da-9d8c-4ffe-a995-c42d55585767 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:44.577766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-15a7a6da-9d8c-4ffe-a995-c42d55585767 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:44.584226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15a7a6da-9d8c-4ffe-a995-c42d55585767 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:44.584720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15a7a6da-9d8c-4ffe-a995-c42d55585767 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:44.585521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15a7a6da-9d8c-4ffe-a995-c42d55585767 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:44.585981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15a7a6da-9d8c-4ffe-a995-c42d55585767 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:44.614792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-15a7a6da-9d8c-4ffe-a995-c42d55585767 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041718 May 12 07:12:44.618861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1004/1915] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:44.692997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-471d046c-71e9-4095-a4c0-181385401aae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:44.693608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-471d046c-71e9-4095-a4c0-181385401aae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:44.699922 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-471d046c-71e9-4095-a4c0-181385401aae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:44.700370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-471d046c-71e9-4095-a4c0-181385401aae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:44.701133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-471d046c-71e9-4095-a4c0-181385401aae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:44.701566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-471d046c-71e9-4095-a4c0-181385401aae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:44.827611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-471d046c-71e9-4095-a4c0-181385401aae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:44.836188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-471d046c-71e9-4095-a4c0-181385401aae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:44.837969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-471d046c-71e9-4095-a4c0-181385401aae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:44.839118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-471d046c-71e9-4095-a4c0-181385401aae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150100 May 12 07:12:44.839966 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 912/1916] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:44 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:45.227999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d5948f6a-a9d4-4844-9b96-4ee22d2aa143 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:45.228619 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d5948f6a-a9d4-4844-9b96-4ee22d2aa143 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:45.234739 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5948f6a-a9d4-4844-9b96-4ee22d2aa143 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:45.235184 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5948f6a-a9d4-4844-9b96-4ee22d2aa143 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:45.235983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5948f6a-a9d4-4844-9b96-4ee22d2aa143 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:45.236419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5948f6a-a9d4-4844-9b96-4ee22d2aa143 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:45.294880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d5948f6a-a9d4-4844-9b96-4ee22d2aa143 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:45.302296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d5948f6a-a9d4-4844-9b96-4ee22d2aa143 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078186 May 12 07:12:45.302863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1005/1917] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:45 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:45.626730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1725c5b7-4ac7-4ae6-baa4-b4857c334064 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:45.627710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1725c5b7-4ac7-4ae6-baa4-b4857c334064 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:45.633450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1725c5b7-4ac7-4ae6-baa4-b4857c334064 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:45.633895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1725c5b7-4ac7-4ae6-baa4-b4857c334064 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:45.634655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1725c5b7-4ac7-4ae6-baa4-b4857c334064 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:45.635087 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1725c5b7-4ac7-4ae6-baa4-b4857c334064 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:45.662885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1725c5b7-4ac7-4ae6-baa4-b4857c334064 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040392 May 12 07:12:45.664132 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 913/1918] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:45 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:45.857878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5f16a19b-0019-4442-aa9b-729e32edce4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:45.858516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5f16a19b-0019-4442-aa9b-729e32edce4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:45.864886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5f16a19b-0019-4442-aa9b-729e32edce4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:45.865336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5f16a19b-0019-4442-aa9b-729e32edce4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:45.866109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5f16a19b-0019-4442-aa9b-729e32edce4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:45.866587 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5f16a19b-0019-4442-aa9b-729e32edce4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:45.994404 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5f16a19b-0019-4442-aa9b-729e32edce4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:46.002804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5f16a19b-0019-4442-aa9b-729e32edce4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:46.006523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5f16a19b-0019-4442-aa9b-729e32edce4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:46.006523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5f16a19b-0019-4442-aa9b-729e32edce4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151629 May 12 07:12:46.006523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1006/1919] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:45 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:46.318760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-778703ce-35ac-4bb5-94b6-5319c70632e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:46.319370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-778703ce-35ac-4bb5-94b6-5319c70632e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:46.326172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-778703ce-35ac-4bb5-94b6-5319c70632e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:46.326613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-778703ce-35ac-4bb5-94b6-5319c70632e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:46.327372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-778703ce-35ac-4bb5-94b6-5319c70632e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:46.327835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-778703ce-35ac-4bb5-94b6-5319c70632e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:46.388124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-778703ce-35ac-4bb5-94b6-5319c70632e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:46.395456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-778703ce-35ac-4bb5-94b6-5319c70632e2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080540 May 12 07:12:46.396053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 914/1920] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:46 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:46.674995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-da636260-6280-4e2b-93b6-8db12b523694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:46.675872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-da636260-6280-4e2b-93b6-8db12b523694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:46.682257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da636260-6280-4e2b-93b6-8db12b523694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:46.682709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da636260-6280-4e2b-93b6-8db12b523694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:46.683480 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da636260-6280-4e2b-93b6-8db12b523694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:46.683944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-da636260-6280-4e2b-93b6-8db12b523694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:46.712090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-da636260-6280-4e2b-93b6-8db12b523694 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041363 May 12 07:12:46.712634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1007/1921] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:46 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:47.024672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-062b6407-12fa-45be-a0dd-0bf5d2048d2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:47.025316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-062b6407-12fa-45be-a0dd-0bf5d2048d2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:47.031160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-062b6407-12fa-45be-a0dd-0bf5d2048d2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:47.031617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-062b6407-12fa-45be-a0dd-0bf5d2048d2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:47.032426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-062b6407-12fa-45be-a0dd-0bf5d2048d2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:47.032872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-062b6407-12fa-45be-a0dd-0bf5d2048d2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:47.158719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-062b6407-12fa-45be-a0dd-0bf5d2048d2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:47.167614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-062b6407-12fa-45be-a0dd-0bf5d2048d2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:47.169162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-062b6407-12fa-45be-a0dd-0bf5d2048d2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:47.170324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-062b6407-12fa-45be-a0dd-0bf5d2048d2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149584 May 12 07:12:47.170889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 915/1922] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:47 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:47.411935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b7376ebe-f3e5-485f-8094-c07b3d3646b8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:47.412459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b7376ebe-f3e5-485f-8094-c07b3d3646b8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:47.419291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7376ebe-f3e5-485f-8094-c07b3d3646b8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:47.419769 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7376ebe-f3e5-485f-8094-c07b3d3646b8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:47.420538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7376ebe-f3e5-485f-8094-c07b3d3646b8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:47.420971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7376ebe-f3e5-485f-8094-c07b3d3646b8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:47.480656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b7376ebe-f3e5-485f-8094-c07b3d3646b8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:47.487825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b7376ebe-f3e5-485f-8094-c07b3d3646b8 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079767 May 12 07:12:47.488388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1008/1923] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:47 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:47.723480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8ec084d4-f0b1-4210-adbf-ed3bb166f93a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:47.724345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8ec084d4-f0b1-4210-adbf-ed3bb166f93a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:47.730612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ec084d4-f0b1-4210-adbf-ed3bb166f93a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:47.731059 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ec084d4-f0b1-4210-adbf-ed3bb166f93a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:47.731851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ec084d4-f0b1-4210-adbf-ed3bb166f93a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:47.732285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8ec084d4-f0b1-4210-adbf-ed3bb166f93a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:47.760986 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8ec084d4-f0b1-4210-adbf-ed3bb166f93a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 May 12 07:12:47.761553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 916/1924] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:48.188867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-db2fb731-0c52-4cf3-9fdd-3af7c86444f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:48.189470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-db2fb731-0c52-4cf3-9fdd-3af7c86444f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:48.196030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db2fb731-0c52-4cf3-9fdd-3af7c86444f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:48.196476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db2fb731-0c52-4cf3-9fdd-3af7c86444f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:48.197234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db2fb731-0c52-4cf3-9fdd-3af7c86444f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:48.197667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-db2fb731-0c52-4cf3-9fdd-3af7c86444f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:48.321490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-db2fb731-0c52-4cf3-9fdd-3af7c86444f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:48.329678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-db2fb731-0c52-4cf3-9fdd-3af7c86444f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:48.331172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-db2fb731-0c52-4cf3-9fdd-3af7c86444f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:48.332350 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-db2fb731-0c52-4cf3-9fdd-3af7c86444f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147406 May 12 07:12:48.332904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1009/1925] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:48 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:48.504265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2f5c6780-b12a-47a0-ac78-03857d092e20 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:48.504894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2f5c6780-b12a-47a0-ac78-03857d092e20 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:48.510712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f5c6780-b12a-47a0-ac78-03857d092e20 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:48.511160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f5c6780-b12a-47a0-ac78-03857d092e20 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:48.511945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f5c6780-b12a-47a0-ac78-03857d092e20 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:48.512386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f5c6780-b12a-47a0-ac78-03857d092e20 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:48.571485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2f5c6780-b12a-47a0-ac78-03857d092e20 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:48.578744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2f5c6780-b12a-47a0-ac78-03857d092e20 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078285 May 12 07:12:48.579303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 917/1926] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:48 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:48.772353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0e61910e-ec6b-4f4c-b82d-ed3d07f8be1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:48.773320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0e61910e-ec6b-4f4c-b82d-ed3d07f8be1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:48.779661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e61910e-ec6b-4f4c-b82d-ed3d07f8be1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:48.780150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e61910e-ec6b-4f4c-b82d-ed3d07f8be1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:48.780927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e61910e-ec6b-4f4c-b82d-ed3d07f8be1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:48.781367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e61910e-ec6b-4f4c-b82d-ed3d07f8be1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:48.811293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0e61910e-ec6b-4f4c-b82d-ed3d07f8be1b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042865 May 12 07:12:48.811871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1010/1927] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:48 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:49.352056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-27293648-27d7-487e-9158-ac12cefa0730 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:49.352589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-27293648-27d7-487e-9158-ac12cefa0730 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:49.358839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-27293648-27d7-487e-9158-ac12cefa0730 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:49.359287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-27293648-27d7-487e-9158-ac12cefa0730 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:49.360075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-27293648-27d7-487e-9158-ac12cefa0730 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:49.360509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-27293648-27d7-487e-9158-ac12cefa0730 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:49.485053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-27293648-27d7-487e-9158-ac12cefa0730 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:49.493713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-27293648-27d7-487e-9158-ac12cefa0730 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:49.495213 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-27293648-27d7-487e-9158-ac12cefa0730 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:49.496398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-27293648-27d7-487e-9158-ac12cefa0730 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149056 May 12 07:12:49.496951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 918/1928] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:49 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:49.595935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7f4710f0-1176-43ed-b9ba-3f2e6f24a43e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:49.596552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7f4710f0-1176-43ed-b9ba-3f2e6f24a43e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:49.602530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f4710f0-1176-43ed-b9ba-3f2e6f24a43e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:49.602915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f4710f0-1176-43ed-b9ba-3f2e6f24a43e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:49.603782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f4710f0-1176-43ed-b9ba-3f2e6f24a43e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:49.604158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7f4710f0-1176-43ed-b9ba-3f2e6f24a43e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:49.663001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7f4710f0-1176-43ed-b9ba-3f2e6f24a43e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:49.670567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7f4710f0-1176-43ed-b9ba-3f2e6f24a43e tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078527 May 12 07:12:49.671133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1011/1929] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:49 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:49.822096 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-21414e8f-8894-45b3-a1d0-ccf7209ed68c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:49.823045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-21414e8f-8894-45b3-a1d0-ccf7209ed68c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:49.829147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21414e8f-8894-45b3-a1d0-ccf7209ed68c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:49.829610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21414e8f-8894-45b3-a1d0-ccf7209ed68c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:49.830423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21414e8f-8894-45b3-a1d0-ccf7209ed68c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:49.830871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21414e8f-8894-45b3-a1d0-ccf7209ed68c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:49.858947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-21414e8f-8894-45b3-a1d0-ccf7209ed68c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 May 12 07:12:49.859431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 919/1930] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:49 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:50.516151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6214dfe2-b756-41ff-84b2-03c7a904d00b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:50.516768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6214dfe2-b756-41ff-84b2-03c7a904d00b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:50.523021 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6214dfe2-b756-41ff-84b2-03c7a904d00b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:50.523472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6214dfe2-b756-41ff-84b2-03c7a904d00b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:50.524277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6214dfe2-b756-41ff-84b2-03c7a904d00b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:50.524718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6214dfe2-b756-41ff-84b2-03c7a904d00b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:50.650771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6214dfe2-b756-41ff-84b2-03c7a904d00b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:50.659102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6214dfe2-b756-41ff-84b2-03c7a904d00b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:50.660637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6214dfe2-b756-41ff-84b2-03c7a904d00b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:50.661824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6214dfe2-b756-41ff-84b2-03c7a904d00b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149635 May 12 07:12:50.662394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1012/1931] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:50 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:50.687639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fc0f43a6-ae7d-4483-95dc-5a05db34503f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:50.688594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fc0f43a6-ae7d-4483-95dc-5a05db34503f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:50.694742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc0f43a6-ae7d-4483-95dc-5a05db34503f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:50.695185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc0f43a6-ae7d-4483-95dc-5a05db34503f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:50.695972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc0f43a6-ae7d-4483-95dc-5a05db34503f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:50.696405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc0f43a6-ae7d-4483-95dc-5a05db34503f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:50.755103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fc0f43a6-ae7d-4483-95dc-5a05db34503f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:50.762387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fc0f43a6-ae7d-4483-95dc-5a05db34503f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078529 May 12 07:12:50.762922 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 920/1932] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:50 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:50.870570 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3b1c85cb-423a-4e3e-92e7-b07d34875f11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:50.871416 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3b1c85cb-423a-4e3e-92e7-b07d34875f11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:50.877269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3b1c85cb-423a-4e3e-92e7-b07d34875f11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:50.877724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3b1c85cb-423a-4e3e-92e7-b07d34875f11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:50.878503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3b1c85cb-423a-4e3e-92e7-b07d34875f11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:50.878943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3b1c85cb-423a-4e3e-92e7-b07d34875f11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:50.907036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3b1c85cb-423a-4e3e-92e7-b07d34875f11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040550 May 12 07:12:50.907580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1013/1933] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:51.681472 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-264d52e6-e701-460e-bc85-3a37b65cddfe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:51.682088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-264d52e6-e701-460e-bc85-3a37b65cddfe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:51.688103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-264d52e6-e701-460e-bc85-3a37b65cddfe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:51.688669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-264d52e6-e701-460e-bc85-3a37b65cddfe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:51.689320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-264d52e6-e701-460e-bc85-3a37b65cddfe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:51.689762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-264d52e6-e701-460e-bc85-3a37b65cddfe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:51.778658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3f747ba9-5565-4125-aa32-13ff4d36f407 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:51.779212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3f747ba9-5565-4125-aa32-13ff4d36f407 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:51.784699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f747ba9-5565-4125-aa32-13ff4d36f407 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:51.785151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f747ba9-5565-4125-aa32-13ff4d36f407 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:51.785927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f747ba9-5565-4125-aa32-13ff4d36f407 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:51.786364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f747ba9-5565-4125-aa32-13ff4d36f407 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:51.815629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-264d52e6-e701-460e-bc85-3a37b65cddfe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:51.824921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-264d52e6-e701-460e-bc85-3a37b65cddfe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:51.826437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-264d52e6-e701-460e-bc85-3a37b65cddfe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:51.827632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-264d52e6-e701-460e-bc85-3a37b65cddfe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150875 May 12 07:12:51.828806 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 921/1934] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:51 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:51.850251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3f747ba9-5565-4125-aa32-13ff4d36f407 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:51.857545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3f747ba9-5565-4125-aa32-13ff4d36f407 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083187 May 12 07:12:51.858110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1014/1935] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:51 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:12:51.918896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9acfadf5-53db-469f-9039-d2d30e2d8b77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:51.919855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9acfadf5-53db-469f-9039-d2d30e2d8b77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:51.926012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9acfadf5-53db-469f-9039-d2d30e2d8b77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:51.926467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9acfadf5-53db-469f-9039-d2d30e2d8b77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:51.927239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9acfadf5-53db-469f-9039-d2d30e2d8b77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:51.927679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9acfadf5-53db-469f-9039-d2d30e2d8b77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:51.957086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9acfadf5-53db-469f-9039-d2d30e2d8b77 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042093 May 12 07:12:51.957576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 922/1936] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:52.846604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3f2004ca-ea79-4181-acb6-05ed902d00a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:52.847198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3f2004ca-ea79-4181-acb6-05ed902d00a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:52.853537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f2004ca-ea79-4181-acb6-05ed902d00a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:52.853986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f2004ca-ea79-4181-acb6-05ed902d00a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:52.854750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f2004ca-ea79-4181-acb6-05ed902d00a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:52.855183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3f2004ca-ea79-4181-acb6-05ed902d00a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:52.874317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0262e0bf-9077-438d-9eae-92e3e8c92e76 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:52.874926 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0262e0bf-9077-438d-9eae-92e3e8c92e76 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:52.881081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0262e0bf-9077-438d-9eae-92e3e8c92e76 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:52.881530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0262e0bf-9077-438d-9eae-92e3e8c92e76 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:52.882793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0262e0bf-9077-438d-9eae-92e3e8c92e76 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:52.883223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0262e0bf-9077-438d-9eae-92e3e8c92e76 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:52.948203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0262e0bf-9077-438d-9eae-92e3e8c92e76 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:52.955396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0262e0bf-9077-438d-9eae-92e3e8c92e76 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.084795 May 12 07:12:52.956007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 923/1937] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:52 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:12:52.969561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0842dabd-0b53-45ee-9666-4924fc2da6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:52.970476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0842dabd-0b53-45ee-9666-4924fc2da6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:52.976844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0842dabd-0b53-45ee-9666-4924fc2da6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:52.977291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0842dabd-0b53-45ee-9666-4924fc2da6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:52.978342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0842dabd-0b53-45ee-9666-4924fc2da6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:52.978779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0842dabd-0b53-45ee-9666-4924fc2da6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:53.007998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0842dabd-0b53-45ee-9666-4924fc2da6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042187 May 12 07:12:53.008573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 924/1938] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:53.009279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3f2004ca-ea79-4181-acb6-05ed902d00a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:53.017721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3f2004ca-ea79-4181-acb6-05ed902d00a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:53.019219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3f2004ca-ea79-4181-acb6-05ed902d00a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:53.020406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3f2004ca-ea79-4181-acb6-05ed902d00a9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.177683 May 12 07:12:53.020959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1015/1939] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:52 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:53.972202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0944fd97-2fb6-461e-8003-65002014310f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:53.972860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0944fd97-2fb6-461e-8003-65002014310f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:53.979139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0944fd97-2fb6-461e-8003-65002014310f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:53.979592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0944fd97-2fb6-461e-8003-65002014310f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:53.980394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0944fd97-2fb6-461e-8003-65002014310f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:53.980843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0944fd97-2fb6-461e-8003-65002014310f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:54.018401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d2e10b64-1d38-4daa-a754-34e7efab67d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:54.019340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d2e10b64-1d38-4daa-a754-34e7efab67d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:54.026010 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2e10b64-1d38-4daa-a754-34e7efab67d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:54.026465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2e10b64-1d38-4daa-a754-34e7efab67d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:54.027246 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2e10b64-1d38-4daa-a754-34e7efab67d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:54.027718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2e10b64-1d38-4daa-a754-34e7efab67d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:54.041518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0944fd97-2fb6-461e-8003-65002014310f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:54.049099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0944fd97-2fb6-461e-8003-65002014310f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.080769 May 12 07:12:54.049668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 925/1940] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:53 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:54.054023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f37c9dce-dfa6-4abc-9452-db33ab18a931 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:54.054632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f37c9dce-dfa6-4abc-9452-db33ab18a931 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:54.057566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d2e10b64-1d38-4daa-a754-34e7efab67d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043021 May 12 07:12:54.058136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1016/1941] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:54.060972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f37c9dce-dfa6-4abc-9452-db33ab18a931 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:54.061422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f37c9dce-dfa6-4abc-9452-db33ab18a931 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:54.062183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f37c9dce-dfa6-4abc-9452-db33ab18a931 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:54.062612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f37c9dce-dfa6-4abc-9452-db33ab18a931 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:54.189011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f37c9dce-dfa6-4abc-9452-db33ab18a931 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:54.197356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f37c9dce-dfa6-4abc-9452-db33ab18a931 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:54.198839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f37c9dce-dfa6-4abc-9452-db33ab18a931 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:54.200010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f37c9dce-dfa6-4abc-9452-db33ab18a931 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149423 May 12 07:12:54.200572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 926/1942] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:54 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:55.066191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d36fa01a-c2d4-45c0-af64-aa2720282312 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:55.066911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d36fa01a-c2d4-45c0-af64-aa2720282312 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:55.068836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-90898117-f97d-4bbf-a6d3-d3165b29332f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:55.069751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-90898117-f97d-4bbf-a6d3-d3165b29332f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:55.073880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d36fa01a-c2d4-45c0-af64-aa2720282312 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:55.074337 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d36fa01a-c2d4-45c0-af64-aa2720282312 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:55.075122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d36fa01a-c2d4-45c0-af64-aa2720282312 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:55.075563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d36fa01a-c2d4-45c0-af64-aa2720282312 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:55.076473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90898117-f97d-4bbf-a6d3-d3165b29332f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:55.076917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90898117-f97d-4bbf-a6d3-d3165b29332f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:55.077677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90898117-f97d-4bbf-a6d3-d3165b29332f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:55.078113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-90898117-f97d-4bbf-a6d3-d3165b29332f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:55.107017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-90898117-f97d-4bbf-a6d3-d3165b29332f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041962 May 12 07:12:55.107586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 927/1943] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:55 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:55.136222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d36fa01a-c2d4-45c0-af64-aa2720282312 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:55.143412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d36fa01a-c2d4-45c0-af64-aa2720282312 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081122 May 12 07:12:55.144019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1017/1944] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:55 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:55.218276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4b774b33-2c62-4261-962d-17fc1f700d1a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:55.218894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4b774b33-2c62-4261-962d-17fc1f700d1a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:55.224840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b774b33-2c62-4261-962d-17fc1f700d1a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:55.225296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b774b33-2c62-4261-962d-17fc1f700d1a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:55.226062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b774b33-2c62-4261-962d-17fc1f700d1a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:55.226499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4b774b33-2c62-4261-962d-17fc1f700d1a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:55.348717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4b774b33-2c62-4261-962d-17fc1f700d1a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:55.357040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4b774b33-2c62-4261-962d-17fc1f700d1a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:55.358544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4b774b33-2c62-4261-962d-17fc1f700d1a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:55.359710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4b774b33-2c62-4261-962d-17fc1f700d1a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.145357 May 12 07:12:55.360284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 928/1945] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:55 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:56.118023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8371b973-3901-41a7-9f12-d0bb067a4af0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:56.118937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8371b973-3901-41a7-9f12-d0bb067a4af0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:56.125299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8371b973-3901-41a7-9f12-d0bb067a4af0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:56.125742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8371b973-3901-41a7-9f12-d0bb067a4af0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:56.126507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8371b973-3901-41a7-9f12-d0bb067a4af0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:56.126940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8371b973-3901-41a7-9f12-d0bb067a4af0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:56.155491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8371b973-3901-41a7-9f12-d0bb067a4af0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 May 12 07:12:56.156069 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1018/1946] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:56.160370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-749f78dc-ecda-4f2e-83f8-ce9272ad8da3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:56.160988 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-749f78dc-ecda-4f2e-83f8-ce9272ad8da3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:56.168030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-749f78dc-ecda-4f2e-83f8-ce9272ad8da3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:56.168482 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-749f78dc-ecda-4f2e-83f8-ce9272ad8da3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:56.169248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-749f78dc-ecda-4f2e-83f8-ce9272ad8da3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:56.169684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-749f78dc-ecda-4f2e-83f8-ce9272ad8da3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:56.231315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-749f78dc-ecda-4f2e-83f8-ce9272ad8da3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:56.238658 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-749f78dc-ecda-4f2e-83f8-ce9272ad8da3 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082131 May 12 07:12:56.239230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 929/1947] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:56 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:12:56.378293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b240f9ea-e733-45d1-bb91-26779193eb86 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:56.378831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b240f9ea-e733-45d1-bb91-26779193eb86 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:56.384988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b240f9ea-e733-45d1-bb91-26779193eb86 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:56.385430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b240f9ea-e733-45d1-bb91-26779193eb86 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:56.386192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b240f9ea-e733-45d1-bb91-26779193eb86 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:56.386626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b240f9ea-e733-45d1-bb91-26779193eb86 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:56.510091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b240f9ea-e733-45d1-bb91-26779193eb86 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:56.518271 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b240f9ea-e733-45d1-bb91-26779193eb86 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:56.519790 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b240f9ea-e733-45d1-bb91-26779193eb86 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:56.520951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b240f9ea-e733-45d1-bb91-26779193eb86 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146610 May 12 07:12:56.521508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1019/1948] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:56 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:57.167458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-21c06330-8ef4-4d00-a53e-6e5ed42718f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:57.168425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-21c06330-8ef4-4d00-a53e-6e5ed42718f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:57.174969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21c06330-8ef4-4d00-a53e-6e5ed42718f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:57.175426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21c06330-8ef4-4d00-a53e-6e5ed42718f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:57.176216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21c06330-8ef4-4d00-a53e-6e5ed42718f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:57.176653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21c06330-8ef4-4d00-a53e-6e5ed42718f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:57.205835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-21c06330-8ef4-4d00-a53e-6e5ed42718f0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 May 12 07:12:57.206386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 930/1949] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:57.254286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1e70df3c-c0a2-42e9-9cfb-879f11be3183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:57.254832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1e70df3c-c0a2-42e9-9cfb-879f11be3183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:57.261607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e70df3c-c0a2-42e9-9cfb-879f11be3183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:57.262050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e70df3c-c0a2-42e9-9cfb-879f11be3183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:57.262815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e70df3c-c0a2-42e9-9cfb-879f11be3183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:57.263249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e70df3c-c0a2-42e9-9cfb-879f11be3183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:57.322638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1e70df3c-c0a2-42e9-9cfb-879f11be3183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:57.329773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1e70df3c-c0a2-42e9-9cfb-879f11be3183 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079457 May 12 07:12:57.330335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1020/1950] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:57 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:57.539918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-87ae5827-1f42-4ce1-b577-44c27fe763bb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:57.540455 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-87ae5827-1f42-4ce1-b577-44c27fe763bb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:57.546244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87ae5827-1f42-4ce1-b577-44c27fe763bb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:57.546686 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87ae5827-1f42-4ce1-b577-44c27fe763bb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:57.547447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87ae5827-1f42-4ce1-b577-44c27fe763bb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:57.547905 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87ae5827-1f42-4ce1-b577-44c27fe763bb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:57.675670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-87ae5827-1f42-4ce1-b577-44c27fe763bb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:57.684666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-87ae5827-1f42-4ce1-b577-44c27fe763bb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:57.686363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-87ae5827-1f42-4ce1-b577-44c27fe763bb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:57.687558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-87ae5827-1f42-4ce1-b577-44c27fe763bb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151716 May 12 07:12:57.691234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 931/1951] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:57 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:58.216949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-985dc10a-b033-4369-93d4-6a87dd08f2bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:58.217932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-985dc10a-b033-4369-93d4-6a87dd08f2bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:58.223975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-985dc10a-b033-4369-93d4-6a87dd08f2bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:58.224426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-985dc10a-b033-4369-93d4-6a87dd08f2bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:58.225185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-985dc10a-b033-4369-93d4-6a87dd08f2bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:58.225622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-985dc10a-b033-4369-93d4-6a87dd08f2bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:58.254253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-985dc10a-b033-4369-93d4-6a87dd08f2bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041218 May 12 07:12:58.254748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1021/1952] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:12:58.347296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c1f9d814-7796-40e0-90e6-57789f62eff0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:58.347971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c1f9d814-7796-40e0-90e6-57789f62eff0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:58.355045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1f9d814-7796-40e0-90e6-57789f62eff0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:58.355492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1f9d814-7796-40e0-90e6-57789f62eff0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:58.356283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1f9d814-7796-40e0-90e6-57789f62eff0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:58.356718 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1f9d814-7796-40e0-90e6-57789f62eff0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:58.416130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c1f9d814-7796-40e0-90e6-57789f62eff0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:58.423607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c1f9d814-7796-40e0-90e6-57789f62eff0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079900 May 12 07:12:58.424197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 932/1953] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:58 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:58.706391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cd7d9b04-9381-49ca-952b-79386813dcc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:58.706928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cd7d9b04-9381-49ca-952b-79386813dcc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:58.714074 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd7d9b04-9381-49ca-952b-79386813dcc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:58.714529 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd7d9b04-9381-49ca-952b-79386813dcc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:58.715341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd7d9b04-9381-49ca-952b-79386813dcc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:58.715810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd7d9b04-9381-49ca-952b-79386813dcc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:58.841025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cd7d9b04-9381-49ca-952b-79386813dcc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:58.849142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cd7d9b04-9381-49ca-952b-79386813dcc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:58.850630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cd7d9b04-9381-49ca-952b-79386813dcc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:58.851839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cd7d9b04-9381-49ca-952b-79386813dcc0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149361 May 12 07:12:58.852404 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1022/1954] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:58 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:12:59.265933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c45e9beb-f368-4284-bd5b-1928335f2d79 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:59.266804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c45e9beb-f368-4284-bd5b-1928335f2d79 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:59.272715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c45e9beb-f368-4284-bd5b-1928335f2d79 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:59.273159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c45e9beb-f368-4284-bd5b-1928335f2d79 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:59.273920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c45e9beb-f368-4284-bd5b-1928335f2d79 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:59.274355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c45e9beb-f368-4284-bd5b-1928335f2d79 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:59.301870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c45e9beb-f368-4284-bd5b-1928335f2d79 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039918 May 12 07:12:59.302406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 933/1955] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:12:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:12:59.439263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ec187b4e-cd8e-47d5-93cd-2b756657267f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:59.439916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ec187b4e-cd8e-47d5-93cd-2b756657267f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:59.445780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec187b4e-cd8e-47d5-93cd-2b756657267f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:59.446234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec187b4e-cd8e-47d5-93cd-2b756657267f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:59.447013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec187b4e-cd8e-47d5-93cd-2b756657267f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:59.447454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec187b4e-cd8e-47d5-93cd-2b756657267f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:59.509425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ec187b4e-cd8e-47d5-93cd-2b756657267f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:12:59.516754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ec187b4e-cd8e-47d5-93cd-2b756657267f tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.081303 May 12 07:12:59.517267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1023/1956] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:12:59 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:12:59.870389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-182a653c-bd47-4111-a2be-f13c4fb5e954 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:12:59.870923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-182a653c-bd47-4111-a2be-f13c4fb5e954 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:12:59.877327 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-182a653c-bd47-4111-a2be-f13c4fb5e954 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:59.877783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-182a653c-bd47-4111-a2be-f13c4fb5e954 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:12:59.878559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-182a653c-bd47-4111-a2be-f13c4fb5e954 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:12:59.878997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-182a653c-bd47-4111-a2be-f13c4fb5e954 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:00.241286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-182a653c-bd47-4111-a2be-f13c4fb5e954 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:00.249491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-182a653c-bd47-4111-a2be-f13c4fb5e954 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:00.250972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-182a653c-bd47-4111-a2be-f13c4fb5e954 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:00.252158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-182a653c-bd47-4111-a2be-f13c4fb5e954 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.385692 May 12 07:13:00.252709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 934/1957] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:12:59 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:00.313789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2834fc38-e6a4-4c13-b8f9-3958b0c5fda8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:00.314692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2834fc38-e6a4-4c13-b8f9-3958b0c5fda8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:00.321437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2834fc38-e6a4-4c13-b8f9-3958b0c5fda8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:00.321884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2834fc38-e6a4-4c13-b8f9-3958b0c5fda8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:00.322647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2834fc38-e6a4-4c13-b8f9-3958b0c5fda8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:00.323079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2834fc38-e6a4-4c13-b8f9-3958b0c5fda8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:00.351972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2834fc38-e6a4-4c13-b8f9-3958b0c5fda8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042152 May 12 07:13:00.352516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1024/1958] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:13:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:13:00.533084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-22f59644-dfd0-4ad3-b00f-3e61ae2ec0af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:00.533702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-22f59644-dfd0-4ad3-b00f-3e61ae2ec0af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:00.539845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-22f59644-dfd0-4ad3-b00f-3e61ae2ec0af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:00.540335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-22f59644-dfd0-4ad3-b00f-3e61ae2ec0af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:00.541113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-22f59644-dfd0-4ad3-b00f-3e61ae2ec0af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:00.541586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-22f59644-dfd0-4ad3-b00f-3e61ae2ec0af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:00.600887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-22f59644-dfd0-4ad3-b00f-3e61ae2ec0af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:00.608099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-22f59644-dfd0-4ad3-b00f-3e61ae2ec0af tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.078902 May 12 07:13:00.608653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 935/1959] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:00 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:01.271094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0fa0edb2-2c3f-4a59-8015-11b95e27d4d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:01.271610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0fa0edb2-2c3f-4a59-8015-11b95e27d4d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:01.277932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0fa0edb2-2c3f-4a59-8015-11b95e27d4d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:01.278379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0fa0edb2-2c3f-4a59-8015-11b95e27d4d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:01.279168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0fa0edb2-2c3f-4a59-8015-11b95e27d4d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:01.279609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0fa0edb2-2c3f-4a59-8015-11b95e27d4d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:01.362408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c5d79d4d-ab80-4fc1-987b-984e19bbff3f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:01.363370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c5d79d4d-ab80-4fc1-987b-984e19bbff3f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:01.369624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5d79d4d-ab80-4fc1-987b-984e19bbff3f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:01.370073 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5d79d4d-ab80-4fc1-987b-984e19bbff3f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:01.370843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5d79d4d-ab80-4fc1-987b-984e19bbff3f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:01.371279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5d79d4d-ab80-4fc1-987b-984e19bbff3f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:01.400346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c5d79d4d-ab80-4fc1-987b-984e19bbff3f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041844 May 12 07:13:01.400900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 936/1960] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:13:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:13:01.408715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0fa0edb2-2c3f-4a59-8015-11b95e27d4d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:01.417616 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0fa0edb2-2c3f-4a59-8015-11b95e27d4d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:01.426470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0fa0edb2-2c3f-4a59-8015-11b95e27d4d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:01.426470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0fa0edb2-2c3f-4a59-8015-11b95e27d4d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.153270 May 12 07:13:01.426470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1025/1961] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:01 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:01.624420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3a650d7d-6742-4cc7-9a70-51e90a98790b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:01.624953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3a650d7d-6742-4cc7-9a70-51e90a98790b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:01.630800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a650d7d-6742-4cc7-9a70-51e90a98790b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:01.631246 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a650d7d-6742-4cc7-9a70-51e90a98790b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:01.632031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a650d7d-6742-4cc7-9a70-51e90a98790b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:01.632464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a650d7d-6742-4cc7-9a70-51e90a98790b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:01.691886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3a650d7d-6742-4cc7-9a70-51e90a98790b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:01.699559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3a650d7d-6742-4cc7-9a70-51e90a98790b tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.079002 May 12 07:13:01.700151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 937/1962] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:01 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:02.411951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8e4d958e-548b-402c-8406-328f31f7e459 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:02.412886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8e4d958e-548b-402c-8406-328f31f7e459 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:02.419723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e4d958e-548b-402c-8406-328f31f7e459 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:02.420183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e4d958e-548b-402c-8406-328f31f7e459 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:02.420961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e4d958e-548b-402c-8406-328f31f7e459 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:02.421402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e4d958e-548b-402c-8406-328f31f7e459 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:02.442400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bebe9c81-d128-46e8-970a-8aa92b92fdb9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:02.443042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bebe9c81-d128-46e8-970a-8aa92b92fdb9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:02.449441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bebe9c81-d128-46e8-970a-8aa92b92fdb9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:02.449901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bebe9c81-d128-46e8-970a-8aa92b92fdb9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:02.450683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bebe9c81-d128-46e8-970a-8aa92b92fdb9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:02.451434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bebe9c81-d128-46e8-970a-8aa92b92fdb9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:02.452117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8e4d958e-548b-402c-8406-328f31f7e459 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 May 12 07:13:02.456046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1026/1963] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:13:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:13:02.579334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bebe9c81-d128-46e8-970a-8aa92b92fdb9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:02.587444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bebe9c81-d128-46e8-970a-8aa92b92fdb9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:02.588989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bebe9c81-d128-46e8-970a-8aa92b92fdb9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:02.590151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bebe9c81-d128-46e8-970a-8aa92b92fdb9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151759 May 12 07:13:02.590713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 938/1964] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:02 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:13:02.716127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-84443cb0-ac59-4751-b286-dd661e460be2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:02.716748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-84443cb0-ac59-4751-b286-dd661e460be2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:02.722573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84443cb0-ac59-4751-b286-dd661e460be2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:02.723025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84443cb0-ac59-4751-b286-dd661e460be2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:02.723898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84443cb0-ac59-4751-b286-dd661e460be2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:02.724343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-84443cb0-ac59-4751-b286-dd661e460be2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:02.786680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-84443cb0-ac59-4751-b286-dd661e460be2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:02.794577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-84443cb0-ac59-4751-b286-dd661e460be2 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.082235 May 12 07:13:02.795151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1027/1965] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:02 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:03.464377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3e25b3b6-7bce-458d-a084-e32d05b8bb25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:03.465296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3e25b3b6-7bce-458d-a084-e32d05b8bb25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:03.471545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e25b3b6-7bce-458d-a084-e32d05b8bb25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:03.472033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e25b3b6-7bce-458d-a084-e32d05b8bb25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:03.472793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e25b3b6-7bce-458d-a084-e32d05b8bb25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:03.473223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e25b3b6-7bce-458d-a084-e32d05b8bb25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:03.502390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3e25b3b6-7bce-458d-a084-e32d05b8bb25 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042704 May 12 07:13:03.503134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 939/1966] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:13:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:13:03.608643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fd79fcb0-a940-4d94-b2bf-b1b44873ce6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:03.609259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fd79fcb0-a940-4d94-b2bf-b1b44873ce6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:03.615474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fd79fcb0-a940-4d94-b2bf-b1b44873ce6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:03.618038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fd79fcb0-a940-4d94-b2bf-b1b44873ce6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:03.618038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fd79fcb0-a940-4d94-b2bf-b1b44873ce6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:03.618038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fd79fcb0-a940-4d94-b2bf-b1b44873ce6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:03.745319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fd79fcb0-a940-4d94-b2bf-b1b44873ce6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:03.753637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fd79fcb0-a940-4d94-b2bf-b1b44873ce6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:03.755131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fd79fcb0-a940-4d94-b2bf-b1b44873ce6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:03.756317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fd79fcb0-a940-4d94-b2bf-b1b44873ce6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151661 May 12 07:13:03.756881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1028/1967] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:03.811150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cc3bad67-a9e4-4393-a3d8-faeaeed9f1e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:03.811793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cc3bad67-a9e4-4393-a3d8-faeaeed9f1e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:03.818263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc3bad67-a9e4-4393-a3d8-faeaeed9f1e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:03.819011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc3bad67-a9e4-4393-a3d8-faeaeed9f1e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:03.819846 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc3bad67-a9e4-4393-a3d8-faeaeed9f1e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:03.820888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc3bad67-a9e4-4393-a3d8-faeaeed9f1e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:03.885259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cc3bad67-a9e4-4393-a3d8-faeaeed9f1e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:03.892633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cc3bad67-a9e4-4393-a3d8-faeaeed9f1e0 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.085304 May 12 07:13:03.893193 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 940/1968] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:03 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:04.513642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-574c4639-c572-4bb3-b11e-f2162c1b111d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:13:04.514565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-574c4639-c572-4bb3-b11e-f2162c1b111d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:04.520351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-574c4639-c572-4bb3-b11e-f2162c1b111d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:04.524214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-574c4639-c572-4bb3-b11e-f2162c1b111d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:04.524214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-574c4639-c572-4bb3-b11e-f2162c1b111d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:04.524214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-574c4639-c572-4bb3-b11e-f2162c1b111d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:04.601109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-574c4639-c572-4bb3-b11e-f2162c1b111d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "POST /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/action" status: 200 len: 76254 microversion: 2.1 time: 0.091067 May 12 07:13:04.602675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1029/1969] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 07:13:04 2022] POST /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106/action => generated 76254 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 07:13:04.775720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-acb05d0f-7b22-4e7a-a442-3a63f33d19c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:04.776281 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-acb05d0f-7b22-4e7a-a442-3a63f33d19c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:04.782604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-acb05d0f-7b22-4e7a-a442-3a63f33d19c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:04.783046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-acb05d0f-7b22-4e7a-a442-3a63f33d19c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:04.783897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-acb05d0f-7b22-4e7a-a442-3a63f33d19c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:04.784333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-acb05d0f-7b22-4e7a-a442-3a63f33d19c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:04.909370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-acb05d0f-7b22-4e7a-a442-3a63f33d19c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:04.910011 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b9b814f2-6cd1-4669-bad2-afc402322543 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:04.910789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b9b814f2-6cd1-4669-bad2-afc402322543 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] [instance: 0f0fa87a-f20f-489f-b64c-04073a58a792] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:04.918272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9b814f2-6cd1-4669-bad2-afc402322543 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:04.918431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-acb05d0f-7b22-4e7a-a442-3a63f33d19c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:04.918724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9b814f2-6cd1-4669-bad2-afc402322543 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:04.919509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9b814f2-6cd1-4669-bad2-afc402322543 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:04.919956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-acb05d0f-7b22-4e7a-a442-3a63f33d19c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:04.920103 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9b814f2-6cd1-4669-bad2-afc402322543 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:04.921115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-acb05d0f-7b22-4e7a-a442-3a63f33d19c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150006 May 12 07:13:04.921672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 941/1970] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:04 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:04.981663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b9b814f2-6cd1-4669-bad2-afc402322543 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edf41df1d4940028966ad901d3f5847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9623ac5b3c664e44bf4e0bacb398a8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:04.989051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b9b814f2-6cd1-4669-bad2-afc402322543 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792" status: 200 len: 1214 microversion: 2.1 time: 0.083494 May 12 07:13:04.989624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1030/1971] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:04 2022] GET /compute/v2.1/servers/0f0fa87a-f20f-489f-b64c-04073a58a792 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:13:05.225372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9367587d-57a3-4006-ab2d-7e8ed80cef71 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] Calling method '.version_select at 0x7f89df5858b0>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:05.302752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9367587d-57a3-4006-ab2d-7e8ed80cef71 tempest-TestShelveInstance-666739515 tempest-TestShelveInstance-666739515-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1222361415" status: 202 len: 0 microversion: 2.1 time: 0.081145 May 12 07:13:05.304182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 942/1972] 10.222.0.25 () {58 vars in 1253 bytes} [Thu May 12 07:13:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1222361415 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:13:05.753455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a834c213-8040-4b96-b62d-91fe9a01e054 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:05.753962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a834c213-8040-4b96-b62d-91fe9a01e054 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:05.761251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a834c213-8040-4b96-b62d-91fe9a01e054 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:05.761701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a834c213-8040-4b96-b62d-91fe9a01e054 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:05.762490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a834c213-8040-4b96-b62d-91fe9a01e054 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:05.762925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a834c213-8040-4b96-b62d-91fe9a01e054 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:05.793692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a834c213-8040-4b96-b62d-91fe9a01e054 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:13:05.941032 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2c95ea3d-1db7-4a4b-b656-d9c700ba29a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:05.941689 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2c95ea3d-1db7-4a4b-b656-d9c700ba29a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:05.948227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c95ea3d-1db7-4a4b-b656-d9c700ba29a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:05.948683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c95ea3d-1db7-4a4b-b656-d9c700ba29a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:05.949466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c95ea3d-1db7-4a4b-b656-d9c700ba29a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:05.949907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c95ea3d-1db7-4a4b-b656-d9c700ba29a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:06.095018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2c95ea3d-1db7-4a4b-b656-d9c700ba29a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:06.104257 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2c95ea3d-1db7-4a4b-b656-d9c700ba29a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:06.105767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2c95ea3d-1db7-4a4b-b656-d9c700ba29a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:06.106936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2c95ea3d-1db7-4a4b-b656-d9c700ba29a7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.170513 May 12 07:13:06.107500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 943/1973] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:05 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:13:06.129652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a834c213-8040-4b96-b62d-91fe9a01e054 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 204 len: 0 microversion: 2.1 time: 0.379759 May 12 07:13:06.130273 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1031/1974] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:13:05 2022] DELETE /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:13:06.146218 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dffa7f4c-b2fa-4114-89d5-339115ff84e7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:06.146843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dffa7f4c-b2fa-4114-89d5-339115ff84e7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:06.152734 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dffa7f4c-b2fa-4114-89d5-339115ff84e7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:06.153191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dffa7f4c-b2fa-4114-89d5-339115ff84e7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:06.154006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dffa7f4c-b2fa-4114-89d5-339115ff84e7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:06.154449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dffa7f4c-b2fa-4114-89d5-339115ff84e7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:06.290259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dffa7f4c-b2fa-4114-89d5-339115ff84e7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:06.298005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dffa7f4c-b2fa-4114-89d5-339115ff84e7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.155954 May 12 07:13:06.299026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 944/1975] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:06 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:07.126902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-14724ec2-f3d0-4385-a71b-abfcccb1ada8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:07.127608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-14724ec2-f3d0-4385-a71b-abfcccb1ada8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:07.134483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14724ec2-f3d0-4385-a71b-abfcccb1ada8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:07.135047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14724ec2-f3d0-4385-a71b-abfcccb1ada8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:07.135723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14724ec2-f3d0-4385-a71b-abfcccb1ada8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:07.136165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14724ec2-f3d0-4385-a71b-abfcccb1ada8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:07.277968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-14724ec2-f3d0-4385-a71b-abfcccb1ada8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:07.286602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-14724ec2-f3d0-4385-a71b-abfcccb1ada8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:07.288264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-14724ec2-f3d0-4385-a71b-abfcccb1ada8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:07.290168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-14724ec2-f3d0-4385-a71b-abfcccb1ada8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.167539 May 12 07:13:07.290807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1032/1976] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:07 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:07.315615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b4ec54f9-eac7-423f-afca-c37851660407 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:07.316259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b4ec54f9-eac7-423f-afca-c37851660407 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:07.322511 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4ec54f9-eac7-423f-afca-c37851660407 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:07.322964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4ec54f9-eac7-423f-afca-c37851660407 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:07.323755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4ec54f9-eac7-423f-afca-c37851660407 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:07.324485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b4ec54f9-eac7-423f-afca-c37851660407 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:07.456585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b4ec54f9-eac7-423f-afca-c37851660407 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:07.465556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b4ec54f9-eac7-423f-afca-c37851660407 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.153685 May 12 07:13:07.474853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 945/1977] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:07 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:08.309663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1e4fce5e-f8f6-47f6-bbdd-352bc4a1056f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:08.310401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1e4fce5e-f8f6-47f6-bbdd-352bc4a1056f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:08.317354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e4fce5e-f8f6-47f6-bbdd-352bc4a1056f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:08.317902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e4fce5e-f8f6-47f6-bbdd-352bc4a1056f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:08.318765 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e4fce5e-f8f6-47f6-bbdd-352bc4a1056f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:08.319284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e4fce5e-f8f6-47f6-bbdd-352bc4a1056f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:08.510377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c6c08980-3298-4f79-93d5-22cea44a7662 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:08.510377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c6c08980-3298-4f79-93d5-22cea44a7662 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:08.510377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6c08980-3298-4f79-93d5-22cea44a7662 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:08.510377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6c08980-3298-4f79-93d5-22cea44a7662 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:08.511335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6c08980-3298-4f79-93d5-22cea44a7662 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:08.511335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6c08980-3298-4f79-93d5-22cea44a7662 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:08.594246 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1e4fce5e-f8f6-47f6-bbdd-352bc4a1056f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:08.605511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1e4fce5e-f8f6-47f6-bbdd-352bc4a1056f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:08.607033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1e4fce5e-f8f6-47f6-bbdd-352bc4a1056f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:08.608321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1e4fce5e-f8f6-47f6-bbdd-352bc4a1056f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.302696 May 12 07:13:08.609217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1033/1978] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:08.710290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c6c08980-3298-4f79-93d5-22cea44a7662 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:08.718296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c6c08980-3298-4f79-93d5-22cea44a7662 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.237069 May 12 07:13:08.718869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 946/1979] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:08 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:13:09.627032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-20e480f6-15fa-41ef-be67-004fd19edf44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:09.627615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-20e480f6-15fa-41ef-be67-004fd19edf44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:09.634782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20e480f6-15fa-41ef-be67-004fd19edf44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:09.635239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20e480f6-15fa-41ef-be67-004fd19edf44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:09.636057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20e480f6-15fa-41ef-be67-004fd19edf44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:09.636504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20e480f6-15fa-41ef-be67-004fd19edf44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:09.736793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2f7bbf57-c254-452b-92c9-995942947cfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:09.737417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2f7bbf57-c254-452b-92c9-995942947cfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:09.745051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f7bbf57-c254-452b-92c9-995942947cfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:09.745802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f7bbf57-c254-452b-92c9-995942947cfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:09.746614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f7bbf57-c254-452b-92c9-995942947cfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:09.747255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f7bbf57-c254-452b-92c9-995942947cfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:09.777271 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-20e480f6-15fa-41ef-be67-004fd19edf44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:09.786289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-20e480f6-15fa-41ef-be67-004fd19edf44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:09.787938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-20e480f6-15fa-41ef-be67-004fd19edf44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:09.789109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-20e480f6-15fa-41ef-be67-004fd19edf44 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.166178 May 12 07:13:09.789671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1034/1980] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:09.879148 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2f7bbf57-c254-452b-92c9-995942947cfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:09.887664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2f7bbf57-c254-452b-92c9-995942947cfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.154980 May 12 07:13:09.888470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 947/1981] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:09 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:10.810215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-996f7246-5b94-494b-a487-56fa193fb4e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:10.811191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-996f7246-5b94-494b-a487-56fa193fb4e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:10.818763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-996f7246-5b94-494b-a487-56fa193fb4e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:10.819215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-996f7246-5b94-494b-a487-56fa193fb4e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:10.820060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-996f7246-5b94-494b-a487-56fa193fb4e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:10.820526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-996f7246-5b94-494b-a487-56fa193fb4e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:10.904627 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d6344f51-997d-4c55-af78-ef9923261ec3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:10.905241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d6344f51-997d-4c55-af78-ef9923261ec3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:10.912442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6344f51-997d-4c55-af78-ef9923261ec3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:10.914287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6344f51-997d-4c55-af78-ef9923261ec3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:10.915939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6344f51-997d-4c55-af78-ef9923261ec3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:10.916994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6344f51-997d-4c55-af78-ef9923261ec3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:10.972211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-996f7246-5b94-494b-a487-56fa193fb4e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:10.981771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-996f7246-5b94-494b-a487-56fa193fb4e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:10.983429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-996f7246-5b94-494b-a487-56fa193fb4e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:10.984990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-996f7246-5b94-494b-a487-56fa193fb4e3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.179672 May 12 07:13:10.985666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1035/1982] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:10 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:11.060586 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d6344f51-997d-4c55-af78-ef9923261ec3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:11.068320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d6344f51-997d-4c55-af78-ef9923261ec3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.167542 May 12 07:13:11.068887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 948/1983] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:10 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:13:12.003381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a1bad498-e68e-4579-8328-d7d30e1a81a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:12.004026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a1bad498-e68e-4579-8328-d7d30e1a81a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:12.010311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1bad498-e68e-4579-8328-d7d30e1a81a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:12.010996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1bad498-e68e-4579-8328-d7d30e1a81a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:12.011979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1bad498-e68e-4579-8328-d7d30e1a81a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:12.012587 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1bad498-e68e-4579-8328-d7d30e1a81a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:12.085713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3128b43a-85bb-4dcb-a917-7f958e070b2d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:12.087093 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3128b43a-85bb-4dcb-a917-7f958e070b2d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:12.094470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3128b43a-85bb-4dcb-a917-7f958e070b2d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:12.095142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3128b43a-85bb-4dcb-a917-7f958e070b2d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:12.095650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3128b43a-85bb-4dcb-a917-7f958e070b2d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:12.101942 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3128b43a-85bb-4dcb-a917-7f958e070b2d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:12.191669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a1bad498-e68e-4579-8328-d7d30e1a81a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:12.201376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a1bad498-e68e-4579-8328-d7d30e1a81a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:12.202903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a1bad498-e68e-4579-8328-d7d30e1a81a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:12.204088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a1bad498-e68e-4579-8328-d7d30e1a81a1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.204601 May 12 07:13:12.204651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1036/1984] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:12.257833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3128b43a-85bb-4dcb-a917-7f958e070b2d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:12.265626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3128b43a-85bb-4dcb-a917-7f958e070b2d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.184297 May 12 07:13:12.266208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 949/1985] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:12 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:13:13.223029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e725145e-addd-4c21-b24e-0e5e3af5fe79 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:13.223713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e725145e-addd-4c21-b24e-0e5e3af5fe79 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:13.233335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e725145e-addd-4c21-b24e-0e5e3af5fe79 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:13.233335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e725145e-addd-4c21-b24e-0e5e3af5fe79 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:13.233335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e725145e-addd-4c21-b24e-0e5e3af5fe79 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:13.233335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e725145e-addd-4c21-b24e-0e5e3af5fe79 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:13.282254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f35d5271-4c10-4aaf-936c-b5d9d7be6cf4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:13.282858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f35d5271-4c10-4aaf-936c-b5d9d7be6cf4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:13.289751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f35d5271-4c10-4aaf-936c-b5d9d7be6cf4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:13.290210 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f35d5271-4c10-4aaf-936c-b5d9d7be6cf4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:13.290963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f35d5271-4c10-4aaf-936c-b5d9d7be6cf4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:13.291392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f35d5271-4c10-4aaf-936c-b5d9d7be6cf4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:13.400160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e725145e-addd-4c21-b24e-0e5e3af5fe79 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:13.408606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e725145e-addd-4c21-b24e-0e5e3af5fe79 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:13.410113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e725145e-addd-4c21-b24e-0e5e3af5fe79 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:13.411275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e725145e-addd-4c21-b24e-0e5e3af5fe79 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.192337 May 12 07:13:13.411914 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1037/1986] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:13.443476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f35d5271-4c10-4aaf-936c-b5d9d7be6cf4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:13.452114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f35d5271-4c10-4aaf-936c-b5d9d7be6cf4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.173510 May 12 07:13:13.453459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 950/1987] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:13 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:13:14.429780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2f9d9634-7fd1-4281-aa32-a68cd539abb1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:14.430948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2f9d9634-7fd1-4281-aa32-a68cd539abb1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:14.437201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f9d9634-7fd1-4281-aa32-a68cd539abb1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:14.437631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f9d9634-7fd1-4281-aa32-a68cd539abb1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:14.438401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f9d9634-7fd1-4281-aa32-a68cd539abb1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:14.438836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2f9d9634-7fd1-4281-aa32-a68cd539abb1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:14.471061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-debf1735-b841-4fe4-a7f7-fe929c691c37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:14.471801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-debf1735-b841-4fe4-a7f7-fe929c691c37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:14.479022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-debf1735-b841-4fe4-a7f7-fe929c691c37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:14.479826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-debf1735-b841-4fe4-a7f7-fe929c691c37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:14.480465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-debf1735-b841-4fe4-a7f7-fe929c691c37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:14.480978 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-debf1735-b841-4fe4-a7f7-fe929c691c37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:14.616602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2f9d9634-7fd1-4281-aa32-a68cd539abb1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:14.626015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2f9d9634-7fd1-4281-aa32-a68cd539abb1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:14.627817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2f9d9634-7fd1-4281-aa32-a68cd539abb1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:14.630187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2f9d9634-7fd1-4281-aa32-a68cd539abb1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.203102 May 12 07:13:14.639895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1038/1988] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:14 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:14.646411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-debf1735-b841-4fe4-a7f7-fe929c691c37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:14.659732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-debf1735-b841-4fe4-a7f7-fe929c691c37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.193689 May 12 07:13:14.660321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 951/1989] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:14 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:13:15.647183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8c694b92-ed06-4b43-8938-36f095c70e7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:15.647828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8c694b92-ed06-4b43-8938-36f095c70e7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:15.654722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c694b92-ed06-4b43-8938-36f095c70e7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:15.655184 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c694b92-ed06-4b43-8938-36f095c70e7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:15.655988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c694b92-ed06-4b43-8938-36f095c70e7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:15.656433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c694b92-ed06-4b43-8938-36f095c70e7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:15.677377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-21437156-54cd-4ea3-a190-64375ddd6573 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:15.678025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-21437156-54cd-4ea3-a190-64375ddd6573 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:15.684810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21437156-54cd-4ea3-a190-64375ddd6573 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:15.685460 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21437156-54cd-4ea3-a190-64375ddd6573 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:15.686441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21437156-54cd-4ea3-a190-64375ddd6573 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:15.686949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21437156-54cd-4ea3-a190-64375ddd6573 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:15.850066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8c694b92-ed06-4b43-8938-36f095c70e7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:15.857748 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-21437156-54cd-4ea3-a190-64375ddd6573 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:15.865938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-21437156-54cd-4ea3-a190-64375ddd6573 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.192605 May 12 07:13:15.866134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8c694b92-ed06-4b43-8938-36f095c70e7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:15.866740 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 952/1990] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:15 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:13:15.867472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8c694b92-ed06-4b43-8938-36f095c70e7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:15.868716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8c694b92-ed06-4b43-8938-36f095c70e7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.225384 May 12 07:13:15.879513 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1039/1991] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:16.884235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a2c86be4-9be2-4a14-9e40-9f637b9f5282 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:16.884852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a2c86be4-9be2-4a14-9e40-9f637b9f5282 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:16.886466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-021a7b54-171b-4504-a38c-d29eac4b3d28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:16.887667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-021a7b54-171b-4504-a38c-d29eac4b3d28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:16.891734 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2c86be4-9be2-4a14-9e40-9f637b9f5282 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:16.892418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2c86be4-9be2-4a14-9e40-9f637b9f5282 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:16.893202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2c86be4-9be2-4a14-9e40-9f637b9f5282 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:16.893784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2c86be4-9be2-4a14-9e40-9f637b9f5282 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:16.894152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-021a7b54-171b-4504-a38c-d29eac4b3d28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:16.894608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-021a7b54-171b-4504-a38c-d29eac4b3d28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:16.895499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-021a7b54-171b-4504-a38c-d29eac4b3d28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:16.895969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-021a7b54-171b-4504-a38c-d29eac4b3d28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:17.219085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a2c86be4-9be2-4a14-9e40-9f637b9f5282 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:17.225532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-021a7b54-171b-4504-a38c-d29eac4b3d28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:17.228619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a2c86be4-9be2-4a14-9e40-9f637b9f5282 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.348524 May 12 07:13:17.229490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 953/1992] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:16 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:17.245051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-021a7b54-171b-4504-a38c-d29eac4b3d28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:17.246597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-021a7b54-171b-4504-a38c-d29eac4b3d28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:17.247808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-021a7b54-171b-4504-a38c-d29eac4b3d28 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.365487 May 12 07:13:17.248432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1040/1993] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:13:18.246585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7f675e1e-010c-425a-91db-96f1ea2ebf10 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:18.247209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7f675e1e-010c-425a-91db-96f1ea2ebf10 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:18.255088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f675e1e-010c-425a-91db-96f1ea2ebf10 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:18.256392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f675e1e-010c-425a-91db-96f1ea2ebf10 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:18.257432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f675e1e-010c-425a-91db-96f1ea2ebf10 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:18.257881 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f675e1e-010c-425a-91db-96f1ea2ebf10 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:18.267151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-116cb645-ec40-4d16-8520-a5c32f626167 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:18.268526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-116cb645-ec40-4d16-8520-a5c32f626167 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:18.276921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-116cb645-ec40-4d16-8520-a5c32f626167 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:18.277375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-116cb645-ec40-4d16-8520-a5c32f626167 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:18.278206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-116cb645-ec40-4d16-8520-a5c32f626167 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:18.278649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-116cb645-ec40-4d16-8520-a5c32f626167 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:18.761648 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7f675e1e-010c-425a-91db-96f1ea2ebf10 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:18.770605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7f675e1e-010c-425a-91db-96f1ea2ebf10 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.528525 May 12 07:13:18.771502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 954/1994] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:18 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:18.785699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-116cb645-ec40-4d16-8520-a5c32f626167 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:18.795226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-116cb645-ec40-4d16-8520-a5c32f626167 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:18.797129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-116cb645-ec40-4d16-8520-a5c32f626167 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:18.798578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-116cb645-ec40-4d16-8520-a5c32f626167 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.535725 May 12 07:13:18.799213 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1041/1995] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:19.788006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b15aefc5-18d9-415d-9d5d-517c02eb0e1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:19.788685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b15aefc5-18d9-415d-9d5d-517c02eb0e1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:19.794859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b15aefc5-18d9-415d-9d5d-517c02eb0e1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:19.795304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b15aefc5-18d9-415d-9d5d-517c02eb0e1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:19.796102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b15aefc5-18d9-415d-9d5d-517c02eb0e1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:19.796535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b15aefc5-18d9-415d-9d5d-517c02eb0e1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:19.818179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-34176ca1-f19b-4a62-bbad-ab182ce4646c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:19.819536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-34176ca1-f19b-4a62-bbad-ab182ce4646c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:19.829108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34176ca1-f19b-4a62-bbad-ab182ce4646c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:19.829926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34176ca1-f19b-4a62-bbad-ab182ce4646c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:19.830722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34176ca1-f19b-4a62-bbad-ab182ce4646c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:19.831163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34176ca1-f19b-4a62-bbad-ab182ce4646c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:19.951976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b15aefc5-18d9-415d-9d5d-517c02eb0e1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:19.960895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b15aefc5-18d9-415d-9d5d-517c02eb0e1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.176702 May 12 07:13:19.972119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 955/1996] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:19 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:20.143597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-34176ca1-f19b-4a62-bbad-ab182ce4646c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:20.153277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-34176ca1-f19b-4a62-bbad-ab182ce4646c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:20.154786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-34176ca1-f19b-4a62-bbad-ab182ce4646c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:20.156267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-34176ca1-f19b-4a62-bbad-ab182ce4646c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.342675 May 12 07:13:20.157041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1042/1997] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:19 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:13:20.979922 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-60fabe69-b199-49ba-8929-4187634a2a60 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:20.980720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-60fabe69-b199-49ba-8929-4187634a2a60 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:20.987251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-60fabe69-b199-49ba-8929-4187634a2a60 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:20.987989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-60fabe69-b199-49ba-8929-4187634a2a60 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:20.988787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-60fabe69-b199-49ba-8929-4187634a2a60 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:20.989237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-60fabe69-b199-49ba-8929-4187634a2a60 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:21.028718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:13:21.029277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:13:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:13:21.171952 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-60fabe69-b199-49ba-8929-4187634a2a60 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:21.175035 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8b406e5a-2e42-4fff-8575-6d6abf158805 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:21.175654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8b406e5a-2e42-4fff-8575-6d6abf158805 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:21.184291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b406e5a-2e42-4fff-8575-6d6abf158805 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:21.184748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b406e5a-2e42-4fff-8575-6d6abf158805 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:21.185869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-60fabe69-b199-49ba-8929-4187634a2a60 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.211151 May 12 07:13:21.188423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b406e5a-2e42-4fff-8575-6d6abf158805 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:21.188881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b406e5a-2e42-4fff-8575-6d6abf158805 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:21.189241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 956/1998] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:20 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:21.384664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8b406e5a-2e42-4fff-8575-6d6abf158805 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:21.396695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8b406e5a-2e42-4fff-8575-6d6abf158805 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:21.398593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8b406e5a-2e42-4fff-8575-6d6abf158805 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:21.401126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8b406e5a-2e42-4fff-8575-6d6abf158805 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.230131 May 12 07:13:21.411857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1043/1999] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:13:22.206220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bf80437a-3877-469d-9539-aec1640cc83a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:22.206868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bf80437a-3877-469d-9539-aec1640cc83a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:22.214117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf80437a-3877-469d-9539-aec1640cc83a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:22.214752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf80437a-3877-469d-9539-aec1640cc83a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:22.215573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf80437a-3877-469d-9539-aec1640cc83a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:22.216225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf80437a-3877-469d-9539-aec1640cc83a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:22.346617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bf80437a-3877-469d-9539-aec1640cc83a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:22.355760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bf80437a-3877-469d-9539-aec1640cc83a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.153476 May 12 07:13:22.358092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 957/2000] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:22 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:22.426890 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-57382f7e-bb40-4d49-921a-7d1bc41e2ba1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:22.426890 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-57382f7e-bb40-4d49-921a-7d1bc41e2ba1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:22.429557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57382f7e-bb40-4d49-921a-7d1bc41e2ba1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:22.430323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57382f7e-bb40-4d49-921a-7d1bc41e2ba1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:22.431252 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57382f7e-bb40-4d49-921a-7d1bc41e2ba1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:22.432008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57382f7e-bb40-4d49-921a-7d1bc41e2ba1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:22.564393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-57382f7e-bb40-4d49-921a-7d1bc41e2ba1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:22.573693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-57382f7e-bb40-4d49-921a-7d1bc41e2ba1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:22.576460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-57382f7e-bb40-4d49-921a-7d1bc41e2ba1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:22.577666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-57382f7e-bb40-4d49-921a-7d1bc41e2ba1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.160973 May 12 07:13:22.578398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1044/2001] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:22 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:23.373813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d9ce9cea-1d6d-4a4f-9e80-f31b9e825c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:23.374480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d9ce9cea-1d6d-4a4f-9e80-f31b9e825c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:23.381287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d9ce9cea-1d6d-4a4f-9e80-f31b9e825c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:23.381745 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d9ce9cea-1d6d-4a4f-9e80-f31b9e825c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:23.382569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d9ce9cea-1d6d-4a4f-9e80-f31b9e825c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:23.383625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d9ce9cea-1d6d-4a4f-9e80-f31b9e825c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:23.530401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d9ce9cea-1d6d-4a4f-9e80-f31b9e825c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:23.538431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d9ce9cea-1d6d-4a4f-9e80-f31b9e825c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.168639 May 12 07:13:23.539017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 958/2002] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:23 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:23.603031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b6264e21-4631-49a7-9634-a9c36f1872f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:23.604431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b6264e21-4631-49a7-9634-a9c36f1872f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:23.614383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6264e21-4631-49a7-9634-a9c36f1872f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:23.614962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6264e21-4631-49a7-9634-a9c36f1872f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:23.616080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6264e21-4631-49a7-9634-a9c36f1872f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:23.616631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6264e21-4631-49a7-9634-a9c36f1872f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:23.798318 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b6264e21-4631-49a7-9634-a9c36f1872f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:23.814210 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b6264e21-4631-49a7-9634-a9c36f1872f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:23.816499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b6264e21-4631-49a7-9634-a9c36f1872f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:23.817958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b6264e21-4631-49a7-9634-a9c36f1872f0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.225295 May 12 07:13:23.818834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1045/2003] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:23 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:24.557937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4c201c8e-511d-4a96-b175-b3fcf70c2181 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:24.559504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4c201c8e-511d-4a96-b175-b3fcf70c2181 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:24.567943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c201c8e-511d-4a96-b175-b3fcf70c2181 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:24.568732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c201c8e-511d-4a96-b175-b3fcf70c2181 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:24.569899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c201c8e-511d-4a96-b175-b3fcf70c2181 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:24.571210 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c201c8e-511d-4a96-b175-b3fcf70c2181 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:24.729133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4c201c8e-511d-4a96-b175-b3fcf70c2181 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:24.738963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4c201c8e-511d-4a96-b175-b3fcf70c2181 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.185387 May 12 07:13:24.740250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 959/2004] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:24 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:24.837774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-94aa82f3-ae8a-41f7-baaa-0886bc2dcc06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:24.838412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-94aa82f3-ae8a-41f7-baaa-0886bc2dcc06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:24.845148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94aa82f3-ae8a-41f7-baaa-0886bc2dcc06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:24.850976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94aa82f3-ae8a-41f7-baaa-0886bc2dcc06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:24.850976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94aa82f3-ae8a-41f7-baaa-0886bc2dcc06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:24.850976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94aa82f3-ae8a-41f7-baaa-0886bc2dcc06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:25.031839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-94aa82f3-ae8a-41f7-baaa-0886bc2dcc06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:25.076907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-94aa82f3-ae8a-41f7-baaa-0886bc2dcc06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:25.078667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-94aa82f3-ae8a-41f7-baaa-0886bc2dcc06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:25.079882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-94aa82f3-ae8a-41f7-baaa-0886bc2dcc06 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.246522 May 12 07:13:25.080972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1046/2005] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:24 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:25.759284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0c81adee-c9b4-4762-b537-4e935a9de024 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:25.759956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0c81adee-c9b4-4762-b537-4e935a9de024 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:25.770045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c81adee-c9b4-4762-b537-4e935a9de024 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:25.772021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c81adee-c9b4-4762-b537-4e935a9de024 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:25.773266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c81adee-c9b4-4762-b537-4e935a9de024 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:25.773770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c81adee-c9b4-4762-b537-4e935a9de024 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:26.007342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0c81adee-c9b4-4762-b537-4e935a9de024 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:26.024085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0c81adee-c9b4-4762-b537-4e935a9de024 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.269944 May 12 07:13:26.025508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 960/2006] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:25 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:26.098570 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9be6a882-102c-4445-b3aa-328c2eb709e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:26.100517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9be6a882-102c-4445-b3aa-328c2eb709e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:26.111429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9be6a882-102c-4445-b3aa-328c2eb709e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:26.112249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9be6a882-102c-4445-b3aa-328c2eb709e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:26.113044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9be6a882-102c-4445-b3aa-328c2eb709e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:26.113687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9be6a882-102c-4445-b3aa-328c2eb709e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:26.339482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9be6a882-102c-4445-b3aa-328c2eb709e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:26.350154 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9be6a882-102c-4445-b3aa-328c2eb709e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:26.352427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9be6a882-102c-4445-b3aa-328c2eb709e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:26.353941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9be6a882-102c-4445-b3aa-328c2eb709e1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.259293 May 12 07:13:26.361113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1047/2007] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:26 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:27.041105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9cb69842-88f3-4fba-bf07-d114ceaa3ca5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:27.041717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9cb69842-88f3-4fba-bf07-d114ceaa3ca5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:27.048285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cb69842-88f3-4fba-bf07-d114ceaa3ca5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:27.048732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cb69842-88f3-4fba-bf07-d114ceaa3ca5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:27.049492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cb69842-88f3-4fba-bf07-d114ceaa3ca5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:27.049925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cb69842-88f3-4fba-bf07-d114ceaa3ca5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:27.327573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9cb69842-88f3-4fba-bf07-d114ceaa3ca5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:27.338967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9cb69842-88f3-4fba-bf07-d114ceaa3ca5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.301599 May 12 07:13:27.339985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 961/2008] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:27 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:27.373680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-78faaa24-de49-41b1-a615-cb77862d408c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:27.378731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-78faaa24-de49-41b1-a615-cb77862d408c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:27.396540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78faaa24-de49-41b1-a615-cb77862d408c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:27.401597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78faaa24-de49-41b1-a615-cb77862d408c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:27.403472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78faaa24-de49-41b1-a615-cb77862d408c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:27.404166 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78faaa24-de49-41b1-a615-cb77862d408c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:27.652758 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-78faaa24-de49-41b1-a615-cb77862d408c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:27.661413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-78faaa24-de49-41b1-a615-cb77862d408c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:27.663204 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-78faaa24-de49-41b1-a615-cb77862d408c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:27.665197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-78faaa24-de49-41b1-a615-cb77862d408c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.296117 May 12 07:13:27.666253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1048/2009] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:27 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:27.998266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0221a021-a6da-4ae6-b1e7-99aef7636c27 tempest-TestVolumeBootPattern-728057823 tempest-TestVolumeBootPattern-728057823-project] Action: 'create', calling method: .version_select at 0x7f89df58ae50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1041594724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEh2g2y0QSC1ZE58/3CX3MXtJbdJuaD9tv/P6EFB2NywVBszy+6FxM/KFgyS/YMi+h7zOjHVcsF/ZgM7GDvrjEPI4TgVqQBCwd17U9y7FQEtPGC7YULp11X/HY54RQtbw=="}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:13:28.012653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-0221a021-a6da-4ae6-b1e7-99aef7636c27 tempest-TestVolumeBootPattern-728057823 tempest-TestVolumeBootPattern-728057823-project] Getting quotas for project c8f49f13fc76471cab47c7270da89297. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 07:13:28.016372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-0221a021-a6da-4ae6-b1e7-99aef7636c27 tempest-TestVolumeBootPattern-728057823 tempest-TestVolumeBootPattern-728057823-project] Getting quotas for user 9caf2e62387840e5ab72b3abe34f5008 and project c8f49f13fc76471cab47c7270da89297. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 07:13:28.107170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0221a021-a6da-4ae6-b1e7-99aef7636c27 tempest-TestVolumeBootPattern-728057823 tempest-TestVolumeBootPattern-728057823-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.265550 May 12 07:13:28.107988 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 962/2010] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 12 07:13:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:13:28.357067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-49098fa7-1880-422c-9e46-ff493483be25 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:28.357679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-49098fa7-1880-422c-9e46-ff493483be25 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:28.363487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49098fa7-1880-422c-9e46-ff493483be25 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:28.363965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49098fa7-1880-422c-9e46-ff493483be25 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:28.364737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49098fa7-1880-422c-9e46-ff493483be25 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:28.365177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-49098fa7-1880-422c-9e46-ff493483be25 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:28.499548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-49098fa7-1880-422c-9e46-ff493483be25 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:28.507332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-49098fa7-1880-422c-9e46-ff493483be25 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.154089 May 12 07:13:28.508122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1049/2011] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:28 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:28.684767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-23fb2bcb-ee40-4a70-a4d1-d8b98b57b4e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:28.685386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-23fb2bcb-ee40-4a70-a4d1-d8b98b57b4e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:28.691320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23fb2bcb-ee40-4a70-a4d1-d8b98b57b4e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:28.691808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23fb2bcb-ee40-4a70-a4d1-d8b98b57b4e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:28.692587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23fb2bcb-ee40-4a70-a4d1-d8b98b57b4e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:28.693029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-23fb2bcb-ee40-4a70-a4d1-d8b98b57b4e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:28.827010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-23fb2bcb-ee40-4a70-a4d1-d8b98b57b4e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:28.837907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-23fb2bcb-ee40-4a70-a4d1-d8b98b57b4e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:28.839530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-23fb2bcb-ee40-4a70-a4d1-d8b98b57b4e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:28.840886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-23fb2bcb-ee40-4a70-a4d1-d8b98b57b4e7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.160050 May 12 07:13:28.841637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 963/2012] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:28 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:29.525473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c8c3c69c-ffe0-484f-9919-c17f9442577c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:29.526727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c8c3c69c-ffe0-484f-9919-c17f9442577c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:29.533965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8c3c69c-ffe0-484f-9919-c17f9442577c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:29.534400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8c3c69c-ffe0-484f-9919-c17f9442577c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:29.535192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8c3c69c-ffe0-484f-9919-c17f9442577c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:29.535678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8c3c69c-ffe0-484f-9919-c17f9442577c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:29.691861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c8c3c69c-ffe0-484f-9919-c17f9442577c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:29.707669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c8c3c69c-ffe0-484f-9919-c17f9442577c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.186738 May 12 07:13:29.708626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1050/2013] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:29 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:29.860417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f4ea8fe8-3dbb-42d6-be95-3f967c459007 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:29.861183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f4ea8fe8-3dbb-42d6-be95-3f967c459007 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:29.868523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f4ea8fe8-3dbb-42d6-be95-3f967c459007 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:29.869217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f4ea8fe8-3dbb-42d6-be95-3f967c459007 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:29.870206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f4ea8fe8-3dbb-42d6-be95-3f967c459007 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:29.870816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f4ea8fe8-3dbb-42d6-be95-3f967c459007 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:30.013857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f4ea8fe8-3dbb-42d6-be95-3f967c459007 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:30.022317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f4ea8fe8-3dbb-42d6-be95-3f967c459007 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:30.023966 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f4ea8fe8-3dbb-42d6-be95-3f967c459007 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:30.025146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f4ea8fe8-3dbb-42d6-be95-3f967c459007 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.168792 May 12 07:13:30.025647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 964/2014] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:29 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:30.725165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-138e5375-d9e1-4ed2-94f1-564902e7974e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:30.725710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-138e5375-d9e1-4ed2-94f1-564902e7974e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:30.732878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-138e5375-d9e1-4ed2-94f1-564902e7974e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:30.733327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-138e5375-d9e1-4ed2-94f1-564902e7974e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:30.734114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-138e5375-d9e1-4ed2-94f1-564902e7974e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:30.734559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-138e5375-d9e1-4ed2-94f1-564902e7974e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:30.865738 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-138e5375-d9e1-4ed2-94f1-564902e7974e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:30.873732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-138e5375-d9e1-4ed2-94f1-564902e7974e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.152511 May 12 07:13:30.874301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1051/2015] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:30 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:31.043668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2b936dfa-a25f-4b64-b47c-c3f273ce3b45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:31.044298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2b936dfa-a25f-4b64-b47c-c3f273ce3b45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:31.050490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b936dfa-a25f-4b64-b47c-c3f273ce3b45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:31.050933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b936dfa-a25f-4b64-b47c-c3f273ce3b45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:31.051707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b936dfa-a25f-4b64-b47c-c3f273ce3b45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:31.052149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b936dfa-a25f-4b64-b47c-c3f273ce3b45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:31.180637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2b936dfa-a25f-4b64-b47c-c3f273ce3b45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:31.188994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2b936dfa-a25f-4b64-b47c-c3f273ce3b45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:31.190507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2b936dfa-a25f-4b64-b47c-c3f273ce3b45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:31.191679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2b936dfa-a25f-4b64-b47c-c3f273ce3b45 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152037 May 12 07:13:31.192522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 965/2016] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:31 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:31.891462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6e3895d0-fdfb-4cf9-bb0f-eab9c00a65a5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:31.892154 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6e3895d0-fdfb-4cf9-bb0f-eab9c00a65a5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:31.898699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e3895d0-fdfb-4cf9-bb0f-eab9c00a65a5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:31.899160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e3895d0-fdfb-4cf9-bb0f-eab9c00a65a5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:31.899973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e3895d0-fdfb-4cf9-bb0f-eab9c00a65a5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:31.900416 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e3895d0-fdfb-4cf9-bb0f-eab9c00a65a5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:32.036028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6e3895d0-fdfb-4cf9-bb0f-eab9c00a65a5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:32.044634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6e3895d0-fdfb-4cf9-bb0f-eab9c00a65a5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.157048 May 12 07:13:32.045197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1052/2017] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:31 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:32.211339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b8e6be38-9d00-4488-8573-929b90166de5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:32.212012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b8e6be38-9d00-4488-8573-929b90166de5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:32.218324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e6be38-9d00-4488-8573-929b90166de5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:32.218782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e6be38-9d00-4488-8573-929b90166de5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:32.219557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e6be38-9d00-4488-8573-929b90166de5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:32.220042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e6be38-9d00-4488-8573-929b90166de5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:32.348260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8e6be38-9d00-4488-8573-929b90166de5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:32.357095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8e6be38-9d00-4488-8573-929b90166de5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:32.358617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8e6be38-9d00-4488-8573-929b90166de5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:32.359814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b8e6be38-9d00-4488-8573-929b90166de5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152902 May 12 07:13:32.360376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 966/2018] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:32 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:33.061648 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-06fcf070-860a-49de-a491-f35591d18068 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:33.062269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-06fcf070-860a-49de-a491-f35591d18068 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:33.068572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-06fcf070-860a-49de-a491-f35591d18068 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:33.069022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-06fcf070-860a-49de-a491-f35591d18068 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:33.069795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-06fcf070-860a-49de-a491-f35591d18068 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:33.070278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-06fcf070-860a-49de-a491-f35591d18068 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:33.194035 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-06fcf070-860a-49de-a491-f35591d18068 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:33.202311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-06fcf070-860a-49de-a491-f35591d18068 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144530 May 12 07:13:33.202875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1053/2019] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:33 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:33.378132 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b34636d4-a9b1-4e3b-9c1a-bd612e31c803 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:33.378751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b34636d4-a9b1-4e3b-9c1a-bd612e31c803 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:33.385595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b34636d4-a9b1-4e3b-9c1a-bd612e31c803 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:33.386057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b34636d4-a9b1-4e3b-9c1a-bd612e31c803 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:33.386831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b34636d4-a9b1-4e3b-9c1a-bd612e31c803 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:33.387275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b34636d4-a9b1-4e3b-9c1a-bd612e31c803 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:33.512050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b34636d4-a9b1-4e3b-9c1a-bd612e31c803 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:33.520205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b34636d4-a9b1-4e3b-9c1a-bd612e31c803 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:33.521699 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b34636d4-a9b1-4e3b-9c1a-bd612e31c803 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:33.522865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b34636d4-a9b1-4e3b-9c1a-bd612e31c803 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148692 May 12 07:13:33.523432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 967/2020] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:33 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:34.219956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b7d9fee6-2bdc-408f-954e-846b13244659 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:34.220482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b7d9fee6-2bdc-408f-954e-846b13244659 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:34.227483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7d9fee6-2bdc-408f-954e-846b13244659 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:34.227988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7d9fee6-2bdc-408f-954e-846b13244659 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:34.228764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7d9fee6-2bdc-408f-954e-846b13244659 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:34.229226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b7d9fee6-2bdc-408f-954e-846b13244659 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:34.358386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b7d9fee6-2bdc-408f-954e-846b13244659 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:34.366135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b7d9fee6-2bdc-408f-954e-846b13244659 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150106 May 12 07:13:34.366708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1054/2021] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:34 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:34.542181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4ebb3a94-c22e-408d-9610-d6a22a2aef3c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:34.542900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4ebb3a94-c22e-408d-9610-d6a22a2aef3c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:34.549530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4ebb3a94-c22e-408d-9610-d6a22a2aef3c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:34.549968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4ebb3a94-c22e-408d-9610-d6a22a2aef3c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:34.550769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4ebb3a94-c22e-408d-9610-d6a22a2aef3c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:34.551204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4ebb3a94-c22e-408d-9610-d6a22a2aef3c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:34.678520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4ebb3a94-c22e-408d-9610-d6a22a2aef3c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:34.686908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4ebb3a94-c22e-408d-9610-d6a22a2aef3c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:34.688445 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4ebb3a94-c22e-408d-9610-d6a22a2aef3c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:34.689614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4ebb3a94-c22e-408d-9610-d6a22a2aef3c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152365 May 12 07:13:34.690173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 968/2022] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:34 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:35.383064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-64111aa9-eab2-405d-88f3-2db76e12cca9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:35.383702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-64111aa9-eab2-405d-88f3-2db76e12cca9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:35.389993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64111aa9-eab2-405d-88f3-2db76e12cca9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:35.390445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64111aa9-eab2-405d-88f3-2db76e12cca9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:35.391216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64111aa9-eab2-405d-88f3-2db76e12cca9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:35.391652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-64111aa9-eab2-405d-88f3-2db76e12cca9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:35.708718 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e814a426-fe86-4991-b2bd-337f0a329782 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:35.709239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e814a426-fe86-4991-b2bd-337f0a329782 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:35.715813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e814a426-fe86-4991-b2bd-337f0a329782 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:35.716262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e814a426-fe86-4991-b2bd-337f0a329782 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:35.717044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e814a426-fe86-4991-b2bd-337f0a329782 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:35.717480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e814a426-fe86-4991-b2bd-337f0a329782 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:35.769452 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-64111aa9-eab2-405d-88f3-2db76e12cca9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:35.778566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-64111aa9-eab2-405d-88f3-2db76e12cca9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.399863 May 12 07:13:35.779164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1055/2023] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:35 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:36.004442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e814a426-fe86-4991-b2bd-337f0a329782 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:36.012563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e814a426-fe86-4991-b2bd-337f0a329782 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:36.014043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e814a426-fe86-4991-b2bd-337f0a329782 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:36.015192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e814a426-fe86-4991-b2bd-337f0a329782 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.310500 May 12 07:13:36.015768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 969/2024] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:35 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:13:36.573646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:13:36.574192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:13:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:13:36.795408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-569dd027-e6a5-4ec2-a515-f58d03d901f5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:36.796082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-569dd027-e6a5-4ec2-a515-f58d03d901f5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:36.802569 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-569dd027-e6a5-4ec2-a515-f58d03d901f5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:36.803014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-569dd027-e6a5-4ec2-a515-f58d03d901f5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:36.803813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-569dd027-e6a5-4ec2-a515-f58d03d901f5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:36.804745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-569dd027-e6a5-4ec2-a515-f58d03d901f5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:36.933703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-569dd027-e6a5-4ec2-a515-f58d03d901f5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:36.941517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-569dd027-e6a5-4ec2-a515-f58d03d901f5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149896 May 12 07:13:36.942089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1056/2025] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:36 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:37.033752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e12cbd46-4f0e-4243-b3c6-46466a8c17be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:37.034375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e12cbd46-4f0e-4243-b3c6-46466a8c17be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:37.041194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e12cbd46-4f0e-4243-b3c6-46466a8c17be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:37.041650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e12cbd46-4f0e-4243-b3c6-46466a8c17be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:37.042424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e12cbd46-4f0e-4243-b3c6-46466a8c17be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:37.042865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e12cbd46-4f0e-4243-b3c6-46466a8c17be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:37.166455 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e12cbd46-4f0e-4243-b3c6-46466a8c17be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:37.174924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e12cbd46-4f0e-4243-b3c6-46466a8c17be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:37.176497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e12cbd46-4f0e-4243-b3c6-46466a8c17be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:37.177676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e12cbd46-4f0e-4243-b3c6-46466a8c17be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147872 May 12 07:13:37.178223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 970/2026] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:37 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:37.958344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-75fb1e4a-a8a7-450a-b475-874ee8e4dde1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:37.958960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-75fb1e4a-a8a7-450a-b475-874ee8e4dde1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:37.965996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75fb1e4a-a8a7-450a-b475-874ee8e4dde1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:37.966448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75fb1e4a-a8a7-450a-b475-874ee8e4dde1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:37.967222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75fb1e4a-a8a7-450a-b475-874ee8e4dde1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:37.967668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-75fb1e4a-a8a7-450a-b475-874ee8e4dde1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:38.091446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-75fb1e4a-a8a7-450a-b475-874ee8e4dde1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:38.099188 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-75fb1e4a-a8a7-450a-b475-874ee8e4dde1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144781 May 12 07:13:38.099778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1057/2027] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:37 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:38.197574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b8831855-0606-4341-985e-877021e954a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:38.198202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b8831855-0606-4341-985e-877021e954a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:38.204765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8831855-0606-4341-985e-877021e954a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:38.205212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8831855-0606-4341-985e-877021e954a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:38.206050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8831855-0606-4341-985e-877021e954a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:38.206483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8831855-0606-4341-985e-877021e954a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:38.334526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8831855-0606-4341-985e-877021e954a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:38.342867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8831855-0606-4341-985e-877021e954a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:38.344903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8831855-0606-4341-985e-877021e954a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:38.345733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b8831855-0606-4341-985e-877021e954a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152861 May 12 07:13:38.346282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 971/2028] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:38 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:39.116309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4a1d7ab7-1410-4cdc-994a-c123b8b21aa3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:39.117005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4a1d7ab7-1410-4cdc-994a-c123b8b21aa3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:39.123353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a1d7ab7-1410-4cdc-994a-c123b8b21aa3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:39.123845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a1d7ab7-1410-4cdc-994a-c123b8b21aa3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:39.124623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a1d7ab7-1410-4cdc-994a-c123b8b21aa3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:39.125064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a1d7ab7-1410-4cdc-994a-c123b8b21aa3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:39.265331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4a1d7ab7-1410-4cdc-994a-c123b8b21aa3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:39.274797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4a1d7ab7-1410-4cdc-994a-c123b8b21aa3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.162546 May 12 07:13:39.275636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1058/2029] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:39 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:39.364380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e9d4113e-fa5f-4550-a090-79244ea1aa5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:39.365006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e9d4113e-fa5f-4550-a090-79244ea1aa5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:39.371342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e9d4113e-fa5f-4550-a090-79244ea1aa5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:39.371863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e9d4113e-fa5f-4550-a090-79244ea1aa5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:39.372631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e9d4113e-fa5f-4550-a090-79244ea1aa5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:39.373075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e9d4113e-fa5f-4550-a090-79244ea1aa5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:39.499596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e9d4113e-fa5f-4550-a090-79244ea1aa5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:39.507850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e9d4113e-fa5f-4550-a090-79244ea1aa5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:39.509365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e9d4113e-fa5f-4550-a090-79244ea1aa5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:39.511315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e9d4113e-fa5f-4550-a090-79244ea1aa5f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150044 May 12 07:13:39.511899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 972/2030] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:39 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:40.291776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-37126db3-7472-4f3a-8a47-63cf4d4c41a2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:40.292386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-37126db3-7472-4f3a-8a47-63cf4d4c41a2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:40.298879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37126db3-7472-4f3a-8a47-63cf4d4c41a2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:40.299326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37126db3-7472-4f3a-8a47-63cf4d4c41a2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:40.300113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37126db3-7472-4f3a-8a47-63cf4d4c41a2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:40.300550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-37126db3-7472-4f3a-8a47-63cf4d4c41a2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:40.425808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-37126db3-7472-4f3a-8a47-63cf4d4c41a2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:40.433539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-37126db3-7472-4f3a-8a47-63cf4d4c41a2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146256 May 12 07:13:40.434141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1059/2031] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:40 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:40.530075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ff9a5ce5-ecb9-4679-83dc-6172c53bfa36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:40.530680 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ff9a5ce5-ecb9-4679-83dc-6172c53bfa36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:40.536920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff9a5ce5-ecb9-4679-83dc-6172c53bfa36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:40.537375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff9a5ce5-ecb9-4679-83dc-6172c53bfa36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:40.538138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff9a5ce5-ecb9-4679-83dc-6172c53bfa36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:40.538573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff9a5ce5-ecb9-4679-83dc-6172c53bfa36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:40.667466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ff9a5ce5-ecb9-4679-83dc-6172c53bfa36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:40.676033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ff9a5ce5-ecb9-4679-83dc-6172c53bfa36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:40.677704 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ff9a5ce5-ecb9-4679-83dc-6172c53bfa36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:40.678690 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ff9a5ce5-ecb9-4679-83dc-6172c53bfa36 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152460 May 12 07:13:40.679253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 973/2032] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:40 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:41.450367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9ad88768-49e8-4a02-a236-856ac73479e1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:41.450984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9ad88768-49e8-4a02-a236-856ac73479e1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:41.457296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ad88768-49e8-4a02-a236-856ac73479e1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:41.457752 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ad88768-49e8-4a02-a236-856ac73479e1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:41.458522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ad88768-49e8-4a02-a236-856ac73479e1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:41.458959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ad88768-49e8-4a02-a236-856ac73479e1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:41.582457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9ad88768-49e8-4a02-a236-856ac73479e1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:41.590199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9ad88768-49e8-4a02-a236-856ac73479e1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143720 May 12 07:13:41.590770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1060/2033] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:41 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:41.696527 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-99e4f27b-027f-47ed-ace5-a01728e1632c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:41.697174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-99e4f27b-027f-47ed-ace5-a01728e1632c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:41.703542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e4f27b-027f-47ed-ace5-a01728e1632c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:41.704034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e4f27b-027f-47ed-ace5-a01728e1632c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:41.704808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e4f27b-027f-47ed-ace5-a01728e1632c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:41.705248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e4f27b-027f-47ed-ace5-a01728e1632c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:41.829641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-99e4f27b-027f-47ed-ace5-a01728e1632c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:41.838317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-99e4f27b-027f-47ed-ace5-a01728e1632c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:41.840612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-99e4f27b-027f-47ed-ace5-a01728e1632c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:41.841052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-99e4f27b-027f-47ed-ace5-a01728e1632c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148455 May 12 07:13:41.841638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 974/2034] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:41 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:42.606372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7cdd968f-094f-487b-afec-b0cc5b6b8116 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:42.607009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7cdd968f-094f-487b-afec-b0cc5b6b8116 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:42.613313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cdd968f-094f-487b-afec-b0cc5b6b8116 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:42.613758 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cdd968f-094f-487b-afec-b0cc5b6b8116 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:42.614519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cdd968f-094f-487b-afec-b0cc5b6b8116 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:42.614949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cdd968f-094f-487b-afec-b0cc5b6b8116 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:42.749040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7cdd968f-094f-487b-afec-b0cc5b6b8116 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:42.756733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7cdd968f-094f-487b-afec-b0cc5b6b8116 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.154205 May 12 07:13:42.757288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1061/2035] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:42 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:42.859407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-322995c4-885c-4c9d-904e-8f65ed4a3676 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:42.860041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-322995c4-885c-4c9d-904e-8f65ed4a3676 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:42.866277 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-322995c4-885c-4c9d-904e-8f65ed4a3676 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:42.866733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-322995c4-885c-4c9d-904e-8f65ed4a3676 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:42.867623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-322995c4-885c-4c9d-904e-8f65ed4a3676 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:42.868762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-322995c4-885c-4c9d-904e-8f65ed4a3676 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:42.994735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-322995c4-885c-4c9d-904e-8f65ed4a3676 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:43.002991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-322995c4-885c-4c9d-904e-8f65ed4a3676 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:43.004562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-322995c4-885c-4c9d-904e-8f65ed4a3676 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:43.005723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-322995c4-885c-4c9d-904e-8f65ed4a3676 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150315 May 12 07:13:43.006272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 975/2036] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:42 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:43.774688 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-20446f1f-2e08-453b-a9e9-e3b548dcd16c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:43.775292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-20446f1f-2e08-453b-a9e9-e3b548dcd16c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:43.781597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20446f1f-2e08-453b-a9e9-e3b548dcd16c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:43.782044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20446f1f-2e08-453b-a9e9-e3b548dcd16c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:43.782810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20446f1f-2e08-453b-a9e9-e3b548dcd16c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:43.783239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-20446f1f-2e08-453b-a9e9-e3b548dcd16c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:43.911010 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-20446f1f-2e08-453b-a9e9-e3b548dcd16c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:43.919015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-20446f1f-2e08-453b-a9e9-e3b548dcd16c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148778 May 12 07:13:43.919729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1062/2037] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:43 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:44.024413 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-61ad1fdf-0453-4bac-8e92-5ece23258675 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:44.025109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-61ad1fdf-0453-4bac-8e92-5ece23258675 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:44.031281 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61ad1fdf-0453-4bac-8e92-5ece23258675 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:44.031757 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61ad1fdf-0453-4bac-8e92-5ece23258675 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:44.032525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61ad1fdf-0453-4bac-8e92-5ece23258675 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:44.032959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61ad1fdf-0453-4bac-8e92-5ece23258675 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:44.157478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-61ad1fdf-0453-4bac-8e92-5ece23258675 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:44.165580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-61ad1fdf-0453-4bac-8e92-5ece23258675 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:44.167073 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-61ad1fdf-0453-4bac-8e92-5ece23258675 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:44.168256 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-61ad1fdf-0453-4bac-8e92-5ece23258675 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147748 May 12 07:13:44.168802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 976/2038] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:44 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:44.936008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-feff8275-ee7b-42f1-abbb-7bc19b1c75d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:44.936629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-feff8275-ee7b-42f1-abbb-7bc19b1c75d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:44.942884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feff8275-ee7b-42f1-abbb-7bc19b1c75d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:44.943336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feff8275-ee7b-42f1-abbb-7bc19b1c75d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:44.944178 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feff8275-ee7b-42f1-abbb-7bc19b1c75d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:44.944641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-feff8275-ee7b-42f1-abbb-7bc19b1c75d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:45.070521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-feff8275-ee7b-42f1-abbb-7bc19b1c75d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:45.078765 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-feff8275-ee7b-42f1-abbb-7bc19b1c75d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146691 May 12 07:13:45.079332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1063/2039] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:44 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:45.187030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9499bb39-b05f-446d-98e2-7c9bc8be9bd9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:45.187615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9499bb39-b05f-446d-98e2-7c9bc8be9bd9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:45.194007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9499bb39-b05f-446d-98e2-7c9bc8be9bd9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:45.194462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9499bb39-b05f-446d-98e2-7c9bc8be9bd9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:45.195239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9499bb39-b05f-446d-98e2-7c9bc8be9bd9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:45.195679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9499bb39-b05f-446d-98e2-7c9bc8be9bd9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:45.322096 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9499bb39-b05f-446d-98e2-7c9bc8be9bd9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:45.330240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9499bb39-b05f-446d-98e2-7c9bc8be9bd9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:45.331753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9499bb39-b05f-446d-98e2-7c9bc8be9bd9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:45.332910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9499bb39-b05f-446d-98e2-7c9bc8be9bd9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149890 May 12 07:13:45.333465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 977/2040] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:45 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:46.095823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c5f3b918-84ff-4138-b8ef-a512ddf1297f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:46.096440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c5f3b918-84ff-4138-b8ef-a512ddf1297f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:46.102715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5f3b918-84ff-4138-b8ef-a512ddf1297f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:46.103211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5f3b918-84ff-4138-b8ef-a512ddf1297f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:46.104018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5f3b918-84ff-4138-b8ef-a512ddf1297f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:46.104458 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5f3b918-84ff-4138-b8ef-a512ddf1297f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:46.227671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c5f3b918-84ff-4138-b8ef-a512ddf1297f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:46.235365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c5f3b918-84ff-4138-b8ef-a512ddf1297f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143486 May 12 07:13:46.235972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1064/2041] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:46 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:46.351507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-37d2e8f7-d1a7-4ed9-8616-ee6e48072420 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:46.352096 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-37d2e8f7-d1a7-4ed9-8616-ee6e48072420 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:46.358393 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-37d2e8f7-d1a7-4ed9-8616-ee6e48072420 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:46.358839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-37d2e8f7-d1a7-4ed9-8616-ee6e48072420 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:46.359604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-37d2e8f7-d1a7-4ed9-8616-ee6e48072420 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:46.360066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-37d2e8f7-d1a7-4ed9-8616-ee6e48072420 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:46.488371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-37d2e8f7-d1a7-4ed9-8616-ee6e48072420 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:46.497000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-37d2e8f7-d1a7-4ed9-8616-ee6e48072420 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:46.498481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-37d2e8f7-d1a7-4ed9-8616-ee6e48072420 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:46.499636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-37d2e8f7-d1a7-4ed9-8616-ee6e48072420 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152074 May 12 07:13:46.500247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 978/2042] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:46 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:47.253485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c3ea1988-5946-493c-b1dd-a09078b24528 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:47.254033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c3ea1988-5946-493c-b1dd-a09078b24528 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:47.260364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3ea1988-5946-493c-b1dd-a09078b24528 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:47.260847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3ea1988-5946-493c-b1dd-a09078b24528 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:47.261617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3ea1988-5946-493c-b1dd-a09078b24528 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:47.262059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c3ea1988-5946-493c-b1dd-a09078b24528 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:47.385208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c3ea1988-5946-493c-b1dd-a09078b24528 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:47.392970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c3ea1988-5946-493c-b1dd-a09078b24528 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143471 May 12 07:13:47.393545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1065/2043] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:47 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:47.517817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-aed95fea-f5f2-4e93-90c2-955ec0d02bd7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:47.518365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-aed95fea-f5f2-4e93-90c2-955ec0d02bd7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:47.525276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aed95fea-f5f2-4e93-90c2-955ec0d02bd7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:47.525730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aed95fea-f5f2-4e93-90c2-955ec0d02bd7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:47.526503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aed95fea-f5f2-4e93-90c2-955ec0d02bd7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:47.526941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aed95fea-f5f2-4e93-90c2-955ec0d02bd7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:47.653747 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aed95fea-f5f2-4e93-90c2-955ec0d02bd7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:47.662126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aed95fea-f5f2-4e93-90c2-955ec0d02bd7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:47.663619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aed95fea-f5f2-4e93-90c2-955ec0d02bd7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:47.664869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-aed95fea-f5f2-4e93-90c2-955ec0d02bd7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151000 May 12 07:13:47.665470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 979/2044] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:47 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:48.410354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-29a132ef-1f48-48cf-ba35-25626351c1f7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:48.410904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-29a132ef-1f48-48cf-ba35-25626351c1f7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:48.417271 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29a132ef-1f48-48cf-ba35-25626351c1f7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:48.417727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29a132ef-1f48-48cf-ba35-25626351c1f7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:48.418501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29a132ef-1f48-48cf-ba35-25626351c1f7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:48.418941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29a132ef-1f48-48cf-ba35-25626351c1f7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:48.543090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-29a132ef-1f48-48cf-ba35-25626351c1f7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:48.551085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-29a132ef-1f48-48cf-ba35-25626351c1f7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144709 May 12 07:13:48.551657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1066/2045] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:48 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:48.684325 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9be0c2d5-64c8-4d17-91c0-f385bb0debb8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:48.684854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9be0c2d5-64c8-4d17-91c0-f385bb0debb8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:48.691104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9be0c2d5-64c8-4d17-91c0-f385bb0debb8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:48.691552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9be0c2d5-64c8-4d17-91c0-f385bb0debb8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:48.692349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9be0c2d5-64c8-4d17-91c0-f385bb0debb8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:48.692785 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9be0c2d5-64c8-4d17-91c0-f385bb0debb8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:48.817991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9be0c2d5-64c8-4d17-91c0-f385bb0debb8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:48.826117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9be0c2d5-64c8-4d17-91c0-f385bb0debb8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:48.827604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9be0c2d5-64c8-4d17-91c0-f385bb0debb8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:48.828780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9be0c2d5-64c8-4d17-91c0-f385bb0debb8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149011 May 12 07:13:48.829335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 980/2046] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:48 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:49.567907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4f3a6e87-e300-4a14-a538-4ff633941cc6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:49.568527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4f3a6e87-e300-4a14-a538-4ff633941cc6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:49.575460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f3a6e87-e300-4a14-a538-4ff633941cc6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:49.575941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f3a6e87-e300-4a14-a538-4ff633941cc6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:49.576710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f3a6e87-e300-4a14-a538-4ff633941cc6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:49.577153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f3a6e87-e300-4a14-a538-4ff633941cc6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:49.705123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4f3a6e87-e300-4a14-a538-4ff633941cc6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:49.712840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4f3a6e87-e300-4a14-a538-4ff633941cc6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148814 May 12 07:13:49.713417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1067/2047] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:49 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:49.847403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cc779163-31d4-4eff-8b9c-663bd00850a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:49.848007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cc779163-31d4-4eff-8b9c-663bd00850a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:49.854886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc779163-31d4-4eff-8b9c-663bd00850a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:49.855345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc779163-31d4-4eff-8b9c-663bd00850a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:49.856154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc779163-31d4-4eff-8b9c-663bd00850a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:49.856600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc779163-31d4-4eff-8b9c-663bd00850a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:49.984510 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cc779163-31d4-4eff-8b9c-663bd00850a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:49.993263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cc779163-31d4-4eff-8b9c-663bd00850a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:49.994367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cc779163-31d4-4eff-8b9c-663bd00850a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:49.995542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cc779163-31d4-4eff-8b9c-663bd00850a6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152228 May 12 07:13:49.996170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 981/2048] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:49 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:50.059064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:13:50.059265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:13:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:13:50.729540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e623ca75-f7e1-46d3-a3b8-45f8bfe4c584 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:50.730157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e623ca75-f7e1-46d3-a3b8-45f8bfe4c584 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:50.736505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e623ca75-f7e1-46d3-a3b8-45f8bfe4c584 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:50.736959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e623ca75-f7e1-46d3-a3b8-45f8bfe4c584 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:50.737739 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e623ca75-f7e1-46d3-a3b8-45f8bfe4c584 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:50.738182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e623ca75-f7e1-46d3-a3b8-45f8bfe4c584 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:50.868316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e623ca75-f7e1-46d3-a3b8-45f8bfe4c584 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:50.876021 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e623ca75-f7e1-46d3-a3b8-45f8bfe4c584 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150380 May 12 07:13:50.876592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1068/2049] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:50 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:51.014571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-08d991e8-b5b7-48d6-bf20-721131f4a1d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:51.015182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-08d991e8-b5b7-48d6-bf20-721131f4a1d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:51.021507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08d991e8-b5b7-48d6-bf20-721131f4a1d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:51.021950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08d991e8-b5b7-48d6-bf20-721131f4a1d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:51.022713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08d991e8-b5b7-48d6-bf20-721131f4a1d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:51.023144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08d991e8-b5b7-48d6-bf20-721131f4a1d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:51.147758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-08d991e8-b5b7-48d6-bf20-721131f4a1d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:51.155934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-08d991e8-b5b7-48d6-bf20-721131f4a1d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:51.157442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-08d991e8-b5b7-48d6-bf20-721131f4a1d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:51.158608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-08d991e8-b5b7-48d6-bf20-721131f4a1d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147957 May 12 07:13:51.159163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 982/2050] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:51 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:51.893307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-914f656c-dd9e-4026-83a3-5bf8d729a387 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:51.893950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-914f656c-dd9e-4026-83a3-5bf8d729a387 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:51.900874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-914f656c-dd9e-4026-83a3-5bf8d729a387 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:51.901226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-914f656c-dd9e-4026-83a3-5bf8d729a387 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:51.901987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-914f656c-dd9e-4026-83a3-5bf8d729a387 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:51.902425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-914f656c-dd9e-4026-83a3-5bf8d729a387 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:52.026857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-914f656c-dd9e-4026-83a3-5bf8d729a387 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:52.034754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-914f656c-dd9e-4026-83a3-5bf8d729a387 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145242 May 12 07:13:52.035302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1069/2051] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:51 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:52.177733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b775514f-6752-42a4-a9a2-fde55c109e02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:52.178281 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b775514f-6752-42a4-a9a2-fde55c109e02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:52.184728 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b775514f-6752-42a4-a9a2-fde55c109e02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:52.185187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b775514f-6752-42a4-a9a2-fde55c109e02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:52.185962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b775514f-6752-42a4-a9a2-fde55c109e02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:52.186405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b775514f-6752-42a4-a9a2-fde55c109e02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:52.313501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b775514f-6752-42a4-a9a2-fde55c109e02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:52.322308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b775514f-6752-42a4-a9a2-fde55c109e02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:52.323861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b775514f-6752-42a4-a9a2-fde55c109e02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:52.325028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b775514f-6752-42a4-a9a2-fde55c109e02 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151275 May 12 07:13:52.325591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 983/2052] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:52 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:53.051670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b6ff2d62-a2d0-4e8a-8615-14b7ebd6327c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:53.052317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b6ff2d62-a2d0-4e8a-8615-14b7ebd6327c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:53.058595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6ff2d62-a2d0-4e8a-8615-14b7ebd6327c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:53.059047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6ff2d62-a2d0-4e8a-8615-14b7ebd6327c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:53.059936 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6ff2d62-a2d0-4e8a-8615-14b7ebd6327c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:53.060384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6ff2d62-a2d0-4e8a-8615-14b7ebd6327c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:53.188671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b6ff2d62-a2d0-4e8a-8615-14b7ebd6327c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:53.196430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b6ff2d62-a2d0-4e8a-8615-14b7ebd6327c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148917 May 12 07:13:53.196987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1070/2053] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:53 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:53.343336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dd25a472-9add-4620-86b9-54077f405cbc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:53.343909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dd25a472-9add-4620-86b9-54077f405cbc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:53.350246 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dd25a472-9add-4620-86b9-54077f405cbc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:53.350699 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dd25a472-9add-4620-86b9-54077f405cbc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:53.352091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dd25a472-9add-4620-86b9-54077f405cbc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:53.352534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dd25a472-9add-4620-86b9-54077f405cbc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:53.479549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dd25a472-9add-4620-86b9-54077f405cbc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:53.487819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dd25a472-9add-4620-86b9-54077f405cbc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:53.489320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dd25a472-9add-4620-86b9-54077f405cbc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:53.490508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dd25a472-9add-4620-86b9-54077f405cbc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151128 May 12 07:13:53.491066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 984/2054] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:53 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:54.214156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bf2e8643-29fa-4e82-b5ea-3554a3958d95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:54.214799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bf2e8643-29fa-4e82-b5ea-3554a3958d95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:54.221039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf2e8643-29fa-4e82-b5ea-3554a3958d95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:54.221487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf2e8643-29fa-4e82-b5ea-3554a3958d95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:54.222280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf2e8643-29fa-4e82-b5ea-3554a3958d95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:54.222714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf2e8643-29fa-4e82-b5ea-3554a3958d95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:54.344726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bf2e8643-29fa-4e82-b5ea-3554a3958d95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:54.352328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bf2e8643-29fa-4e82-b5ea-3554a3958d95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.142753 May 12 07:13:54.352892 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1071/2055] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:54 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:54.509463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3ad78c67-9c5e-465c-8311-6eee56698c8f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:54.510075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3ad78c67-9c5e-465c-8311-6eee56698c8f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:54.516484 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ad78c67-9c5e-465c-8311-6eee56698c8f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:54.516942 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ad78c67-9c5e-465c-8311-6eee56698c8f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:54.517707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ad78c67-9c5e-465c-8311-6eee56698c8f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:54.518202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ad78c67-9c5e-465c-8311-6eee56698c8f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:54.644995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3ad78c67-9c5e-465c-8311-6eee56698c8f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:54.653307 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3ad78c67-9c5e-465c-8311-6eee56698c8f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:54.654810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3ad78c67-9c5e-465c-8311-6eee56698c8f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:54.656035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3ad78c67-9c5e-465c-8311-6eee56698c8f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151051 May 12 07:13:54.656596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 985/2056] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:54 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:13:55.369696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6ffbc8d9-bc18-4797-a33c-16794fcb7219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:55.370235 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6ffbc8d9-bc18-4797-a33c-16794fcb7219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:55.376544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ffbc8d9-bc18-4797-a33c-16794fcb7219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:55.376995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ffbc8d9-bc18-4797-a33c-16794fcb7219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:55.377767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ffbc8d9-bc18-4797-a33c-16794fcb7219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:55.378209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6ffbc8d9-bc18-4797-a33c-16794fcb7219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:55.502085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6ffbc8d9-bc18-4797-a33c-16794fcb7219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:55.510406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6ffbc8d9-bc18-4797-a33c-16794fcb7219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145190 May 12 07:13:55.510978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1072/2057] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:55 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:55.674551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b37c7cab-fbc9-4167-98fe-2dffd6b78e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:55.675133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b37c7cab-fbc9-4167-98fe-2dffd6b78e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:55.682086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b37c7cab-fbc9-4167-98fe-2dffd6b78e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:55.682549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b37c7cab-fbc9-4167-98fe-2dffd6b78e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:55.683321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b37c7cab-fbc9-4167-98fe-2dffd6b78e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:55.683798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b37c7cab-fbc9-4167-98fe-2dffd6b78e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:55.807671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b37c7cab-fbc9-4167-98fe-2dffd6b78e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:55.815933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b37c7cab-fbc9-4167-98fe-2dffd6b78e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:55.817443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b37c7cab-fbc9-4167-98fe-2dffd6b78e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:55.818649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b37c7cab-fbc9-4167-98fe-2dffd6b78e61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148339 May 12 07:13:55.819205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 986/2058] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:55 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:56.527007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fa86332a-f61c-441a-a9ff-7a63a5f3e87c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:56.527618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fa86332a-f61c-441a-a9ff-7a63a5f3e87c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:56.533889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa86332a-f61c-441a-a9ff-7a63a5f3e87c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:56.534333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa86332a-f61c-441a-a9ff-7a63a5f3e87c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:56.535091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa86332a-f61c-441a-a9ff-7a63a5f3e87c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:56.535522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa86332a-f61c-441a-a9ff-7a63a5f3e87c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:56.661718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fa86332a-f61c-441a-a9ff-7a63a5f3e87c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:56.669424 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fa86332a-f61c-441a-a9ff-7a63a5f3e87c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146975 May 12 07:13:56.669986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1073/2059] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:56 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:56.837568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c575465e-8e6b-463e-a15d-ba0d25d09182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:56.838109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c575465e-8e6b-463e-a15d-ba0d25d09182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:56.844485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c575465e-8e6b-463e-a15d-ba0d25d09182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:56.844930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c575465e-8e6b-463e-a15d-ba0d25d09182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:56.845713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c575465e-8e6b-463e-a15d-ba0d25d09182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:56.846151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c575465e-8e6b-463e-a15d-ba0d25d09182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:56.971459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c575465e-8e6b-463e-a15d-ba0d25d09182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:56.979572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c575465e-8e6b-463e-a15d-ba0d25d09182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:56.981096 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c575465e-8e6b-463e-a15d-ba0d25d09182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:56.982254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c575465e-8e6b-463e-a15d-ba0d25d09182 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148750 May 12 07:13:56.982804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 987/2060] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:56 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:57.686421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e3246728-a21a-4f46-ab37-4172b369c805 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:57.687045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e3246728-a21a-4f46-ab37-4172b369c805 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:57.693426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3246728-a21a-4f46-ab37-4172b369c805 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:57.693880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3246728-a21a-4f46-ab37-4172b369c805 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:57.694653 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3246728-a21a-4f46-ab37-4172b369c805 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:57.695101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3246728-a21a-4f46-ab37-4172b369c805 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:57.821843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e3246728-a21a-4f46-ab37-4172b369c805 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:57.829702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e3246728-a21a-4f46-ab37-4172b369c805 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147221 May 12 07:13:57.834031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1074/2061] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:57 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:58.000868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a780ad18-fae2-4d1f-b2e7-12a4cc74a3ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:58.001478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a780ad18-fae2-4d1f-b2e7-12a4cc74a3ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:58.007783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a780ad18-fae2-4d1f-b2e7-12a4cc74a3ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:58.008724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a780ad18-fae2-4d1f-b2e7-12a4cc74a3ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:58.009483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a780ad18-fae2-4d1f-b2e7-12a4cc74a3ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:58.009920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a780ad18-fae2-4d1f-b2e7-12a4cc74a3ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:58.131871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a780ad18-fae2-4d1f-b2e7-12a4cc74a3ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:58.141703 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a780ad18-fae2-4d1f-b2e7-12a4cc74a3ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:58.143188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a780ad18-fae2-4d1f-b2e7-12a4cc74a3ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:58.144383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a780ad18-fae2-4d1f-b2e7-12a4cc74a3ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147359 May 12 07:13:58.144926 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 988/2062] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:57 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:13:58.849390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-28eb28e4-b5a6-4acc-81d7-ecc93a15903d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:58.850008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-28eb28e4-b5a6-4acc-81d7-ecc93a15903d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:58.856910 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28eb28e4-b5a6-4acc-81d7-ecc93a15903d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:58.857361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28eb28e4-b5a6-4acc-81d7-ecc93a15903d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:58.858131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28eb28e4-b5a6-4acc-81d7-ecc93a15903d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:58.858571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-28eb28e4-b5a6-4acc-81d7-ecc93a15903d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:58.984521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-28eb28e4-b5a6-4acc-81d7-ecc93a15903d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:58.992326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-28eb28e4-b5a6-4acc-81d7-ecc93a15903d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146962 May 12 07:13:58.993262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1075/2063] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:13:58 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:13:59.163261 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-220c95d6-7db6-4477-96c2-181c0f7af0e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:13:59.163940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-220c95d6-7db6-4477-96c2-181c0f7af0e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:13:59.170915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-220c95d6-7db6-4477-96c2-181c0f7af0e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:59.171359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-220c95d6-7db6-4477-96c2-181c0f7af0e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:59.172151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-220c95d6-7db6-4477-96c2-181c0f7af0e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:13:59.172588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-220c95d6-7db6-4477-96c2-181c0f7af0e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:13:59.299464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-220c95d6-7db6-4477-96c2-181c0f7af0e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:59.307568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-220c95d6-7db6-4477-96c2-181c0f7af0e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:59.309106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-220c95d6-7db6-4477-96c2-181c0f7af0e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:13:59.310269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-220c95d6-7db6-4477-96c2-181c0f7af0e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150956 May 12 07:13:59.310802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 989/2064] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:13:59 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:00.009671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7b507de3-12ab-4d13-b694-11ee9fb0e246 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:00.010281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7b507de3-12ab-4d13-b694-11ee9fb0e246 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:00.016520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b507de3-12ab-4d13-b694-11ee9fb0e246 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:00.016970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b507de3-12ab-4d13-b694-11ee9fb0e246 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:00.017732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b507de3-12ab-4d13-b694-11ee9fb0e246 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:00.018165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b507de3-12ab-4d13-b694-11ee9fb0e246 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:00.148593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7b507de3-12ab-4d13-b694-11ee9fb0e246 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:00.156379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7b507de3-12ab-4d13-b694-11ee9fb0e246 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.151253 May 12 07:14:00.156949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1076/2065] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:00 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:00.329306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9c6f6353-fd9e-47a8-9719-62df2ad4ee9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:00.329824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9c6f6353-fd9e-47a8-9719-62df2ad4ee9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:00.336039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c6f6353-fd9e-47a8-9719-62df2ad4ee9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:00.336489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c6f6353-fd9e-47a8-9719-62df2ad4ee9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:00.337380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c6f6353-fd9e-47a8-9719-62df2ad4ee9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:00.337780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c6f6353-fd9e-47a8-9719-62df2ad4ee9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:00.471969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c6f6353-fd9e-47a8-9719-62df2ad4ee9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:00.480803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c6f6353-fd9e-47a8-9719-62df2ad4ee9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:00.482297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c6f6353-fd9e-47a8-9719-62df2ad4ee9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:00.483459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9c6f6353-fd9e-47a8-9719-62df2ad4ee9d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.158149 May 12 07:14:00.484110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 990/2066] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:00 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:01.174240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-14f716df-217a-419a-a2e5-11d043649c1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:01.174849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-14f716df-217a-419a-a2e5-11d043649c1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:01.181686 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14f716df-217a-419a-a2e5-11d043649c1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:01.182140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14f716df-217a-419a-a2e5-11d043649c1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:01.182922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14f716df-217a-419a-a2e5-11d043649c1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:01.183364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-14f716df-217a-419a-a2e5-11d043649c1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:01.306828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-14f716df-217a-419a-a2e5-11d043649c1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:01.314619 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-14f716df-217a-419a-a2e5-11d043649c1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144532 May 12 07:14:01.321144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1077/2067] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:01 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:01.502373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ecff515a-486d-41f2-a9f7-7cf80f164390 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:01.502976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ecff515a-486d-41f2-a9f7-7cf80f164390 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:01.509622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecff515a-486d-41f2-a9f7-7cf80f164390 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:01.510010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecff515a-486d-41f2-a9f7-7cf80f164390 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:01.510777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecff515a-486d-41f2-a9f7-7cf80f164390 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:01.511215 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ecff515a-486d-41f2-a9f7-7cf80f164390 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:01.637523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ecff515a-486d-41f2-a9f7-7cf80f164390 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:01.645593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ecff515a-486d-41f2-a9f7-7cf80f164390 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:01.647108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ecff515a-486d-41f2-a9f7-7cf80f164390 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:01.648295 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ecff515a-486d-41f2-a9f7-7cf80f164390 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149981 May 12 07:14:01.648848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 991/2068] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:01 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:02.332160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a1ec3c65-3eb8-46bb-84f5-30328d44eb28 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:02.332696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a1ec3c65-3eb8-46bb-84f5-30328d44eb28 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:02.339535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1ec3c65-3eb8-46bb-84f5-30328d44eb28 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:02.340012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1ec3c65-3eb8-46bb-84f5-30328d44eb28 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:02.340773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1ec3c65-3eb8-46bb-84f5-30328d44eb28 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:02.341205 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a1ec3c65-3eb8-46bb-84f5-30328d44eb28 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:02.470000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a1ec3c65-3eb8-46bb-84f5-30328d44eb28 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:02.477842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a1ec3c65-3eb8-46bb-84f5-30328d44eb28 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149743 May 12 07:14:02.478681 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1078/2069] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:02 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:02.667163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8fef0a5c-8f9f-4210-bfef-6d3f9ceabe14 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:02.667816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8fef0a5c-8f9f-4210-bfef-6d3f9ceabe14 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:02.674279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fef0a5c-8f9f-4210-bfef-6d3f9ceabe14 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:02.674728 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fef0a5c-8f9f-4210-bfef-6d3f9ceabe14 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:02.675499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fef0a5c-8f9f-4210-bfef-6d3f9ceabe14 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:02.675957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fef0a5c-8f9f-4210-bfef-6d3f9ceabe14 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:02.801105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8fef0a5c-8f9f-4210-bfef-6d3f9ceabe14 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:02.809695 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8fef0a5c-8f9f-4210-bfef-6d3f9ceabe14 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:02.811207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8fef0a5c-8f9f-4210-bfef-6d3f9ceabe14 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:02.812431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8fef0a5c-8f9f-4210-bfef-6d3f9ceabe14 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149695 May 12 07:14:02.813012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 992/2070] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:02 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:03.494790 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d4cf30e0-fcfe-4dd8-9583-ae32634a4463 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:03.495412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d4cf30e0-fcfe-4dd8-9583-ae32634a4463 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:03.501706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d4cf30e0-fcfe-4dd8-9583-ae32634a4463 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:03.502158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d4cf30e0-fcfe-4dd8-9583-ae32634a4463 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:03.502924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d4cf30e0-fcfe-4dd8-9583-ae32634a4463 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:03.503367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d4cf30e0-fcfe-4dd8-9583-ae32634a4463 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:03.632787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d4cf30e0-fcfe-4dd8-9583-ae32634a4463 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:03.641143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d4cf30e0-fcfe-4dd8-9583-ae32634a4463 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150716 May 12 07:14:03.641707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1079/2071] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:03 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:03.830935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-31c4a8e4-8b47-4844-b6be-f05cb4ec9b53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:03.831471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-31c4a8e4-8b47-4844-b6be-f05cb4ec9b53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:03.837950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31c4a8e4-8b47-4844-b6be-f05cb4ec9b53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:03.838397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31c4a8e4-8b47-4844-b6be-f05cb4ec9b53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:03.839159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31c4a8e4-8b47-4844-b6be-f05cb4ec9b53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:03.839703 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31c4a8e4-8b47-4844-b6be-f05cb4ec9b53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:03.965990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-31c4a8e4-8b47-4844-b6be-f05cb4ec9b53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:03.974186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-31c4a8e4-8b47-4844-b6be-f05cb4ec9b53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:03.975677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-31c4a8e4-8b47-4844-b6be-f05cb4ec9b53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:03.977348 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-31c4a8e4-8b47-4844-b6be-f05cb4ec9b53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150409 May 12 07:14:03.977901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 993/2072] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:04.658045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-65067afb-46e0-4087-8e29-6c758943ec98 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:04.658649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-65067afb-46e0-4087-8e29-6c758943ec98 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:04.665060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65067afb-46e0-4087-8e29-6c758943ec98 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:04.665507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65067afb-46e0-4087-8e29-6c758943ec98 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:04.666280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65067afb-46e0-4087-8e29-6c758943ec98 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:04.666805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65067afb-46e0-4087-8e29-6c758943ec98 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:04.794905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-65067afb-46e0-4087-8e29-6c758943ec98 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:04.803029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-65067afb-46e0-4087-8e29-6c758943ec98 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148907 May 12 07:14:04.803598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1080/2073] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:04 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:04.996386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cf6ca6fc-8f5a-4a37-aaf7-72ca62b6abd6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:04.997009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cf6ca6fc-8f5a-4a37-aaf7-72ca62b6abd6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:05.003319 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf6ca6fc-8f5a-4a37-aaf7-72ca62b6abd6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:05.003813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf6ca6fc-8f5a-4a37-aaf7-72ca62b6abd6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:05.004588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf6ca6fc-8f5a-4a37-aaf7-72ca62b6abd6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:05.005034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf6ca6fc-8f5a-4a37-aaf7-72ca62b6abd6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:05.130583 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cf6ca6fc-8f5a-4a37-aaf7-72ca62b6abd6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:05.139373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cf6ca6fc-8f5a-4a37-aaf7-72ca62b6abd6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:05.140899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cf6ca6fc-8f5a-4a37-aaf7-72ca62b6abd6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:05.142065 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cf6ca6fc-8f5a-4a37-aaf7-72ca62b6abd6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150183 May 12 07:14:05.142619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 994/2074] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:04 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:05.820195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-35bd4c39-9143-4ae7-9a68-870552318bff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:05.820809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-35bd4c39-9143-4ae7-9a68-870552318bff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:05.827229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35bd4c39-9143-4ae7-9a68-870552318bff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:05.830023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35bd4c39-9143-4ae7-9a68-870552318bff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:05.830023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35bd4c39-9143-4ae7-9a68-870552318bff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:05.830023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-35bd4c39-9143-4ae7-9a68-870552318bff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:05.956195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-35bd4c39-9143-4ae7-9a68-870552318bff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:05.963904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-35bd4c39-9143-4ae7-9a68-870552318bff tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147521 May 12 07:14:05.964475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1081/2075] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:05 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:06.160511 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-16fdb0c2-0422-4bd1-bdfb-f8413c5ce0c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:06.161059 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-16fdb0c2-0422-4bd1-bdfb-f8413c5ce0c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:06.167271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16fdb0c2-0422-4bd1-bdfb-f8413c5ce0c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:06.167750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16fdb0c2-0422-4bd1-bdfb-f8413c5ce0c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:06.168520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16fdb0c2-0422-4bd1-bdfb-f8413c5ce0c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:06.168952 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16fdb0c2-0422-4bd1-bdfb-f8413c5ce0c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:06.294615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-16fdb0c2-0422-4bd1-bdfb-f8413c5ce0c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:06.302991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-16fdb0c2-0422-4bd1-bdfb-f8413c5ce0c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:06.304512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-16fdb0c2-0422-4bd1-bdfb-f8413c5ce0c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:06.305663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-16fdb0c2-0422-4bd1-bdfb-f8413c5ce0c7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149207 May 12 07:14:06.306217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 995/2076] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:06 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:06.981187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b42acae0-0860-4776-998b-2eab6068f762 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:06.981806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b42acae0-0860-4776-998b-2eab6068f762 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:06.988252 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b42acae0-0860-4776-998b-2eab6068f762 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:06.988709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b42acae0-0860-4776-998b-2eab6068f762 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:06.989483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b42acae0-0860-4776-998b-2eab6068f762 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:06.989925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b42acae0-0860-4776-998b-2eab6068f762 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:07.114328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b42acae0-0860-4776-998b-2eab6068f762 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:07.122601 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b42acae0-0860-4776-998b-2eab6068f762 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145900 May 12 07:14:07.123169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1082/2077] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:06 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:07.323991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6370e1cf-01f8-41b5-8713-a39179e90d07 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:07.324608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6370e1cf-01f8-41b5-8713-a39179e90d07 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:07.330925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6370e1cf-01f8-41b5-8713-a39179e90d07 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:07.331378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6370e1cf-01f8-41b5-8713-a39179e90d07 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:07.332253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6370e1cf-01f8-41b5-8713-a39179e90d07 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:07.332698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6370e1cf-01f8-41b5-8713-a39179e90d07 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:07.460038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6370e1cf-01f8-41b5-8713-a39179e90d07 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:07.468625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6370e1cf-01f8-41b5-8713-a39179e90d07 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:07.470125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6370e1cf-01f8-41b5-8713-a39179e90d07 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:07.471280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6370e1cf-01f8-41b5-8713-a39179e90d07 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151258 May 12 07:14:07.471876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 996/2078] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:07 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:08.140497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-55f9cfda-6357-4287-83ac-9354a20cabc7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:08.141113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-55f9cfda-6357-4287-83ac-9354a20cabc7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:08.147329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55f9cfda-6357-4287-83ac-9354a20cabc7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:08.147813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55f9cfda-6357-4287-83ac-9354a20cabc7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:08.148613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55f9cfda-6357-4287-83ac-9354a20cabc7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:08.149058 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55f9cfda-6357-4287-83ac-9354a20cabc7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:08.275578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-55f9cfda-6357-4287-83ac-9354a20cabc7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:08.285358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-55f9cfda-6357-4287-83ac-9354a20cabc7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149259 May 12 07:14:08.287293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1083/2079] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:08 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:08.489960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-571c8e72-46a8-4885-8dd3-ea6e878d2b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:08.490568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-571c8e72-46a8-4885-8dd3-ea6e878d2b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:08.497526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-571c8e72-46a8-4885-8dd3-ea6e878d2b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:08.497971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-571c8e72-46a8-4885-8dd3-ea6e878d2b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:08.498733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-571c8e72-46a8-4885-8dd3-ea6e878d2b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:08.499164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-571c8e72-46a8-4885-8dd3-ea6e878d2b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:08.625001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-571c8e72-46a8-4885-8dd3-ea6e878d2b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:08.633224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-571c8e72-46a8-4885-8dd3-ea6e878d2b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:08.634724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-571c8e72-46a8-4885-8dd3-ea6e878d2b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:08.635949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-571c8e72-46a8-4885-8dd3-ea6e878d2b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149809 May 12 07:14:08.636511 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 997/2080] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:09.301961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d5999893-35b9-4ae8-a9f1-a955d2598ee6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:09.302497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d5999893-35b9-4ae8-a9f1-a955d2598ee6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:09.308804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5999893-35b9-4ae8-a9f1-a955d2598ee6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:09.309246 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5999893-35b9-4ae8-a9f1-a955d2598ee6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:09.310006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5999893-35b9-4ae8-a9f1-a955d2598ee6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:09.310438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5999893-35b9-4ae8-a9f1-a955d2598ee6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:09.434078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d5999893-35b9-4ae8-a9f1-a955d2598ee6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:09.441798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d5999893-35b9-4ae8-a9f1-a955d2598ee6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144007 May 12 07:14:09.442356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1084/2081] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:09 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:09.654343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d3418641-8b1c-4cbf-969e-6beeefb13882 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:09.654891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d3418641-8b1c-4cbf-969e-6beeefb13882 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:09.661265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d3418641-8b1c-4cbf-969e-6beeefb13882 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:09.661723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d3418641-8b1c-4cbf-969e-6beeefb13882 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:09.662509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d3418641-8b1c-4cbf-969e-6beeefb13882 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:09.662948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d3418641-8b1c-4cbf-969e-6beeefb13882 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:09.787416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d3418641-8b1c-4cbf-969e-6beeefb13882 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:09.796161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d3418641-8b1c-4cbf-969e-6beeefb13882 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:09.797650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d3418641-8b1c-4cbf-969e-6beeefb13882 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:09.799090 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d3418641-8b1c-4cbf-969e-6beeefb13882 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148748 May 12 07:14:09.799646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 998/2082] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:10.459231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c6dd81e9-2826-4fd2-9f93-6dcff7b48b8c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:10.459826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c6dd81e9-2826-4fd2-9f93-6dcff7b48b8c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:10.466272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6dd81e9-2826-4fd2-9f93-6dcff7b48b8c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:10.466725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6dd81e9-2826-4fd2-9f93-6dcff7b48b8c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:10.467498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6dd81e9-2826-4fd2-9f93-6dcff7b48b8c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:10.467971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6dd81e9-2826-4fd2-9f93-6dcff7b48b8c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:10.600746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c6dd81e9-2826-4fd2-9f93-6dcff7b48b8c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:10.609012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c6dd81e9-2826-4fd2-9f93-6dcff7b48b8c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.153727 May 12 07:14:10.609579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1085/2083] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:10 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:10.817405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5dfbd014-dd67-4c42-a716-5644d75e7f43 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:10.818019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5dfbd014-dd67-4c42-a716-5644d75e7f43 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:10.824409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dfbd014-dd67-4c42-a716-5644d75e7f43 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:10.824879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dfbd014-dd67-4c42-a716-5644d75e7f43 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:10.825646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dfbd014-dd67-4c42-a716-5644d75e7f43 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:10.826075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dfbd014-dd67-4c42-a716-5644d75e7f43 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:10.952347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5dfbd014-dd67-4c42-a716-5644d75e7f43 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:10.961293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5dfbd014-dd67-4c42-a716-5644d75e7f43 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:10.962884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5dfbd014-dd67-4c42-a716-5644d75e7f43 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:10.964077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5dfbd014-dd67-4c42-a716-5644d75e7f43 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150541 May 12 07:14:10.964630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 999/2084] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:10 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:11.626298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-edcc7879-1df0-4f70-a044-9d3577f60ae5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:11.626893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-edcc7879-1df0-4f70-a044-9d3577f60ae5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:11.633700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edcc7879-1df0-4f70-a044-9d3577f60ae5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:11.634148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edcc7879-1df0-4f70-a044-9d3577f60ae5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:11.634914 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edcc7879-1df0-4f70-a044-9d3577f60ae5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:11.635352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edcc7879-1df0-4f70-a044-9d3577f60ae5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:11.762102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-edcc7879-1df0-4f70-a044-9d3577f60ae5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:11.769862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-edcc7879-1df0-4f70-a044-9d3577f60ae5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147434 May 12 07:14:11.770421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1086/2085] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:11 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:11.982351 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d83252f0-e01a-4cc1-9ce0-b904e04a82f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:11.982895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d83252f0-e01a-4cc1-9ce0-b904e04a82f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:11.989438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d83252f0-e01a-4cc1-9ce0-b904e04a82f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:11.989890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d83252f0-e01a-4cc1-9ce0-b904e04a82f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:11.990669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d83252f0-e01a-4cc1-9ce0-b904e04a82f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:11.991108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d83252f0-e01a-4cc1-9ce0-b904e04a82f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:12.115424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d83252f0-e01a-4cc1-9ce0-b904e04a82f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:12.124348 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d83252f0-e01a-4cc1-9ce0-b904e04a82f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:12.125840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d83252f0-e01a-4cc1-9ce0-b904e04a82f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:12.127102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d83252f0-e01a-4cc1-9ce0-b904e04a82f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148665 May 12 07:14:12.127768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1000/2086] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:12.786733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4e697155-9185-46cd-924d-0e5ac0a762f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:12.787351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4e697155-9185-46cd-924d-0e5ac0a762f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:12.794248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e697155-9185-46cd-924d-0e5ac0a762f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:12.794698 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e697155-9185-46cd-924d-0e5ac0a762f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:12.795465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e697155-9185-46cd-924d-0e5ac0a762f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:12.795951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e697155-9185-46cd-924d-0e5ac0a762f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:12.918407 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4e697155-9185-46cd-924d-0e5ac0a762f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:12.926358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4e697155-9185-46cd-924d-0e5ac0a762f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143610 May 12 07:14:12.926922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1087/2087] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:12 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:13.145794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7d9513fc-c1b0-4979-b371-b3ad7f92e321 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:13.146406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7d9513fc-c1b0-4979-b371-b3ad7f92e321 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:13.153363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d9513fc-c1b0-4979-b371-b3ad7f92e321 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:13.153808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d9513fc-c1b0-4979-b371-b3ad7f92e321 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:13.154572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d9513fc-c1b0-4979-b371-b3ad7f92e321 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:13.155007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d9513fc-c1b0-4979-b371-b3ad7f92e321 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:13.282553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7d9513fc-c1b0-4979-b371-b3ad7f92e321 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:13.290694 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7d9513fc-c1b0-4979-b371-b3ad7f92e321 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:13.292233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7d9513fc-c1b0-4979-b371-b3ad7f92e321 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:13.293404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7d9513fc-c1b0-4979-b371-b3ad7f92e321 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151620 May 12 07:14:13.293967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1001/2088] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:13.943135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-78c65614-18af-4d7c-aa58-2ec2ff160cf6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:13.943770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-78c65614-18af-4d7c-aa58-2ec2ff160cf6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:13.950066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78c65614-18af-4d7c-aa58-2ec2ff160cf6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:13.950517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78c65614-18af-4d7c-aa58-2ec2ff160cf6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:13.951289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78c65614-18af-4d7c-aa58-2ec2ff160cf6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:13.951758 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78c65614-18af-4d7c-aa58-2ec2ff160cf6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:14.089419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-78c65614-18af-4d7c-aa58-2ec2ff160cf6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:14.097177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-78c65614-18af-4d7c-aa58-2ec2ff160cf6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.158000 May 12 07:14:14.097747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1088/2089] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:13 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:14.312562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c6be6f12-98dc-4941-a083-941787b6ed54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:14.313179 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c6be6f12-98dc-4941-a083-941787b6ed54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:14.319476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6be6f12-98dc-4941-a083-941787b6ed54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:14.320469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6be6f12-98dc-4941-a083-941787b6ed54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:14.321240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6be6f12-98dc-4941-a083-941787b6ed54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:14.321686 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6be6f12-98dc-4941-a083-941787b6ed54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:14.448383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c6be6f12-98dc-4941-a083-941787b6ed54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:14.456551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c6be6f12-98dc-4941-a083-941787b6ed54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:14.458068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c6be6f12-98dc-4941-a083-941787b6ed54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:14.459236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c6be6f12-98dc-4941-a083-941787b6ed54 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150545 May 12 07:14:14.459822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1002/2090] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:14 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:15.114497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-211fb47d-ec26-4835-920d-285945f7319c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:15.115112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-211fb47d-ec26-4835-920d-285945f7319c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:15.122009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-211fb47d-ec26-4835-920d-285945f7319c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:15.122462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-211fb47d-ec26-4835-920d-285945f7319c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:15.123223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-211fb47d-ec26-4835-920d-285945f7319c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:15.123663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-211fb47d-ec26-4835-920d-285945f7319c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:15.251078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-211fb47d-ec26-4835-920d-285945f7319c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:15.258949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-211fb47d-ec26-4835-920d-285945f7319c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148455 May 12 07:14:15.259524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1089/2091] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:15 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:15.478654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-74e9bf00-6ac6-40f1-af32-c13833ca5b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:15.479269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-74e9bf00-6ac6-40f1-af32-c13833ca5b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:15.485498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74e9bf00-6ac6-40f1-af32-c13833ca5b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:15.485946 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74e9bf00-6ac6-40f1-af32-c13833ca5b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:15.486708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74e9bf00-6ac6-40f1-af32-c13833ca5b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:15.487147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74e9bf00-6ac6-40f1-af32-c13833ca5b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:15.613457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-74e9bf00-6ac6-40f1-af32-c13833ca5b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:15.621596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-74e9bf00-6ac6-40f1-af32-c13833ca5b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:15.623100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-74e9bf00-6ac6-40f1-af32-c13833ca5b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:15.624279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-74e9bf00-6ac6-40f1-af32-c13833ca5b7a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150101 May 12 07:14:15.624836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1003/2092] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:16.275893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d9a8ffec-e504-45d2-8cb4-80b471a0934e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:16.276425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d9a8ffec-e504-45d2-8cb4-80b471a0934e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:16.282712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d9a8ffec-e504-45d2-8cb4-80b471a0934e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:16.283152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d9a8ffec-e504-45d2-8cb4-80b471a0934e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:16.283940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d9a8ffec-e504-45d2-8cb4-80b471a0934e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:16.284374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d9a8ffec-e504-45d2-8cb4-80b471a0934e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:16.406753 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d9a8ffec-e504-45d2-8cb4-80b471a0934e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:16.414358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d9a8ffec-e504-45d2-8cb4-80b471a0934e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.142566 May 12 07:14:16.414921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1090/2093] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:16 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:16.642839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-848fa81d-5c69-4ed9-ac33-aba0f96546f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:16.643459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-848fa81d-5c69-4ed9-ac33-aba0f96546f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:16.649623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-848fa81d-5c69-4ed9-ac33-aba0f96546f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:16.650070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-848fa81d-5c69-4ed9-ac33-aba0f96546f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:16.650831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-848fa81d-5c69-4ed9-ac33-aba0f96546f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:16.651272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-848fa81d-5c69-4ed9-ac33-aba0f96546f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:16.775326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-848fa81d-5c69-4ed9-ac33-aba0f96546f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:16.783490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-848fa81d-5c69-4ed9-ac33-aba0f96546f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:16.785025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-848fa81d-5c69-4ed9-ac33-aba0f96546f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:16.786196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-848fa81d-5c69-4ed9-ac33-aba0f96546f6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147392 May 12 07:14:16.786750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1004/2094] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:17.431472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-04359e4a-63a0-41b5-a964-7089312b0bcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:17.432050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-04359e4a-63a0-41b5-a964-7089312b0bcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:17.438260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04359e4a-63a0-41b5-a964-7089312b0bcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:17.438724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04359e4a-63a0-41b5-a964-7089312b0bcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:17.439490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04359e4a-63a0-41b5-a964-7089312b0bcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:17.439957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04359e4a-63a0-41b5-a964-7089312b0bcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:17.565243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-04359e4a-63a0-41b5-a964-7089312b0bcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:17.573409 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-04359e4a-63a0-41b5-a964-7089312b0bcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145900 May 12 07:14:17.573966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1091/2095] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:17 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:17.805416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ad287e9e-8af1-4254-9a5c-987cad77eda1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:17.806049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ad287e9e-8af1-4254-9a5c-987cad77eda1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:17.812308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad287e9e-8af1-4254-9a5c-987cad77eda1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:17.812752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad287e9e-8af1-4254-9a5c-987cad77eda1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:17.813513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad287e9e-8af1-4254-9a5c-987cad77eda1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:17.813946 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad287e9e-8af1-4254-9a5c-987cad77eda1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:17.937504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ad287e9e-8af1-4254-9a5c-987cad77eda1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:17.946434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ad287e9e-8af1-4254-9a5c-987cad77eda1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:17.947971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ad287e9e-8af1-4254-9a5c-987cad77eda1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:17.949145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ad287e9e-8af1-4254-9a5c-987cad77eda1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148139 May 12 07:14:17.949707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1005/2096] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:17 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:18.590749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c905ad10-4d30-4c29-ba7d-06985de24329 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:18.591363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c905ad10-4d30-4c29-ba7d-06985de24329 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:18.597669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c905ad10-4d30-4c29-ba7d-06985de24329 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:18.598118 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c905ad10-4d30-4c29-ba7d-06985de24329 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:18.598886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c905ad10-4d30-4c29-ba7d-06985de24329 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:18.599322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c905ad10-4d30-4c29-ba7d-06985de24329 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:18.725563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c905ad10-4d30-4c29-ba7d-06985de24329 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:18.733893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c905ad10-4d30-4c29-ba7d-06985de24329 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147100 May 12 07:14:18.734454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1092/2097] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:18 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:18.968369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0c11e727-c827-497e-954b-de348bc641ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:18.968906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0c11e727-c827-497e-954b-de348bc641ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:18.975060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c11e727-c827-497e-954b-de348bc641ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:18.975510 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c11e727-c827-497e-954b-de348bc641ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:18.976366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c11e727-c827-497e-954b-de348bc641ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:18.976801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0c11e727-c827-497e-954b-de348bc641ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:19.102479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0c11e727-c827-497e-954b-de348bc641ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:19.110826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0c11e727-c827-497e-954b-de348bc641ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:19.112359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0c11e727-c827-497e-954b-de348bc641ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:19.113521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0c11e727-c827-497e-954b-de348bc641ee tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149135 May 12 07:14:19.114076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1006/2098] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:19.750652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bdd5734d-8ea2-4ae5-9147-bd53785bee36 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:19.751287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bdd5734d-8ea2-4ae5-9147-bd53785bee36 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:19.757560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bdd5734d-8ea2-4ae5-9147-bd53785bee36 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:19.758006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bdd5734d-8ea2-4ae5-9147-bd53785bee36 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:19.758763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bdd5734d-8ea2-4ae5-9147-bd53785bee36 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:19.759195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bdd5734d-8ea2-4ae5-9147-bd53785bee36 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:19.882503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bdd5734d-8ea2-4ae5-9147-bd53785bee36 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:19.890165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bdd5734d-8ea2-4ae5-9147-bd53785bee36 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143368 May 12 07:14:19.890726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1093/2099] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:19 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:20.131900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-943972a4-5cf7-4afa-b6d8-a62db48d17f8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:20.132447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-943972a4-5cf7-4afa-b6d8-a62db48d17f8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:20.138846 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-943972a4-5cf7-4afa-b6d8-a62db48d17f8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:20.139299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-943972a4-5cf7-4afa-b6d8-a62db48d17f8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:20.140109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-943972a4-5cf7-4afa-b6d8-a62db48d17f8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:20.140539 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-943972a4-5cf7-4afa-b6d8-a62db48d17f8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:20.271374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-943972a4-5cf7-4afa-b6d8-a62db48d17f8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:20.279917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-943972a4-5cf7-4afa-b6d8-a62db48d17f8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:20.281401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-943972a4-5cf7-4afa-b6d8-a62db48d17f8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:20.282544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-943972a4-5cf7-4afa-b6d8-a62db48d17f8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.154684 May 12 07:14:20.283152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1007/2100] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:20.906284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1fbaddc9-c1be-42d8-90c2-bdf16ebfb81d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:20.906900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1fbaddc9-c1be-42d8-90c2-bdf16ebfb81d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:20.913280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fbaddc9-c1be-42d8-90c2-bdf16ebfb81d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:20.913737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fbaddc9-c1be-42d8-90c2-bdf16ebfb81d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:20.914505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fbaddc9-c1be-42d8-90c2-bdf16ebfb81d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:20.914947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fbaddc9-c1be-42d8-90c2-bdf16ebfb81d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:21.041049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1fbaddc9-c1be-42d8-90c2-bdf16ebfb81d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:21.049024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1fbaddc9-c1be-42d8-90c2-bdf16ebfb81d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146629 May 12 07:14:21.049591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1094/2101] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:20 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:21.302259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-15d81af2-8d91-493e-bca5-90f384c8217b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:21.302894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-15d81af2-8d91-493e-bca5-90f384c8217b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:21.309813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15d81af2-8d91-493e-bca5-90f384c8217b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:21.310477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15d81af2-8d91-493e-bca5-90f384c8217b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:21.311336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15d81af2-8d91-493e-bca5-90f384c8217b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:21.311813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15d81af2-8d91-493e-bca5-90f384c8217b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:21.438106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-15d81af2-8d91-493e-bca5-90f384c8217b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:21.446382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-15d81af2-8d91-493e-bca5-90f384c8217b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:21.447910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-15d81af2-8d91-493e-bca5-90f384c8217b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:21.449070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-15d81af2-8d91-493e-bca5-90f384c8217b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150981 May 12 07:14:21.449623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1008/2102] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:22.066550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-45d9e7f2-8fe7-4a78-a764-e897481ce3e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:22.067167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-45d9e7f2-8fe7-4a78-a764-e897481ce3e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:22.073628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45d9e7f2-8fe7-4a78-a764-e897481ce3e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:22.074077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45d9e7f2-8fe7-4a78-a764-e897481ce3e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:22.074841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45d9e7f2-8fe7-4a78-a764-e897481ce3e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:22.075278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45d9e7f2-8fe7-4a78-a764-e897481ce3e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:22.198175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-45d9e7f2-8fe7-4a78-a764-e897481ce3e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:22.205956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-45d9e7f2-8fe7-4a78-a764-e897481ce3e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143362 May 12 07:14:22.206517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1095/2103] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:22 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:22.467561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a6cf7b8c-2ddc-43fa-aa73-55a5923de1c6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:22.468106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a6cf7b8c-2ddc-43fa-aa73-55a5923de1c6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:22.474337 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a6cf7b8c-2ddc-43fa-aa73-55a5923de1c6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:22.474790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a6cf7b8c-2ddc-43fa-aa73-55a5923de1c6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:22.475552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a6cf7b8c-2ddc-43fa-aa73-55a5923de1c6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:22.476014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a6cf7b8c-2ddc-43fa-aa73-55a5923de1c6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:22.601905 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a6cf7b8c-2ddc-43fa-aa73-55a5923de1c6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:22.610478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a6cf7b8c-2ddc-43fa-aa73-55a5923de1c6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:22.611997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a6cf7b8c-2ddc-43fa-aa73-55a5923de1c6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:22.613148 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a6cf7b8c-2ddc-43fa-aa73-55a5923de1c6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149564 May 12 07:14:22.613704 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1009/2104] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:22 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:23.222810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2d8d585e-f08c-423e-bb0a-3f1d3b14d8b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:23.223419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2d8d585e-f08c-423e-bb0a-3f1d3b14d8b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:23.230300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d8d585e-f08c-423e-bb0a-3f1d3b14d8b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:23.230748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d8d585e-f08c-423e-bb0a-3f1d3b14d8b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:23.231515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d8d585e-f08c-423e-bb0a-3f1d3b14d8b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:23.231974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d8d585e-f08c-423e-bb0a-3f1d3b14d8b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:23.355511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2d8d585e-f08c-423e-bb0a-3f1d3b14d8b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:23.363175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2d8d585e-f08c-423e-bb0a-3f1d3b14d8b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144250 May 12 07:14:23.363773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1096/2105] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:23 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:23.631925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b8e9cd7d-e6e9-45d4-95b7-d2b4a38ac647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:23.632468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b8e9cd7d-e6e9-45d4-95b7-d2b4a38ac647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:23.638806 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e9cd7d-e6e9-45d4-95b7-d2b4a38ac647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:23.639264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e9cd7d-e6e9-45d4-95b7-d2b4a38ac647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:23.640067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e9cd7d-e6e9-45d4-95b7-d2b4a38ac647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:23.640516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b8e9cd7d-e6e9-45d4-95b7-d2b4a38ac647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:23.764413 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8e9cd7d-e6e9-45d4-95b7-d2b4a38ac647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:23.772580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8e9cd7d-e6e9-45d4-95b7-d2b4a38ac647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:23.774065 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b8e9cd7d-e6e9-45d4-95b7-d2b4a38ac647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:23.775841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b8e9cd7d-e6e9-45d4-95b7-d2b4a38ac647 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147359 May 12 07:14:23.776396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1010/2106] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:23 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:14:24.380804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1692379b-3f62-409d-a7a9-0b463a0baa67 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:24.381326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1692379b-3f62-409d-a7a9-0b463a0baa67 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:24.388286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1692379b-3f62-409d-a7a9-0b463a0baa67 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:24.388736 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1692379b-3f62-409d-a7a9-0b463a0baa67 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:24.389495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1692379b-3f62-409d-a7a9-0b463a0baa67 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:24.389930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1692379b-3f62-409d-a7a9-0b463a0baa67 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:24.516649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1692379b-3f62-409d-a7a9-0b463a0baa67 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:24.524425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1692379b-3f62-409d-a7a9-0b463a0baa67 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147546 May 12 07:14:24.525019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1097/2107] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:24 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:24.794550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ef709efe-722e-4bd6-8944-97e7a993fc89 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:24.795228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ef709efe-722e-4bd6-8944-97e7a993fc89 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:24.801732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef709efe-722e-4bd6-8944-97e7a993fc89 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:24.802305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef709efe-722e-4bd6-8944-97e7a993fc89 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:24.802983 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef709efe-722e-4bd6-8944-97e7a993fc89 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:24.803415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef709efe-722e-4bd6-8944-97e7a993fc89 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:24.927924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ef709efe-722e-4bd6-8944-97e7a993fc89 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:24.936056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ef709efe-722e-4bd6-8944-97e7a993fc89 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:24.937560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ef709efe-722e-4bd6-8944-97e7a993fc89 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:24.938722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ef709efe-722e-4bd6-8944-97e7a993fc89 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148597 May 12 07:14:24.939355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1011/2108] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:24 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:25.541330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9806c0d3-2866-4ab5-886b-29002f6114a9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:25.541946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9806c0d3-2866-4ab5-886b-29002f6114a9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:25.548442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9806c0d3-2866-4ab5-886b-29002f6114a9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:25.548911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9806c0d3-2866-4ab5-886b-29002f6114a9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:25.549643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9806c0d3-2866-4ab5-886b-29002f6114a9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:25.550074 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9806c0d3-2866-4ab5-886b-29002f6114a9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:25.677182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9806c0d3-2866-4ab5-886b-29002f6114a9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:25.685638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9806c0d3-2866-4ab5-886b-29002f6114a9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148166 May 12 07:14:25.686200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1098/2109] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:25 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:25.957111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-78a6db04-be1f-4d21-be29-97554bdd4943 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:25.962950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-78a6db04-be1f-4d21-be29-97554bdd4943 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:25.967378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78a6db04-be1f-4d21-be29-97554bdd4943 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:25.967866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78a6db04-be1f-4d21-be29-97554bdd4943 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:25.968685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78a6db04-be1f-4d21-be29-97554bdd4943 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:25.969238 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78a6db04-be1f-4d21-be29-97554bdd4943 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:26.102242 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-78a6db04-be1f-4d21-be29-97554bdd4943 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:26.111118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-78a6db04-be1f-4d21-be29-97554bdd4943 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:26.112671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-78a6db04-be1f-4d21-be29-97554bdd4943 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:26.113841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-78a6db04-be1f-4d21-be29-97554bdd4943 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.160758 May 12 07:14:26.114394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1012/2110] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:25 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:26.703165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-be0797e1-e8bf-41c5-a8da-092c5be57e5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:26.703807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-be0797e1-e8bf-41c5-a8da-092c5be57e5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:26.710260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be0797e1-e8bf-41c5-a8da-092c5be57e5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:26.710545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be0797e1-e8bf-41c5-a8da-092c5be57e5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:26.711137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be0797e1-e8bf-41c5-a8da-092c5be57e5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:26.711663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be0797e1-e8bf-41c5-a8da-092c5be57e5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:26.838932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-be0797e1-e8bf-41c5-a8da-092c5be57e5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:26.846774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-be0797e1-e8bf-41c5-a8da-092c5be57e5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147812 May 12 07:14:26.847340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1099/2111] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:26 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:27.133260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d75b4803-c62f-4e63-85d4-681a331e6f7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:27.134066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d75b4803-c62f-4e63-85d4-681a331e6f7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:27.143110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d75b4803-c62f-4e63-85d4-681a331e6f7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:27.143566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d75b4803-c62f-4e63-85d4-681a331e6f7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:27.144423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d75b4803-c62f-4e63-85d4-681a331e6f7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:27.144866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d75b4803-c62f-4e63-85d4-681a331e6f7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:27.276495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d75b4803-c62f-4e63-85d4-681a331e6f7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:27.285177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d75b4803-c62f-4e63-85d4-681a331e6f7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:27.286669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d75b4803-c62f-4e63-85d4-681a331e6f7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:27.287895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d75b4803-c62f-4e63-85d4-681a331e6f7e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.158805 May 12 07:14:27.288450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1013/2112] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:27 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:27.863919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5113c1a3-e51b-4f33-9407-c4ebfb845608 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:27.864539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5113c1a3-e51b-4f33-9407-c4ebfb845608 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:27.871380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5113c1a3-e51b-4f33-9407-c4ebfb845608 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:27.871864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5113c1a3-e51b-4f33-9407-c4ebfb845608 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:27.872640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5113c1a3-e51b-4f33-9407-c4ebfb845608 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:27.873087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5113c1a3-e51b-4f33-9407-c4ebfb845608 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:28.003040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5113c1a3-e51b-4f33-9407-c4ebfb845608 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:28.011543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5113c1a3-e51b-4f33-9407-c4ebfb845608 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.151628 May 12 07:14:28.012139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1100/2113] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:27 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:28.307251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f888c5cc-ad8b-460a-92a5-ee1167174fce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:28.307949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f888c5cc-ad8b-460a-92a5-ee1167174fce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:28.314342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f888c5cc-ad8b-460a-92a5-ee1167174fce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:28.314804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f888c5cc-ad8b-460a-92a5-ee1167174fce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:28.315609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f888c5cc-ad8b-460a-92a5-ee1167174fce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:28.316081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f888c5cc-ad8b-460a-92a5-ee1167174fce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:28.452050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f888c5cc-ad8b-460a-92a5-ee1167174fce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:28.460559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f888c5cc-ad8b-460a-92a5-ee1167174fce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:28.462069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f888c5cc-ad8b-460a-92a5-ee1167174fce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:28.463236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f888c5cc-ad8b-460a-92a5-ee1167174fce tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.160721 May 12 07:14:28.463824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1014/2114] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:28 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:29.030171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-38863b69-1faf-4317-8023-7362f2971df6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:29.030791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-38863b69-1faf-4317-8023-7362f2971df6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:29.037145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38863b69-1faf-4317-8023-7362f2971df6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:29.037600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38863b69-1faf-4317-8023-7362f2971df6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:29.038423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38863b69-1faf-4317-8023-7362f2971df6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:29.038868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-38863b69-1faf-4317-8023-7362f2971df6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:29.172052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-38863b69-1faf-4317-8023-7362f2971df6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:29.180353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-38863b69-1faf-4317-8023-7362f2971df6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.154682 May 12 07:14:29.180928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1101/2115] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:29 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:29.481741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-766bfde5-1e6c-4f1c-a82e-094bdbb67d6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:29.482278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-766bfde5-1e6c-4f1c-a82e-094bdbb67d6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:29.488746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-766bfde5-1e6c-4f1c-a82e-094bdbb67d6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:29.489262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-766bfde5-1e6c-4f1c-a82e-094bdbb67d6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:29.490168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-766bfde5-1e6c-4f1c-a82e-094bdbb67d6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:29.490961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-766bfde5-1e6c-4f1c-a82e-094bdbb67d6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:29.624179 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-766bfde5-1e6c-4f1c-a82e-094bdbb67d6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:29.633663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-766bfde5-1e6c-4f1c-a82e-094bdbb67d6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:29.635815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-766bfde5-1e6c-4f1c-a82e-094bdbb67d6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:29.636990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-766bfde5-1e6c-4f1c-a82e-094bdbb67d6c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.159313 May 12 07:14:29.637542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1015/2116] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:29 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:30.197369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b36e8904-8c6b-4263-8555-9329b4eafa9c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:30.197993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b36e8904-8c6b-4263-8555-9329b4eafa9c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:30.204482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b36e8904-8c6b-4263-8555-9329b4eafa9c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:30.204935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b36e8904-8c6b-4263-8555-9329b4eafa9c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:30.205710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b36e8904-8c6b-4263-8555-9329b4eafa9c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:30.206155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b36e8904-8c6b-4263-8555-9329b4eafa9c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:30.334239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b36e8904-8c6b-4263-8555-9329b4eafa9c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:30.346649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b36e8904-8c6b-4263-8555-9329b4eafa9c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.153146 May 12 07:14:30.347244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1102/2117] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:30 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:30.657170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ed60f0d3-767e-4d5e-9a83-0c62f88d023c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:30.658006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ed60f0d3-767e-4d5e-9a83-0c62f88d023c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:30.664493 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed60f0d3-767e-4d5e-9a83-0c62f88d023c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:30.664947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed60f0d3-767e-4d5e-9a83-0c62f88d023c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:30.665723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed60f0d3-767e-4d5e-9a83-0c62f88d023c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:30.666160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed60f0d3-767e-4d5e-9a83-0c62f88d023c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:30.796624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ed60f0d3-767e-4d5e-9a83-0c62f88d023c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:30.805119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ed60f0d3-767e-4d5e-9a83-0c62f88d023c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:30.806617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ed60f0d3-767e-4d5e-9a83-0c62f88d023c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:30.807800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ed60f0d3-767e-4d5e-9a83-0c62f88d023c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.156263 May 12 07:14:30.808849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1016/2118] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:30 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:31.364388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-973b1a54-6c07-4e94-b2ba-5d57ebc9c05e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:31.364959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-973b1a54-6c07-4e94-b2ba-5d57ebc9c05e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:31.371339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-973b1a54-6c07-4e94-b2ba-5d57ebc9c05e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:31.371826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-973b1a54-6c07-4e94-b2ba-5d57ebc9c05e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:31.372687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-973b1a54-6c07-4e94-b2ba-5d57ebc9c05e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:31.373028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-973b1a54-6c07-4e94-b2ba-5d57ebc9c05e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:31.506180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-973b1a54-6c07-4e94-b2ba-5d57ebc9c05e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:31.514524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-973b1a54-6c07-4e94-b2ba-5d57ebc9c05e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.154248 May 12 07:14:31.515153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1103/2119] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:31 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:31.828124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-320107a8-d4e2-4b71-9e56-148cd6da622c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:31.828734 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-320107a8-d4e2-4b71-9e56-148cd6da622c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:31.834678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-320107a8-d4e2-4b71-9e56-148cd6da622c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:31.835129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-320107a8-d4e2-4b71-9e56-148cd6da622c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:31.835934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-320107a8-d4e2-4b71-9e56-148cd6da622c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:31.836374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-320107a8-d4e2-4b71-9e56-148cd6da622c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:31.964774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-320107a8-d4e2-4b71-9e56-148cd6da622c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:31.973227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-320107a8-d4e2-4b71-9e56-148cd6da622c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:31.974753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-320107a8-d4e2-4b71-9e56-148cd6da622c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:31.975953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-320107a8-d4e2-4b71-9e56-148cd6da622c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152630 May 12 07:14:31.976509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1017/2120] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:31 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:32.531294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fd4fde0a-2b53-4de2-be96-5bda86d66ff1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:32.531957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fd4fde0a-2b53-4de2-be96-5bda86d66ff1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:32.538314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fd4fde0a-2b53-4de2-be96-5bda86d66ff1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:32.538766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fd4fde0a-2b53-4de2-be96-5bda86d66ff1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:32.539532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fd4fde0a-2b53-4de2-be96-5bda86d66ff1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:32.540000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fd4fde0a-2b53-4de2-be96-5bda86d66ff1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:32.675379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fd4fde0a-2b53-4de2-be96-5bda86d66ff1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:32.683055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fd4fde0a-2b53-4de2-be96-5bda86d66ff1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.156142 May 12 07:14:32.683717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1104/2121] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:32 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:32.995182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-84a7c08c-4851-4115-abc3-ce7081a4c64e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:32.996821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-84a7c08c-4851-4115-abc3-ce7081a4c64e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:33.004133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84a7c08c-4851-4115-abc3-ce7081a4c64e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:33.004588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84a7c08c-4851-4115-abc3-ce7081a4c64e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:33.005371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84a7c08c-4851-4115-abc3-ce7081a4c64e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:33.005810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84a7c08c-4851-4115-abc3-ce7081a4c64e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:33.134418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-84a7c08c-4851-4115-abc3-ce7081a4c64e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:33.143590 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-84a7c08c-4851-4115-abc3-ce7081a4c64e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:33.145740 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-84a7c08c-4851-4115-abc3-ce7081a4c64e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:33.146905 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-84a7c08c-4851-4115-abc3-ce7081a4c64e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.155890 May 12 07:14:33.147453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1018/2122] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:32 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:33.700344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3579f112-5b14-4453-a94f-ad13ee3dc93b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:33.700958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3579f112-5b14-4453-a94f-ad13ee3dc93b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:33.708062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3579f112-5b14-4453-a94f-ad13ee3dc93b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:33.708624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3579f112-5b14-4453-a94f-ad13ee3dc93b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:33.709443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3579f112-5b14-4453-a94f-ad13ee3dc93b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:33.710021 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3579f112-5b14-4453-a94f-ad13ee3dc93b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:33.838989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3579f112-5b14-4453-a94f-ad13ee3dc93b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:33.847525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3579f112-5b14-4453-a94f-ad13ee3dc93b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.151169 May 12 07:14:33.848128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1105/2123] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:33 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:34.165348 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-64bf2116-9927-48cc-9e06-429c4fab7447 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:34.165967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-64bf2116-9927-48cc-9e06-429c4fab7447 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:34.172373 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64bf2116-9927-48cc-9e06-429c4fab7447 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:34.173092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64bf2116-9927-48cc-9e06-429c4fab7447 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:34.173870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64bf2116-9927-48cc-9e06-429c4fab7447 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:34.174312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-64bf2116-9927-48cc-9e06-429c4fab7447 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:34.303964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-64bf2116-9927-48cc-9e06-429c4fab7447 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:34.312449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-64bf2116-9927-48cc-9e06-429c4fab7447 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:34.313963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-64bf2116-9927-48cc-9e06-429c4fab7447 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:34.315138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-64bf2116-9927-48cc-9e06-429c4fab7447 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.153764 May 12 07:14:34.315715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1019/2124] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:34 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:34.865836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-56b93e2e-dde4-4785-a33b-58ee51eb44f2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:34.866457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-56b93e2e-dde4-4785-a33b-58ee51eb44f2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:34.872851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56b93e2e-dde4-4785-a33b-58ee51eb44f2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:34.873304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56b93e2e-dde4-4785-a33b-58ee51eb44f2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:34.874090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56b93e2e-dde4-4785-a33b-58ee51eb44f2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:34.874531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56b93e2e-dde4-4785-a33b-58ee51eb44f2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:35.004981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-56b93e2e-dde4-4785-a33b-58ee51eb44f2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:35.013146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-56b93e2e-dde4-4785-a33b-58ee51eb44f2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.151394 May 12 07:14:35.013720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1106/2125] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:34 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:35.334035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-42483ec5-34bd-483a-a51c-2b35244d5d0f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:35.334644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-42483ec5-34bd-483a-a51c-2b35244d5d0f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:35.340918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42483ec5-34bd-483a-a51c-2b35244d5d0f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:35.341388 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42483ec5-34bd-483a-a51c-2b35244d5d0f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:35.342148 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42483ec5-34bd-483a-a51c-2b35244d5d0f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:35.342590 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42483ec5-34bd-483a-a51c-2b35244d5d0f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:35.473297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-42483ec5-34bd-483a-a51c-2b35244d5d0f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:35.481564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-42483ec5-34bd-483a-a51c-2b35244d5d0f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:35.483066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-42483ec5-34bd-483a-a51c-2b35244d5d0f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:35.484270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-42483ec5-34bd-483a-a51c-2b35244d5d0f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.154182 May 12 07:14:35.484822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1020/2126] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:35 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:36.030685 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5ec1eda3-dcc7-462e-872a-92f0d31a7d7b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:36.031307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5ec1eda3-dcc7-462e-872a-92f0d31a7d7b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:36.037806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ec1eda3-dcc7-462e-872a-92f0d31a7d7b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:36.038256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ec1eda3-dcc7-462e-872a-92f0d31a7d7b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:36.039031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ec1eda3-dcc7-462e-872a-92f0d31a7d7b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:36.039467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ec1eda3-dcc7-462e-872a-92f0d31a7d7b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:36.165921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5ec1eda3-dcc7-462e-872a-92f0d31a7d7b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:36.174544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5ec1eda3-dcc7-462e-872a-92f0d31a7d7b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148220 May 12 07:14:36.175114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1107/2127] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:36 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:36.503500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c307fb77-e2df-4384-a462-0951fc0b7340 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:36.504143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c307fb77-e2df-4384-a462-0951fc0b7340 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:36.510481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c307fb77-e2df-4384-a462-0951fc0b7340 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:36.510934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c307fb77-e2df-4384-a462-0951fc0b7340 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:36.511716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c307fb77-e2df-4384-a462-0951fc0b7340 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:36.512660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c307fb77-e2df-4384-a462-0951fc0b7340 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:36.641522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c307fb77-e2df-4384-a462-0951fc0b7340 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:36.649759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c307fb77-e2df-4384-a462-0951fc0b7340 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:36.651257 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c307fb77-e2df-4384-a462-0951fc0b7340 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:36.652457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c307fb77-e2df-4384-a462-0951fc0b7340 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152941 May 12 07:14:36.653642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1021/2128] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:36 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:37.191405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5aa5c1c0-fc83-4821-bc49-13d42fec43c6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:37.192117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5aa5c1c0-fc83-4821-bc49-13d42fec43c6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:37.198546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa5c1c0-fc83-4821-bc49-13d42fec43c6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:37.199000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa5c1c0-fc83-4821-bc49-13d42fec43c6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:37.199798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa5c1c0-fc83-4821-bc49-13d42fec43c6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:37.200239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa5c1c0-fc83-4821-bc49-13d42fec43c6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:37.324042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5aa5c1c0-fc83-4821-bc49-13d42fec43c6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:37.331774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5aa5c1c0-fc83-4821-bc49-13d42fec43c6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144174 May 12 07:14:37.332340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1108/2129] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:37 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:37.672150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-02e3a7e4-e0c8-4240-b330-190e32aabf5e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:37.672949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-02e3a7e4-e0c8-4240-b330-190e32aabf5e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:37.679275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-02e3a7e4-e0c8-4240-b330-190e32aabf5e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:37.679771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-02e3a7e4-e0c8-4240-b330-190e32aabf5e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:37.680548 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-02e3a7e4-e0c8-4240-b330-190e32aabf5e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:37.680987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-02e3a7e4-e0c8-4240-b330-190e32aabf5e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:37.804105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-02e3a7e4-e0c8-4240-b330-190e32aabf5e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:37.812254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-02e3a7e4-e0c8-4240-b330-190e32aabf5e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:37.813754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-02e3a7e4-e0c8-4240-b330-190e32aabf5e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:37.814919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-02e3a7e4-e0c8-4240-b330-190e32aabf5e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147357 May 12 07:14:37.815483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1022/2130] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:37 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:38.348772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1940cd2a-545f-43e7-a8d7-b0b43e626a91 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:38.349444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1940cd2a-545f-43e7-a8d7-b0b43e626a91 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:38.356118 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1940cd2a-545f-43e7-a8d7-b0b43e626a91 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:38.356573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1940cd2a-545f-43e7-a8d7-b0b43e626a91 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:38.357357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1940cd2a-545f-43e7-a8d7-b0b43e626a91 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:38.357855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1940cd2a-545f-43e7-a8d7-b0b43e626a91 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:38.492763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1940cd2a-545f-43e7-a8d7-b0b43e626a91 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:38.501201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1940cd2a-545f-43e7-a8d7-b0b43e626a91 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.156387 May 12 07:14:38.501807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1109/2131] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:38 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:38.832961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-74534a2b-ccb0-4889-88ef-2700d39ff466 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:38.833655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-74534a2b-ccb0-4889-88ef-2700d39ff466 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:38.839977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74534a2b-ccb0-4889-88ef-2700d39ff466 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:38.840431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74534a2b-ccb0-4889-88ef-2700d39ff466 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:38.841203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74534a2b-ccb0-4889-88ef-2700d39ff466 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:38.841644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-74534a2b-ccb0-4889-88ef-2700d39ff466 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:38.967280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-74534a2b-ccb0-4889-88ef-2700d39ff466 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:38.975510 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-74534a2b-ccb0-4889-88ef-2700d39ff466 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:38.977054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-74534a2b-ccb0-4889-88ef-2700d39ff466 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:38.978220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-74534a2b-ccb0-4889-88ef-2700d39ff466 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149205 May 12 07:14:38.978774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1023/2132] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:38 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:39.518264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dd471b6e-290d-438c-afd5-dc94a91d5543 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:39.518876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dd471b6e-290d-438c-afd5-dc94a91d5543 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:39.525118 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd471b6e-290d-438c-afd5-dc94a91d5543 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:39.525564 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd471b6e-290d-438c-afd5-dc94a91d5543 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:39.526325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd471b6e-290d-438c-afd5-dc94a91d5543 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:39.526755 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd471b6e-290d-438c-afd5-dc94a91d5543 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:39.651588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dd471b6e-290d-438c-afd5-dc94a91d5543 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:39.659463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dd471b6e-290d-438c-afd5-dc94a91d5543 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145077 May 12 07:14:39.660064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1110/2133] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:39 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:39.997502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c494ff89-c1fb-466b-ad46-60304e0ba5a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:39.998121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c494ff89-c1fb-466b-ad46-60304e0ba5a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:40.004636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c494ff89-c1fb-466b-ad46-60304e0ba5a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:40.005111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c494ff89-c1fb-466b-ad46-60304e0ba5a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:40.005878 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c494ff89-c1fb-466b-ad46-60304e0ba5a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:40.006412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c494ff89-c1fb-466b-ad46-60304e0ba5a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:40.131477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c494ff89-c1fb-466b-ad46-60304e0ba5a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:40.140315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c494ff89-c1fb-466b-ad46-60304e0ba5a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:40.141847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c494ff89-c1fb-466b-ad46-60304e0ba5a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:40.143021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c494ff89-c1fb-466b-ad46-60304e0ba5a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149523 May 12 07:14:40.143581 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1024/2134] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:39 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:40.677004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-87fac6e5-fc55-45eb-81cf-c881e1635444 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:40.677647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-87fac6e5-fc55-45eb-81cf-c881e1635444 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:40.684516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-87fac6e5-fc55-45eb-81cf-c881e1635444 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:40.684966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-87fac6e5-fc55-45eb-81cf-c881e1635444 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:40.685746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-87fac6e5-fc55-45eb-81cf-c881e1635444 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:40.686161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-87fac6e5-fc55-45eb-81cf-c881e1635444 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:40.809537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-87fac6e5-fc55-45eb-81cf-c881e1635444 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:40.817261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-87fac6e5-fc55-45eb-81cf-c881e1635444 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144387 May 12 07:14:40.817826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1111/2135] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:40 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:41.163109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b904c763-f06e-4892-be23-439821465baf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:41.163772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b904c763-f06e-4892-be23-439821465baf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:41.170520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b904c763-f06e-4892-be23-439821465baf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:41.170967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b904c763-f06e-4892-be23-439821465baf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:41.171749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b904c763-f06e-4892-be23-439821465baf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:41.172214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b904c763-f06e-4892-be23-439821465baf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:41.298515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b904c763-f06e-4892-be23-439821465baf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:41.306645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b904c763-f06e-4892-be23-439821465baf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:41.308178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b904c763-f06e-4892-be23-439821465baf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:41.309403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b904c763-f06e-4892-be23-439821465baf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150204 May 12 07:14:41.309960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1025/2136] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:41 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:41.834333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5faed2f5-f631-4942-8dc6-bb53bfbbcd87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:41.834945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5faed2f5-f631-4942-8dc6-bb53bfbbcd87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:41.841826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5faed2f5-f631-4942-8dc6-bb53bfbbcd87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:41.842273 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5faed2f5-f631-4942-8dc6-bb53bfbbcd87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:41.843084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5faed2f5-f631-4942-8dc6-bb53bfbbcd87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:41.843519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5faed2f5-f631-4942-8dc6-bb53bfbbcd87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:41.966680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5faed2f5-f631-4942-8dc6-bb53bfbbcd87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:41.974441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5faed2f5-f631-4942-8dc6-bb53bfbbcd87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144056 May 12 07:14:41.975007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1112/2137] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:41 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:42.328398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-944fff84-d8be-46e2-83c6-7d1ec308384d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:42.329020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-944fff84-d8be-46e2-83c6-7d1ec308384d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:42.335284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-944fff84-d8be-46e2-83c6-7d1ec308384d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:42.335767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-944fff84-d8be-46e2-83c6-7d1ec308384d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:42.336543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-944fff84-d8be-46e2-83c6-7d1ec308384d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:42.336987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-944fff84-d8be-46e2-83c6-7d1ec308384d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:42.462258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-944fff84-d8be-46e2-83c6-7d1ec308384d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:42.470544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-944fff84-d8be-46e2-83c6-7d1ec308384d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:42.472086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-944fff84-d8be-46e2-83c6-7d1ec308384d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:42.473253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-944fff84-d8be-46e2-83c6-7d1ec308384d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149380 May 12 07:14:42.473814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1026/2138] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:42 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:14:42.991713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7eeecd1b-8723-4377-86a2-8daa7032d560 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:42.992399 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7eeecd1b-8723-4377-86a2-8daa7032d560 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:42.998632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7eeecd1b-8723-4377-86a2-8daa7032d560 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:42.999079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7eeecd1b-8723-4377-86a2-8daa7032d560 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:42.999870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7eeecd1b-8723-4377-86a2-8daa7032d560 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:43.000306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7eeecd1b-8723-4377-86a2-8daa7032d560 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:43.123974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7eeecd1b-8723-4377-86a2-8daa7032d560 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:43.131807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7eeecd1b-8723-4377-86a2-8daa7032d560 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143996 May 12 07:14:43.132387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1113/2139] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:42 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:43.491122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-704b95f7-0112-4245-b0a2-80e68e2d70d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:43.491700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-704b95f7-0112-4245-b0a2-80e68e2d70d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:43.498665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-704b95f7-0112-4245-b0a2-80e68e2d70d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:43.499116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-704b95f7-0112-4245-b0a2-80e68e2d70d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:43.499940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-704b95f7-0112-4245-b0a2-80e68e2d70d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:43.500379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-704b95f7-0112-4245-b0a2-80e68e2d70d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:43.631425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-704b95f7-0112-4245-b0a2-80e68e2d70d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:43.640168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-704b95f7-0112-4245-b0a2-80e68e2d70d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:43.641661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-704b95f7-0112-4245-b0a2-80e68e2d70d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:43.642805 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-704b95f7-0112-4245-b0a2-80e68e2d70d0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.155724 May 12 07:14:43.643358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1027/2140] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:43 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:44.149235 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-85781048-4159-46f2-8b97-0476bfafc95a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:44.149848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-85781048-4159-46f2-8b97-0476bfafc95a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:44.156913 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85781048-4159-46f2-8b97-0476bfafc95a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:44.157354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85781048-4159-46f2-8b97-0476bfafc95a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:44.158115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85781048-4159-46f2-8b97-0476bfafc95a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:44.158549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85781048-4159-46f2-8b97-0476bfafc95a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:44.284767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-85781048-4159-46f2-8b97-0476bfafc95a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:44.292353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-85781048-4159-46f2-8b97-0476bfafc95a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147027 May 12 07:14:44.293576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1114/2141] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:44 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:44.661436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-915c6971-058c-4f30-8c49-ea01d53d249f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:44.661987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-915c6971-058c-4f30-8c49-ea01d53d249f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:44.668282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-915c6971-058c-4f30-8c49-ea01d53d249f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:44.670973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-915c6971-058c-4f30-8c49-ea01d53d249f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:44.670973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-915c6971-058c-4f30-8c49-ea01d53d249f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:44.670973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-915c6971-058c-4f30-8c49-ea01d53d249f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:44.795408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-915c6971-058c-4f30-8c49-ea01d53d249f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:44.803906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-915c6971-058c-4f30-8c49-ea01d53d249f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:44.805425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-915c6971-058c-4f30-8c49-ea01d53d249f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:44.806595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-915c6971-058c-4f30-8c49-ea01d53d249f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149202 May 12 07:14:44.807192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1028/2142] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:44 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:45.310141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0adb44e6-f5e5-4a42-9ff8-4d3755a05812 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:45.310678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0adb44e6-f5e5-4a42-9ff8-4d3755a05812 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:45.316951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0adb44e6-f5e5-4a42-9ff8-4d3755a05812 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:45.317407 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0adb44e6-f5e5-4a42-9ff8-4d3755a05812 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:45.318174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0adb44e6-f5e5-4a42-9ff8-4d3755a05812 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:45.318609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0adb44e6-f5e5-4a42-9ff8-4d3755a05812 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:45.681986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0adb44e6-f5e5-4a42-9ff8-4d3755a05812 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:45.689772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0adb44e6-f5e5-4a42-9ff8-4d3755a05812 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.383590 May 12 07:14:45.690342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1115/2143] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:45 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:45.825500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-15fac426-1a4f-4136-b4eb-553300a5a021 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:45.826113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-15fac426-1a4f-4136-b4eb-553300a5a021 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:45.832419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15fac426-1a4f-4136-b4eb-553300a5a021 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:45.838138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15fac426-1a4f-4136-b4eb-553300a5a021 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:45.838138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15fac426-1a4f-4136-b4eb-553300a5a021 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:45.838138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15fac426-1a4f-4136-b4eb-553300a5a021 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:45.957420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-15fac426-1a4f-4136-b4eb-553300a5a021 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:45.965859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-15fac426-1a4f-4136-b4eb-553300a5a021 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:45.967390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-15fac426-1a4f-4136-b4eb-553300a5a021 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:45.968585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-15fac426-1a4f-4136-b4eb-553300a5a021 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147639 May 12 07:14:45.969138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1029/2144] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:45 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:14:46.707080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3cb1635b-69fe-4b1f-9637-76e4ad2ce5a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:46.707709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3cb1635b-69fe-4b1f-9637-76e4ad2ce5a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:46.715582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3cb1635b-69fe-4b1f-9637-76e4ad2ce5a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:46.716129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3cb1635b-69fe-4b1f-9637-76e4ad2ce5a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:46.716899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3cb1635b-69fe-4b1f-9637-76e4ad2ce5a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:46.717338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3cb1635b-69fe-4b1f-9637-76e4ad2ce5a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:46.844068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3cb1635b-69fe-4b1f-9637-76e4ad2ce5a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:46.851885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3cb1635b-69fe-4b1f-9637-76e4ad2ce5a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149348 May 12 07:14:46.852454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1116/2145] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:46 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:46.986794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c7f1307f-30cc-486e-8cd5-fa5786d86867 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:46.987350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c7f1307f-30cc-486e-8cd5-fa5786d86867 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:46.993671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7f1307f-30cc-486e-8cd5-fa5786d86867 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:46.994119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7f1307f-30cc-486e-8cd5-fa5786d86867 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:46.994884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7f1307f-30cc-486e-8cd5-fa5786d86867 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:46.995324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7f1307f-30cc-486e-8cd5-fa5786d86867 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:47.117369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c7f1307f-30cc-486e-8cd5-fa5786d86867 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:47.125509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c7f1307f-30cc-486e-8cd5-fa5786d86867 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:47.127000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c7f1307f-30cc-486e-8cd5-fa5786d86867 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:47.128181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c7f1307f-30cc-486e-8cd5-fa5786d86867 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.145488 May 12 07:14:47.128744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1030/2146] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:46 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:47.868725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3e446f0a-3586-466f-9dcc-a8a02c9dd6ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:47.869344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3e446f0a-3586-466f-9dcc-a8a02c9dd6ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:47.876291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e446f0a-3586-466f-9dcc-a8a02c9dd6ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:47.876744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e446f0a-3586-466f-9dcc-a8a02c9dd6ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:47.877511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e446f0a-3586-466f-9dcc-a8a02c9dd6ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:47.877951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e446f0a-3586-466f-9dcc-a8a02c9dd6ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:48.005361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3e446f0a-3586-466f-9dcc-a8a02c9dd6ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:48.013157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3e446f0a-3586-466f-9dcc-a8a02c9dd6ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148277 May 12 07:14:48.013714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1117/2147] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:47 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:48.146372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f7b0a96f-7bc2-4087-82be-578227db602f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:48.146928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f7b0a96f-7bc2-4087-82be-578227db602f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:48.153714 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f7b0a96f-7bc2-4087-82be-578227db602f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:48.154159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f7b0a96f-7bc2-4087-82be-578227db602f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:48.154921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f7b0a96f-7bc2-4087-82be-578227db602f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:48.155353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f7b0a96f-7bc2-4087-82be-578227db602f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:48.286947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f7b0a96f-7bc2-4087-82be-578227db602f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:48.295676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f7b0a96f-7bc2-4087-82be-578227db602f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:48.297184 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f7b0a96f-7bc2-4087-82be-578227db602f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:48.298592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f7b0a96f-7bc2-4087-82be-578227db602f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.156250 May 12 07:14:48.299142 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1031/2148] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:48 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:49.029856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0836b935-661c-467c-ac19-87f19def3c1e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:49.030465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0836b935-661c-467c-ac19-87f19def3c1e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:49.036713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0836b935-661c-467c-ac19-87f19def3c1e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:49.037158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0836b935-661c-467c-ac19-87f19def3c1e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:49.037917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0836b935-661c-467c-ac19-87f19def3c1e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:49.038353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0836b935-661c-467c-ac19-87f19def3c1e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:49.164019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0836b935-661c-467c-ac19-87f19def3c1e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:49.172525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0836b935-661c-467c-ac19-87f19def3c1e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146514 May 12 07:14:49.173358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1118/2149] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:49 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:49.316227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5cec8deb-21e8-4a77-a6ef-1d7fabf9ac31 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:49.316773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5cec8deb-21e8-4a77-a6ef-1d7fabf9ac31 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:49.323076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cec8deb-21e8-4a77-a6ef-1d7fabf9ac31 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:49.323524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cec8deb-21e8-4a77-a6ef-1d7fabf9ac31 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:49.324314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cec8deb-21e8-4a77-a6ef-1d7fabf9ac31 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:49.324754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cec8deb-21e8-4a77-a6ef-1d7fabf9ac31 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:49.449390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5cec8deb-21e8-4a77-a6ef-1d7fabf9ac31 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:49.457992 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5cec8deb-21e8-4a77-a6ef-1d7fabf9ac31 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:49.459486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5cec8deb-21e8-4a77-a6ef-1d7fabf9ac31 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:49.460671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5cec8deb-21e8-4a77-a6ef-1d7fabf9ac31 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148410 May 12 07:14:49.461220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1032/2150] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:49 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:50.189708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9713781c-253b-4aca-a4cd-7bd1b0f11710 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:50.190330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9713781c-253b-4aca-a4cd-7bd1b0f11710 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:50.196659 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9713781c-253b-4aca-a4cd-7bd1b0f11710 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:50.197110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9713781c-253b-4aca-a4cd-7bd1b0f11710 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:50.197887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9713781c-253b-4aca-a4cd-7bd1b0f11710 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:50.198325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9713781c-253b-4aca-a4cd-7bd1b0f11710 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:50.326543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9713781c-253b-4aca-a4cd-7bd1b0f11710 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:50.332236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9713781c-253b-4aca-a4cd-7bd1b0f11710 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146432 May 12 07:14:50.332809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1119/2151] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:50 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:50.479279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-46bef8c7-ac55-4e20-b334-f493deb631bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:50.479923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-46bef8c7-ac55-4e20-b334-f493deb631bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:50.486177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46bef8c7-ac55-4e20-b334-f493deb631bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:50.486623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46bef8c7-ac55-4e20-b334-f493deb631bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:50.487387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46bef8c7-ac55-4e20-b334-f493deb631bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:50.487875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46bef8c7-ac55-4e20-b334-f493deb631bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:50.614387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-46bef8c7-ac55-4e20-b334-f493deb631bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:50.623190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-46bef8c7-ac55-4e20-b334-f493deb631bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:50.624709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-46bef8c7-ac55-4e20-b334-f493deb631bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:50.625866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-46bef8c7-ac55-4e20-b334-f493deb631bd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150419 May 12 07:14:50.626424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1033/2152] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:50 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:51.351437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9526a3f4-f526-46a9-b195-4b39f00ff845 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:51.352011 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9526a3f4-f526-46a9-b195-4b39f00ff845 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:51.357995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9526a3f4-f526-46a9-b195-4b39f00ff845 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:51.358448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9526a3f4-f526-46a9-b195-4b39f00ff845 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:51.359218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9526a3f4-f526-46a9-b195-4b39f00ff845 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:51.359659 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9526a3f4-f526-46a9-b195-4b39f00ff845 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:51.488388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9526a3f4-f526-46a9-b195-4b39f00ff845 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:51.496277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9526a3f4-f526-46a9-b195-4b39f00ff845 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148900 May 12 07:14:51.496844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1120/2153] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:51 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:51.644334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-00dac16a-5b27-45ff-abb5-72412183e1a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:51.644871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-00dac16a-5b27-45ff-abb5-72412183e1a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:51.651144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00dac16a-5b27-45ff-abb5-72412183e1a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:51.651597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00dac16a-5b27-45ff-abb5-72412183e1a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:51.653062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00dac16a-5b27-45ff-abb5-72412183e1a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:51.653500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00dac16a-5b27-45ff-abb5-72412183e1a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:51.777935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-00dac16a-5b27-45ff-abb5-72412183e1a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:51.785935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-00dac16a-5b27-45ff-abb5-72412183e1a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:51.787428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-00dac16a-5b27-45ff-abb5-72412183e1a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:51.788612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-00dac16a-5b27-45ff-abb5-72412183e1a4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148306 May 12 07:14:51.789176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1034/2154] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:51 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:52.512964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c5176fa7-3f65-41c5-a913-3aef60592b3f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:52.513577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c5176fa7-3f65-41c5-a913-3aef60592b3f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:52.519895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5176fa7-3f65-41c5-a913-3aef60592b3f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:52.520345 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5176fa7-3f65-41c5-a913-3aef60592b3f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:52.521112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5176fa7-3f65-41c5-a913-3aef60592b3f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:52.521549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5176fa7-3f65-41c5-a913-3aef60592b3f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:52.647868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c5176fa7-3f65-41c5-a913-3aef60592b3f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:52.656931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c5176fa7-3f65-41c5-a913-3aef60592b3f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147713 May 12 07:14:52.657494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1121/2155] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:52 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:52.806665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-15fadb05-7059-4545-9f9c-447688952b4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:52.807206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-15fadb05-7059-4545-9f9c-447688952b4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:52.813564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15fadb05-7059-4545-9f9c-447688952b4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:52.814043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15fadb05-7059-4545-9f9c-447688952b4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:52.814817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15fadb05-7059-4545-9f9c-447688952b4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:52.815255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-15fadb05-7059-4545-9f9c-447688952b4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:52.941349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-15fadb05-7059-4545-9f9c-447688952b4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:52.950404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-15fadb05-7059-4545-9f9c-447688952b4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:52.951962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-15fadb05-7059-4545-9f9c-447688952b4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:52.953129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-15fadb05-7059-4545-9f9c-447688952b4c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150439 May 12 07:14:52.953689 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1035/2156] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:52 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:53.674679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cb559b1c-7c34-47cb-9af8-4e2aadeda011 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:53.675359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cb559b1c-7c34-47cb-9af8-4e2aadeda011 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:53.681687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb559b1c-7c34-47cb-9af8-4e2aadeda011 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:53.682164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb559b1c-7c34-47cb-9af8-4e2aadeda011 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:53.683545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb559b1c-7c34-47cb-9af8-4e2aadeda011 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:53.684016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb559b1c-7c34-47cb-9af8-4e2aadeda011 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:53.812228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cb559b1c-7c34-47cb-9af8-4e2aadeda011 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:53.820002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cb559b1c-7c34-47cb-9af8-4e2aadeda011 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149458 May 12 07:14:53.820576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1122/2157] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:53 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:53.973078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3e9054fa-9cf7-4edc-8e31-8055d190f42a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:53.973596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3e9054fa-9cf7-4edc-8e31-8055d190f42a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:53.980605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e9054fa-9cf7-4edc-8e31-8055d190f42a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:53.981053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e9054fa-9cf7-4edc-8e31-8055d190f42a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:53.981869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e9054fa-9cf7-4edc-8e31-8055d190f42a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:53.982302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e9054fa-9cf7-4edc-8e31-8055d190f42a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:54.106222 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3e9054fa-9cf7-4edc-8e31-8055d190f42a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:54.115040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3e9054fa-9cf7-4edc-8e31-8055d190f42a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:54.116605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3e9054fa-9cf7-4edc-8e31-8055d190f42a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:54.117753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3e9054fa-9cf7-4edc-8e31-8055d190f42a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148609 May 12 07:14:54.118314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1036/2158] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:53 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:54.836789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a8c255ed-951b-43fd-9503-e734101f3e43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:54.837380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a8c255ed-951b-43fd-9503-e734101f3e43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:54.843732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8c255ed-951b-43fd-9503-e734101f3e43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:54.844180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8c255ed-951b-43fd-9503-e734101f3e43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:54.844946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8c255ed-951b-43fd-9503-e734101f3e43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:54.845380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8c255ed-951b-43fd-9503-e734101f3e43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:54.973391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a8c255ed-951b-43fd-9503-e734101f3e43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:54.981302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a8c255ed-951b-43fd-9503-e734101f3e43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148438 May 12 07:14:54.981902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1123/2159] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:54 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:55.136263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ef3cdd08-cc7a-49fd-bba2-202635f595e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:55.136791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ef3cdd08-cc7a-49fd-bba2-202635f595e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:55.143062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef3cdd08-cc7a-49fd-bba2-202635f595e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:55.143511 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef3cdd08-cc7a-49fd-bba2-202635f595e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:55.144318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef3cdd08-cc7a-49fd-bba2-202635f595e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:55.144754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef3cdd08-cc7a-49fd-bba2-202635f595e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:55.269278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ef3cdd08-cc7a-49fd-bba2-202635f595e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:55.278308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ef3cdd08-cc7a-49fd-bba2-202635f595e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:55.279854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ef3cdd08-cc7a-49fd-bba2-202635f595e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:55.281039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ef3cdd08-cc7a-49fd-bba2-202635f595e9 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149169 May 12 07:14:55.281588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1037/2160] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:55 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:55.997999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3e3c010f-1e79-4f8a-b84d-a2573db82965 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:55.998743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3e3c010f-1e79-4f8a-b84d-a2573db82965 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:56.004870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e3c010f-1e79-4f8a-b84d-a2573db82965 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:56.005320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e3c010f-1e79-4f8a-b84d-a2573db82965 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:56.006083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e3c010f-1e79-4f8a-b84d-a2573db82965 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:56.006518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e3c010f-1e79-4f8a-b84d-a2573db82965 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:56.131442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3e3c010f-1e79-4f8a-b84d-a2573db82965 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:56.139643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3e3c010f-1e79-4f8a-b84d-a2573db82965 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145508 May 12 07:14:56.140236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1124/2161] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:55 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:56.299558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1cefbefc-e67e-4703-84e6-aee596c4061b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:56.300126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1cefbefc-e67e-4703-84e6-aee596c4061b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:56.306507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cefbefc-e67e-4703-84e6-aee596c4061b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:56.306960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cefbefc-e67e-4703-84e6-aee596c4061b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:56.308258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cefbefc-e67e-4703-84e6-aee596c4061b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:56.308706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cefbefc-e67e-4703-84e6-aee596c4061b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:56.435396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1cefbefc-e67e-4703-84e6-aee596c4061b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:56.443574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1cefbefc-e67e-4703-84e6-aee596c4061b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:56.445112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1cefbefc-e67e-4703-84e6-aee596c4061b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:56.446262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1cefbefc-e67e-4703-84e6-aee596c4061b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150942 May 12 07:14:56.446817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1038/2162] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:56 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:57.157572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-79080723-5c58-409d-a47b-e828ab86ef18 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:57.157572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-79080723-5c58-409d-a47b-e828ab86ef18 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:57.164002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-79080723-5c58-409d-a47b-e828ab86ef18 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:57.164449 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-79080723-5c58-409d-a47b-e828ab86ef18 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:57.165223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-79080723-5c58-409d-a47b-e828ab86ef18 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:57.165661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-79080723-5c58-409d-a47b-e828ab86ef18 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:57.291055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-79080723-5c58-409d-a47b-e828ab86ef18 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:57.299704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-79080723-5c58-409d-a47b-e828ab86ef18 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146648 May 12 07:14:57.300267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1125/2163] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:57 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:57.465410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6db9d66e-d616-4c1b-81f0-ee971b98acac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:57.466025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6db9d66e-d616-4c1b-81f0-ee971b98acac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:57.472317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6db9d66e-d616-4c1b-81f0-ee971b98acac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:57.472777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6db9d66e-d616-4c1b-81f0-ee971b98acac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:57.473555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6db9d66e-d616-4c1b-81f0-ee971b98acac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:57.474004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6db9d66e-d616-4c1b-81f0-ee971b98acac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:57.600981 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6db9d66e-d616-4c1b-81f0-ee971b98acac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:57.609686 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6db9d66e-d616-4c1b-81f0-ee971b98acac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:57.611398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6db9d66e-d616-4c1b-81f0-ee971b98acac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:57.612745 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6db9d66e-d616-4c1b-81f0-ee971b98acac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151774 May 12 07:14:57.613319 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1039/2164] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:57 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:58.316679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-68e8dc46-873c-4b8f-be71-427bacc0e28c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:58.317196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-68e8dc46-873c-4b8f-be71-427bacc0e28c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:58.323551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68e8dc46-873c-4b8f-be71-427bacc0e28c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:58.324037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68e8dc46-873c-4b8f-be71-427bacc0e28c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:58.324810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68e8dc46-873c-4b8f-be71-427bacc0e28c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:58.325249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-68e8dc46-873c-4b8f-be71-427bacc0e28c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:58.449104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-68e8dc46-873c-4b8f-be71-427bacc0e28c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:58.456856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-68e8dc46-873c-4b8f-be71-427bacc0e28c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144160 May 12 07:14:58.457426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1126/2165] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:58 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:58.631023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c3b67678-70cc-4140-a263-a348fab1ccdb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:58.631577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c3b67678-70cc-4140-a263-a348fab1ccdb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:58.637878 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3b67678-70cc-4140-a263-a348fab1ccdb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:58.638343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3b67678-70cc-4140-a263-a348fab1ccdb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:58.639115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3b67678-70cc-4140-a263-a348fab1ccdb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:58.639582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3b67678-70cc-4140-a263-a348fab1ccdb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:58.766186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c3b67678-70cc-4140-a263-a348fab1ccdb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:58.774569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c3b67678-70cc-4140-a263-a348fab1ccdb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:58.776115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c3b67678-70cc-4140-a263-a348fab1ccdb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:58.777772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c3b67678-70cc-4140-a263-a348fab1ccdb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150679 May 12 07:14:58.778332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1040/2166] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:58 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:14:59.474353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bc741c06-d26e-4fb8-8378-09791815a7f8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:59.474885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bc741c06-d26e-4fb8-8378-09791815a7f8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:59.481221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc741c06-d26e-4fb8-8378-09791815a7f8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:59.481680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc741c06-d26e-4fb8-8378-09791815a7f8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:59.482454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc741c06-d26e-4fb8-8378-09791815a7f8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:59.482896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc741c06-d26e-4fb8-8378-09791815a7f8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:59.612558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bc741c06-d26e-4fb8-8378-09791815a7f8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:59.620927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bc741c06-d26e-4fb8-8378-09791815a7f8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149986 May 12 07:14:59.621528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1127/2167] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:14:59 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:14:59.796563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2044c956-5b93-4fe2-8cc1-f510cf49b10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:14:59.797176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2044c956-5b93-4fe2-8cc1-f510cf49b10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:14:59.803789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2044c956-5b93-4fe2-8cc1-f510cf49b10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:59.804242 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2044c956-5b93-4fe2-8cc1-f510cf49b10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:59.805007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2044c956-5b93-4fe2-8cc1-f510cf49b10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:14:59.805444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2044c956-5b93-4fe2-8cc1-f510cf49b10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:14:59.930207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2044c956-5b93-4fe2-8cc1-f510cf49b10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:59.939089 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2044c956-5b93-4fe2-8cc1-f510cf49b10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:59.940630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2044c956-5b93-4fe2-8cc1-f510cf49b10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:14:59.941817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2044c956-5b93-4fe2-8cc1-f510cf49b10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149656 May 12 07:14:59.942387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1041/2168] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:14:59 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:00.638390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-995c53f7-7f3b-4827-94c1-4609c593d7d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:00.639034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-995c53f7-7f3b-4827-94c1-4609c593d7d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:00.645248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-995c53f7-7f3b-4827-94c1-4609c593d7d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:00.646441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-995c53f7-7f3b-4827-94c1-4609c593d7d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:00.647218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-995c53f7-7f3b-4827-94c1-4609c593d7d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:00.647804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-995c53f7-7f3b-4827-94c1-4609c593d7d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:00.803656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-995c53f7-7f3b-4827-94c1-4609c593d7d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:00.812323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-995c53f7-7f3b-4827-94c1-4609c593d7d7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.178255 May 12 07:15:00.812893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1128/2169] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:00 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:00.961911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bf39fe03-a107-402f-83a4-7830926070ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:00.962775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bf39fe03-a107-402f-83a4-7830926070ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:00.970017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf39fe03-a107-402f-83a4-7830926070ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:00.970467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf39fe03-a107-402f-83a4-7830926070ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:00.971244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf39fe03-a107-402f-83a4-7830926070ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:00.971706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bf39fe03-a107-402f-83a4-7830926070ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:01.101683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bf39fe03-a107-402f-83a4-7830926070ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:01.114507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bf39fe03-a107-402f-83a4-7830926070ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:01.116038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bf39fe03-a107-402f-83a4-7830926070ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:01.117197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bf39fe03-a107-402f-83a4-7830926070ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.160949 May 12 07:15:01.117750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1042/2170] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:00 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:01.829889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8e8faec2-e3f2-4f5c-acea-c142d67b9177 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:01.839498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8e8faec2-e3f2-4f5c-acea-c142d67b9177 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:01.839498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e8faec2-e3f2-4f5c-acea-c142d67b9177 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:01.839498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e8faec2-e3f2-4f5c-acea-c142d67b9177 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:01.839498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e8faec2-e3f2-4f5c-acea-c142d67b9177 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:01.840010 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e8faec2-e3f2-4f5c-acea-c142d67b9177 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:01.968350 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8e8faec2-e3f2-4f5c-acea-c142d67b9177 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:01.976146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8e8faec2-e3f2-4f5c-acea-c142d67b9177 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150183 May 12 07:15:01.976794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1129/2171] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:01 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:02.136724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-26f9396d-9727-49eb-be0c-8c775107cd57 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:02.137274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-26f9396d-9727-49eb-be0c-8c775107cd57 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:02.143632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26f9396d-9727-49eb-be0c-8c775107cd57 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:02.144134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26f9396d-9727-49eb-be0c-8c775107cd57 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:02.144910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26f9396d-9727-49eb-be0c-8c775107cd57 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:02.145355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26f9396d-9727-49eb-be0c-8c775107cd57 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:02.269043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-26f9396d-9727-49eb-be0c-8c775107cd57 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:02.277403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-26f9396d-9727-49eb-be0c-8c775107cd57 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:02.278909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-26f9396d-9727-49eb-be0c-8c775107cd57 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:02.280105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-26f9396d-9727-49eb-be0c-8c775107cd57 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147843 May 12 07:15:02.280662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1043/2172] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:02 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:02.993162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-83db1f70-f3e9-4acf-99b8-a21a9053e03d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:02.993781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-83db1f70-f3e9-4acf-99b8-a21a9053e03d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:03.000129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83db1f70-f3e9-4acf-99b8-a21a9053e03d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:03.000592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83db1f70-f3e9-4acf-99b8-a21a9053e03d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:03.001402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83db1f70-f3e9-4acf-99b8-a21a9053e03d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:03.001847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83db1f70-f3e9-4acf-99b8-a21a9053e03d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:03.125722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-83db1f70-f3e9-4acf-99b8-a21a9053e03d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:03.133465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-83db1f70-f3e9-4acf-99b8-a21a9053e03d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144264 May 12 07:15:03.134040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1130/2173] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:02 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:03.299162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b0f45833-e102-442f-9fad-1dd8dad1971d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:03.299829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b0f45833-e102-442f-9fad-1dd8dad1971d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:03.306097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0f45833-e102-442f-9fad-1dd8dad1971d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:03.306547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0f45833-e102-442f-9fad-1dd8dad1971d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:03.307303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0f45833-e102-442f-9fad-1dd8dad1971d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:03.307782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0f45833-e102-442f-9fad-1dd8dad1971d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:03.434459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b0f45833-e102-442f-9fad-1dd8dad1971d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:03.443137 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b0f45833-e102-442f-9fad-1dd8dad1971d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:03.444670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b0f45833-e102-442f-9fad-1dd8dad1971d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:03.445816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b0f45833-e102-442f-9fad-1dd8dad1971d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150929 May 12 07:15:03.446394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1044/2174] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:04.150209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c7160ae4-eafd-4214-87f2-dd065856ae70 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:04.150826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c7160ae4-eafd-4214-87f2-dd065856ae70 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:04.157173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7160ae4-eafd-4214-87f2-dd065856ae70 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:04.157660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7160ae4-eafd-4214-87f2-dd065856ae70 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:04.158429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7160ae4-eafd-4214-87f2-dd065856ae70 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:04.158868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7160ae4-eafd-4214-87f2-dd065856ae70 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:04.281902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c7160ae4-eafd-4214-87f2-dd065856ae70 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:04.289557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c7160ae4-eafd-4214-87f2-dd065856ae70 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143184 May 12 07:15:04.290127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1131/2175] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:04 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:04.464983 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4c1411e2-b77b-4ce5-bdd3-334ca51ffe2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:04.465627 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4c1411e2-b77b-4ce5-bdd3-334ca51ffe2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:04.472047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c1411e2-b77b-4ce5-bdd3-334ca51ffe2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:04.472499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c1411e2-b77b-4ce5-bdd3-334ca51ffe2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:04.473317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c1411e2-b77b-4ce5-bdd3-334ca51ffe2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:04.473764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4c1411e2-b77b-4ce5-bdd3-334ca51ffe2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:04.605513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4c1411e2-b77b-4ce5-bdd3-334ca51ffe2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:04.613852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4c1411e2-b77b-4ce5-bdd3-334ca51ffe2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:04.615400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4c1411e2-b77b-4ce5-bdd3-334ca51ffe2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:04.616573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4c1411e2-b77b-4ce5-bdd3-334ca51ffe2d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.156009 May 12 07:15:04.617131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1045/2176] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:04 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:05.306959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f43ae427-18f2-4a3b-aa79-479cc516e050 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:05.308086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f43ae427-18f2-4a3b-aa79-479cc516e050 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:05.315159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f43ae427-18f2-4a3b-aa79-479cc516e050 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:05.315607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f43ae427-18f2-4a3b-aa79-479cc516e050 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:05.316429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f43ae427-18f2-4a3b-aa79-479cc516e050 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:05.316866 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f43ae427-18f2-4a3b-aa79-479cc516e050 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:05.443773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f43ae427-18f2-4a3b-aa79-479cc516e050 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:05.452097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f43ae427-18f2-4a3b-aa79-479cc516e050 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148932 May 12 07:15:05.452668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1132/2177] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:05 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:05.634780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-16a93f9f-d073-4f87-9885-7fedf81f9548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:05.635398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-16a93f9f-d073-4f87-9885-7fedf81f9548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:05.641732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16a93f9f-d073-4f87-9885-7fedf81f9548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:05.642179 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16a93f9f-d073-4f87-9885-7fedf81f9548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:05.642939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16a93f9f-d073-4f87-9885-7fedf81f9548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:05.643370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16a93f9f-d073-4f87-9885-7fedf81f9548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:05.766470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-16a93f9f-d073-4f87-9885-7fedf81f9548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:05.774643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-16a93f9f-d073-4f87-9885-7fedf81f9548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:05.776168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-16a93f9f-d073-4f87-9885-7fedf81f9548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:05.777321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-16a93f9f-d073-4f87-9885-7fedf81f9548 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146469 May 12 07:15:05.777872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1046/2178] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:05 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:05.978683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c6f5758e-68ad-4ec3-a7bb-8840c9776cbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:05.978683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c6f5758e-68ad-4ec3-a7bb-8840c9776cbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:05.981893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6f5758e-68ad-4ec3-a7bb-8840c9776cbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:05.982544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6f5758e-68ad-4ec3-a7bb-8840c9776cbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:05.983336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6f5758e-68ad-4ec3-a7bb-8840c9776cbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:05.983934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c6f5758e-68ad-4ec3-a7bb-8840c9776cbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:06.017085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c6f5758e-68ad-4ec3-a7bb-8840c9776cbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:15:06.345939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c6f5758e-68ad-4ec3-a7bb-8840c9776cbf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 204 len: 0 microversion: 2.1 time: 0.373827 May 12 07:15:06.345939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1133/2179] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:15:05 2022] DELETE /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:15:06.354140 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6292cd39-3d1d-4a08-bb41-a0dbfb99e1f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:06.354759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6292cd39-3d1d-4a08-bb41-a0dbfb99e1f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:06.360621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6292cd39-3d1d-4a08-bb41-a0dbfb99e1f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:06.361078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6292cd39-3d1d-4a08-bb41-a0dbfb99e1f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:06.361852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6292cd39-3d1d-4a08-bb41-a0dbfb99e1f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:06.362296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6292cd39-3d1d-4a08-bb41-a0dbfb99e1f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:06.469860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7779e34a-4103-4ef6-829a-6470d2aa64b4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:06.470839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7779e34a-4103-4ef6-829a-6470d2aa64b4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:06.477988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7779e34a-4103-4ef6-829a-6470d2aa64b4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:06.478679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7779e34a-4103-4ef6-829a-6470d2aa64b4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:06.479457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7779e34a-4103-4ef6-829a-6470d2aa64b4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:06.479919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7779e34a-4103-4ef6-829a-6470d2aa64b4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:06.501559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6292cd39-3d1d-4a08-bb41-a0dbfb99e1f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:06.509884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6292cd39-3d1d-4a08-bb41-a0dbfb99e1f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1719 microversion: 2.1 time: 0.159679 May 12 07:15:06.511727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1047/2180] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:06 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:06.650164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7779e34a-4103-4ef6-829a-6470d2aa64b4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:06.659085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7779e34a-4103-4ef6-829a-6470d2aa64b4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.193530 May 12 07:15:06.659663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1134/2181] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:06 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:06.800320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-203dc0af-9487-41f8-bbca-c5b5b05db51a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:06.800721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-203dc0af-9487-41f8-bbca-c5b5b05db51a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:06.808639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-203dc0af-9487-41f8-bbca-c5b5b05db51a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:06.809494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-203dc0af-9487-41f8-bbca-c5b5b05db51a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:06.810806 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-203dc0af-9487-41f8-bbca-c5b5b05db51a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:06.811593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-203dc0af-9487-41f8-bbca-c5b5b05db51a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:06.950528 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-203dc0af-9487-41f8-bbca-c5b5b05db51a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:06.959641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-203dc0af-9487-41f8-bbca-c5b5b05db51a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:06.961164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-203dc0af-9487-41f8-bbca-c5b5b05db51a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:06.962693 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-203dc0af-9487-41f8-bbca-c5b5b05db51a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.167153 May 12 07:15:06.963456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1048/2182] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:06 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:07.528363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0bdde120-4e3b-4cd3-9d00-389bf46bff72 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:07.529092 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0bdde120-4e3b-4cd3-9d00-389bf46bff72 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:07.535550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bdde120-4e3b-4cd3-9d00-389bf46bff72 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:07.536109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bdde120-4e3b-4cd3-9d00-389bf46bff72 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:07.536957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bdde120-4e3b-4cd3-9d00-389bf46bff72 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:07.537468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bdde120-4e3b-4cd3-9d00-389bf46bff72 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:07.676425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f64cfb95-96c4-4d40-b594-f3f2de0d0075 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:07.677141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f64cfb95-96c4-4d40-b594-f3f2de0d0075 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:07.683058 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f64cfb95-96c4-4d40-b594-f3f2de0d0075 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:07.683589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f64cfb95-96c4-4d40-b594-f3f2de0d0075 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:07.684559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f64cfb95-96c4-4d40-b594-f3f2de0d0075 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:07.685236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f64cfb95-96c4-4d40-b594-f3f2de0d0075 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:07.708052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0bdde120-4e3b-4cd3-9d00-389bf46bff72 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:07.723091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0bdde120-4e3b-4cd3-9d00-389bf46bff72 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1719 microversion: 2.1 time: 0.199104 May 12 07:15:07.723744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1135/2183] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:07 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1719 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:07.829366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f64cfb95-96c4-4d40-b594-f3f2de0d0075 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:07.837446 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f64cfb95-96c4-4d40-b594-f3f2de0d0075 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.165146 May 12 07:15:07.838018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1049/2184] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:07 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:07.985715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1765ebed-cb4e-4db8-b148-16071dc10734 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:07.986510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1765ebed-cb4e-4db8-b148-16071dc10734 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:08.000027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1765ebed-cb4e-4db8-b148-16071dc10734 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:08.001529 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1765ebed-cb4e-4db8-b148-16071dc10734 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:08.003794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1765ebed-cb4e-4db8-b148-16071dc10734 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:08.005053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1765ebed-cb4e-4db8-b148-16071dc10734 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:08.190099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1765ebed-cb4e-4db8-b148-16071dc10734 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:08.203174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1765ebed-cb4e-4db8-b148-16071dc10734 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:08.204882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1765ebed-cb4e-4db8-b148-16071dc10734 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:08.206090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1765ebed-cb4e-4db8-b148-16071dc10734 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.227598 May 12 07:15:08.206663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1136/2185] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:07 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:08.360703 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-a0fae09b-a1cf-4498-bb2f-61d7e705f21c req-a344e265-571a-4cf0-9e4b-2f9a055fa7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f4aebcd-2d12-4d12-941a-12261cb855af", "name": "network-vif-deleted", "tag": "7fada614-d793-49ad-98bb-6d8332ab507a"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:15:08.368977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-a0fae09b-a1cf-4498-bb2f-61d7e705f21c req-a344e265-571a-4cf0-9e4b-2f9a055fa7ef service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:08.370404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-a0fae09b-a1cf-4498-bb2f-61d7e705f21c req-a344e265-571a-4cf0-9e4b-2f9a055fa7ef service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:08.382863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-a0fae09b-a1cf-4498-bb2f-61d7e705f21c req-a344e265-571a-4cf0-9e4b-2f9a055fa7ef service nova] Creating event network-vif-deleted:7fada614-d793-49ad-98bb-6d8332ab507a for instance 7f4aebcd-2d12-4d12-941a-12261cb855af on hv-cinder-76606 May 12 07:15:08.389382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-a0fae09b-a1cf-4498-bb2f-61d7e705f21c req-a344e265-571a-4cf0-9e4b-2f9a055fa7ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350533 May 12 07:15:08.389981 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1050/2186] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:15:08.740889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9908aadf-87a0-40d1-9876-14cea263a5fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:08.741613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9908aadf-87a0-40d1-9876-14cea263a5fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:08.748480 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9908aadf-87a0-40d1-9876-14cea263a5fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:08.748926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9908aadf-87a0-40d1-9876-14cea263a5fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:08.749706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9908aadf-87a0-40d1-9876-14cea263a5fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:08.750152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9908aadf-87a0-40d1-9876-14cea263a5fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:08.821340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9908aadf-87a0-40d1-9876-14cea263a5fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:08.830019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9908aadf-87a0-40d1-9876-14cea263a5fe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.093139 May 12 07:15:08.839344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1137/2187] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:08 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:08.856516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7edddba6-29c5-4be7-a440-76b3a00b076b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:08.857253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7edddba6-29c5-4be7-a440-76b3a00b076b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:08.864023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7edddba6-29c5-4be7-a440-76b3a00b076b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:08.864496 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7edddba6-29c5-4be7-a440-76b3a00b076b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:08.865295 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7edddba6-29c5-4be7-a440-76b3a00b076b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:08.865816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7edddba6-29c5-4be7-a440-76b3a00b076b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:09.008301 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7edddba6-29c5-4be7-a440-76b3a00b076b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:09.018881 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7edddba6-29c5-4be7-a440-76b3a00b076b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.166464 May 12 07:15:09.018881 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1051/2188] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:08 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:09.229050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d0aece7f-5871-4053-af5a-a3df5f24f959 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:09.230191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d0aece7f-5871-4053-af5a-a3df5f24f959 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:09.236138 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d0aece7f-5871-4053-af5a-a3df5f24f959 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:09.236598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d0aece7f-5871-4053-af5a-a3df5f24f959 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:09.237601 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d0aece7f-5871-4053-af5a-a3df5f24f959 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:09.238055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d0aece7f-5871-4053-af5a-a3df5f24f959 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:09.382864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d0aece7f-5871-4053-af5a-a3df5f24f959 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:09.391712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d0aece7f-5871-4053-af5a-a3df5f24f959 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:09.393234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d0aece7f-5871-4053-af5a-a3df5f24f959 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:09.394424 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d0aece7f-5871-4053-af5a-a3df5f24f959 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.173327 May 12 07:15:09.394983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1138/2189] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:15:09.846344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-715b7672-3929-4c59-9391-df8327203087 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:09.848609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-715b7672-3929-4c59-9391-df8327203087 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:09.853913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-715b7672-3929-4c59-9391-df8327203087 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:09.854241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-715b7672-3929-4c59-9391-df8327203087 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:09.855100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-715b7672-3929-4c59-9391-df8327203087 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:09.855622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-715b7672-3929-4c59-9391-df8327203087 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:09.924021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-715b7672-3929-4c59-9391-df8327203087 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:09.929733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-715b7672-3929-4c59-9391-df8327203087 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.087293 May 12 07:15:09.930791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1052/2190] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:09 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:10.034255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3afb254c-a6d7-444e-b6bb-6cff236d329a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:10.035004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3afb254c-a6d7-444e-b6bb-6cff236d329a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:10.041641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3afb254c-a6d7-444e-b6bb-6cff236d329a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:10.042126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3afb254c-a6d7-444e-b6bb-6cff236d329a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:10.042902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3afb254c-a6d7-444e-b6bb-6cff236d329a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:10.043370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3afb254c-a6d7-444e-b6bb-6cff236d329a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:10.167712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3afb254c-a6d7-444e-b6bb-6cff236d329a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:10.175761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3afb254c-a6d7-444e-b6bb-6cff236d329a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145407 May 12 07:15:10.176331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1139/2191] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:10 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:10.413744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d6353881-46e7-48b3-bc49-43ef15af4fae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:10.414278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d6353881-46e7-48b3-bc49-43ef15af4fae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:10.420695 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6353881-46e7-48b3-bc49-43ef15af4fae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:10.421145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6353881-46e7-48b3-bc49-43ef15af4fae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:10.421910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6353881-46e7-48b3-bc49-43ef15af4fae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:10.422349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6353881-46e7-48b3-bc49-43ef15af4fae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:10.551835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d6353881-46e7-48b3-bc49-43ef15af4fae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:10.560059 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d6353881-46e7-48b3-bc49-43ef15af4fae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:10.561637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d6353881-46e7-48b3-bc49-43ef15af4fae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:10.562790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d6353881-46e7-48b3-bc49-43ef15af4fae tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.153070 May 12 07:15:10.563473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1053/2192] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:10 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:10.947083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-815839a4-a337-4e0e-9328-e448c5c4dfae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:10.948383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-815839a4-a337-4e0e-9328-e448c5c4dfae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:10.954223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-815839a4-a337-4e0e-9328-e448c5c4dfae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:10.954676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-815839a4-a337-4e0e-9328-e448c5c4dfae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:10.955440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-815839a4-a337-4e0e-9328-e448c5c4dfae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:10.955911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-815839a4-a337-4e0e-9328-e448c5c4dfae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:11.022344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-815839a4-a337-4e0e-9328-e448c5c4dfae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:11.030916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-815839a4-a337-4e0e-9328-e448c5c4dfae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.088123 May 12 07:15:11.031491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1140/2193] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:10 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:11.193157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8693a8e4-6b75-4ab0-a97f-ee26df140a08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:11.193773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8693a8e4-6b75-4ab0-a97f-ee26df140a08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:11.201522 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8693a8e4-6b75-4ab0-a97f-ee26df140a08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:11.201905 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8693a8e4-6b75-4ab0-a97f-ee26df140a08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:11.202663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8693a8e4-6b75-4ab0-a97f-ee26df140a08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:11.203097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8693a8e4-6b75-4ab0-a97f-ee26df140a08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:11.342972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8693a8e4-6b75-4ab0-a97f-ee26df140a08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:11.353649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8693a8e4-6b75-4ab0-a97f-ee26df140a08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.164261 May 12 07:15:11.354823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1054/2194] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:11 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:11.585183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-51b2849d-2922-4134-8b61-53f1fab00d0e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:11.585820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-51b2849d-2922-4134-8b61-53f1fab00d0e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:11.592106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51b2849d-2922-4134-8b61-53f1fab00d0e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:11.592550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51b2849d-2922-4134-8b61-53f1fab00d0e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:11.593312 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51b2849d-2922-4134-8b61-53f1fab00d0e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:11.593742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51b2849d-2922-4134-8b61-53f1fab00d0e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:11.718325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-51b2849d-2922-4134-8b61-53f1fab00d0e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:11.726489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-51b2849d-2922-4134-8b61-53f1fab00d0e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:11.728039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-51b2849d-2922-4134-8b61-53f1fab00d0e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:11.729720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-51b2849d-2922-4134-8b61-53f1fab00d0e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148069 May 12 07:15:11.730283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1141/2195] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:12.048793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f6f4ea14-4072-493c-86e9-beec6385b00a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:12.049407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f6f4ea14-4072-493c-86e9-beec6385b00a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:12.055286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6f4ea14-4072-493c-86e9-beec6385b00a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:12.055763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6f4ea14-4072-493c-86e9-beec6385b00a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:12.056553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6f4ea14-4072-493c-86e9-beec6385b00a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:12.056991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6f4ea14-4072-493c-86e9-beec6385b00a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:12.118741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f6f4ea14-4072-493c-86e9-beec6385b00a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:12.126631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f6f4ea14-4072-493c-86e9-beec6385b00a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081959 May 12 07:15:12.127207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1055/2196] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:12 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:12.398092 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1fee4441-532b-4f2a-98f0-f9ddc9fd1996 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:12.398634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1fee4441-532b-4f2a-98f0-f9ddc9fd1996 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:12.405265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fee4441-532b-4f2a-98f0-f9ddc9fd1996 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:12.405715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fee4441-532b-4f2a-98f0-f9ddc9fd1996 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:12.406479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fee4441-532b-4f2a-98f0-f9ddc9fd1996 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:12.406915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1fee4441-532b-4f2a-98f0-f9ddc9fd1996 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:12.530294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1fee4441-532b-4f2a-98f0-f9ddc9fd1996 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:12.538078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1fee4441-532b-4f2a-98f0-f9ddc9fd1996 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143934 May 12 07:15:12.538644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1142/2197] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:12 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:12.653655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:15:12.654227 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:15:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:15:12.748400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-77e4169a-1f6d-47a6-88dd-324ea8a52612 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:12.749019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-77e4169a-1f6d-47a6-88dd-324ea8a52612 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:12.755361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77e4169a-1f6d-47a6-88dd-324ea8a52612 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:12.755859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77e4169a-1f6d-47a6-88dd-324ea8a52612 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:12.756632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77e4169a-1f6d-47a6-88dd-324ea8a52612 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:12.757072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-77e4169a-1f6d-47a6-88dd-324ea8a52612 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:12.882105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-77e4169a-1f6d-47a6-88dd-324ea8a52612 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:12.891186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-77e4169a-1f6d-47a6-88dd-324ea8a52612 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:12.892717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-77e4169a-1f6d-47a6-88dd-324ea8a52612 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:12.893877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-77e4169a-1f6d-47a6-88dd-324ea8a52612 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149864 May 12 07:15:12.894443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1056/2198] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:12 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:13.142729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e3470de1-4d8a-4e9a-b473-61cf7062f240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:13.143340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e3470de1-4d8a-4e9a-b473-61cf7062f240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:13.149620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3470de1-4d8a-4e9a-b473-61cf7062f240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:13.150064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3470de1-4d8a-4e9a-b473-61cf7062f240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:13.150822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3470de1-4d8a-4e9a-b473-61cf7062f240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:13.151255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3470de1-4d8a-4e9a-b473-61cf7062f240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:13.214501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e3470de1-4d8a-4e9a-b473-61cf7062f240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:13.222275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e3470de1-4d8a-4e9a-b473-61cf7062f240 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083679 May 12 07:15:13.222835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1143/2199] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:13 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:13.555023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2bb42c75-8f5a-4bd4-96c1-5f493d9d7e95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:13.555637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2bb42c75-8f5a-4bd4-96c1-5f493d9d7e95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:13.561561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2bb42c75-8f5a-4bd4-96c1-5f493d9d7e95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:13.562014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2bb42c75-8f5a-4bd4-96c1-5f493d9d7e95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:13.562784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2bb42c75-8f5a-4bd4-96c1-5f493d9d7e95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:13.563224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2bb42c75-8f5a-4bd4-96c1-5f493d9d7e95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:13.685599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2bb42c75-8f5a-4bd4-96c1-5f493d9d7e95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:13.693387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2bb42c75-8f5a-4bd4-96c1-5f493d9d7e95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.142275 May 12 07:15:13.693952 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1057/2200] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:13 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:13.912254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2feebece-ace6-45a8-9607-34ec255c65e0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:13.912801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2feebece-ace6-45a8-9607-34ec255c65e0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:13.918595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2feebece-ace6-45a8-9607-34ec255c65e0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:13.919043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2feebece-ace6-45a8-9607-34ec255c65e0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:13.919824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2feebece-ace6-45a8-9607-34ec255c65e0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:13.920260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2feebece-ace6-45a8-9607-34ec255c65e0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:14.045561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2feebece-ace6-45a8-9607-34ec255c65e0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:14.055060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2feebece-ace6-45a8-9607-34ec255c65e0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:14.056614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2feebece-ace6-45a8-9607-34ec255c65e0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:14.057756 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2feebece-ace6-45a8-9607-34ec255c65e0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149467 May 12 07:15:14.058310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1144/2201] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:14.239468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2c54e953-e3a2-438f-9637-f8725a5a4fa6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:14.240043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2c54e953-e3a2-438f-9637-f8725a5a4fa6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:14.246921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c54e953-e3a2-438f-9637-f8725a5a4fa6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:14.247375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c54e953-e3a2-438f-9637-f8725a5a4fa6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:14.248318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c54e953-e3a2-438f-9637-f8725a5a4fa6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:14.248765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c54e953-e3a2-438f-9637-f8725a5a4fa6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:14.312368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2c54e953-e3a2-438f-9637-f8725a5a4fa6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:14.320072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2c54e953-e3a2-438f-9637-f8725a5a4fa6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084541 May 12 07:15:14.320627 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1058/2202] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:14 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:14.709521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e269ef38-da91-433b-b431-fbff3f56e474 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:14.710133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e269ef38-da91-433b-b431-fbff3f56e474 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:14.716438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e269ef38-da91-433b-b431-fbff3f56e474 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:14.716886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e269ef38-da91-433b-b431-fbff3f56e474 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:14.717648 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e269ef38-da91-433b-b431-fbff3f56e474 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:14.718081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e269ef38-da91-433b-b431-fbff3f56e474 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:14.842317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e269ef38-da91-433b-b431-fbff3f56e474 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:14.850427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e269ef38-da91-433b-b431-fbff3f56e474 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144708 May 12 07:15:14.850991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1145/2203] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:14 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:15.076147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-63806158-c0de-483f-9dfe-4a3e2c388e97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:15.180642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-63806158-c0de-483f-9dfe-4a3e2c388e97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:15.180642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63806158-c0de-483f-9dfe-4a3e2c388e97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:15.180642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63806158-c0de-483f-9dfe-4a3e2c388e97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:15.180642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63806158-c0de-483f-9dfe-4a3e2c388e97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:15.182324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63806158-c0de-483f-9dfe-4a3e2c388e97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:15.211370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-63806158-c0de-483f-9dfe-4a3e2c388e97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:15.220140 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-63806158-c0de-483f-9dfe-4a3e2c388e97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:15.221642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-63806158-c0de-483f-9dfe-4a3e2c388e97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:15.222797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-63806158-c0de-483f-9dfe-4a3e2c388e97 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150764 May 12 07:15:15.223363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1059/2204] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:15.337271 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-958352ba-f667-45c6-a4f0-d92c807ff269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:15.337815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-958352ba-f667-45c6-a4f0-d92c807ff269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:15.344292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-958352ba-f667-45c6-a4f0-d92c807ff269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:15.344737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-958352ba-f667-45c6-a4f0-d92c807ff269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:15.345492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-958352ba-f667-45c6-a4f0-d92c807ff269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:15.345924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-958352ba-f667-45c6-a4f0-d92c807ff269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:15.407594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-958352ba-f667-45c6-a4f0-d92c807ff269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:15.415283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-958352ba-f667-45c6-a4f0-d92c807ff269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081916 May 12 07:15:15.415866 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1146/2205] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:15 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:15.867993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7b400f9e-a118-4da4-905e-8aacdecd381b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:15.868614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7b400f9e-a118-4da4-905e-8aacdecd381b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:15.877303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b400f9e-a118-4da4-905e-8aacdecd381b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:15.877764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b400f9e-a118-4da4-905e-8aacdecd381b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:15.878544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b400f9e-a118-4da4-905e-8aacdecd381b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:15.878993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7b400f9e-a118-4da4-905e-8aacdecd381b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:16.005479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7b400f9e-a118-4da4-905e-8aacdecd381b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:16.014311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7b400f9e-a118-4da4-905e-8aacdecd381b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150265 May 12 07:15:16.014925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1060/2206] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:15 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:16.241710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e380130f-6402-402b-ad0a-967cf266dc35 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:16.242331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e380130f-6402-402b-ad0a-967cf266dc35 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:16.249367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e380130f-6402-402b-ad0a-967cf266dc35 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:16.249825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e380130f-6402-402b-ad0a-967cf266dc35 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:16.250606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e380130f-6402-402b-ad0a-967cf266dc35 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:16.251050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e380130f-6402-402b-ad0a-967cf266dc35 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:16.374196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e380130f-6402-402b-ad0a-967cf266dc35 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:16.382425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e380130f-6402-402b-ad0a-967cf266dc35 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:16.383967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e380130f-6402-402b-ad0a-967cf266dc35 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:16.385134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e380130f-6402-402b-ad0a-967cf266dc35 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147313 May 12 07:15:16.385697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1147/2207] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:16.432106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0bea6d67-77a4-413b-9af4-a0d3b4a7c952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:16.433306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0bea6d67-77a4-413b-9af4-a0d3b4a7c952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:16.439738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0bea6d67-77a4-413b-9af4-a0d3b4a7c952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:16.440219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0bea6d67-77a4-413b-9af4-a0d3b4a7c952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:16.441069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0bea6d67-77a4-413b-9af4-a0d3b4a7c952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:16.441507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0bea6d67-77a4-413b-9af4-a0d3b4a7c952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:16.503560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0bea6d67-77a4-413b-9af4-a0d3b4a7c952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:16.511347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0bea6d67-77a4-413b-9af4-a0d3b4a7c952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083124 May 12 07:15:16.511944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1061/2208] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:16 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:17.030984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b3a4df16-b9d8-4e52-a0d5-2c0352aec4ad tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:17.031602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b3a4df16-b9d8-4e52-a0d5-2c0352aec4ad tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:17.037597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b3a4df16-b9d8-4e52-a0d5-2c0352aec4ad tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:17.037994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b3a4df16-b9d8-4e52-a0d5-2c0352aec4ad tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:17.038770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b3a4df16-b9d8-4e52-a0d5-2c0352aec4ad tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:17.039210 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b3a4df16-b9d8-4e52-a0d5-2c0352aec4ad tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:17.169014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b3a4df16-b9d8-4e52-a0d5-2c0352aec4ad tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:17.177109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b3a4df16-b9d8-4e52-a0d5-2c0352aec4ad tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150063 May 12 07:15:17.177671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1148/2209] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:17 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:17.403316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1bc62952-7596-46df-a335-256ebaf2c293 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:17.403927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1bc62952-7596-46df-a335-256ebaf2c293 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:17.410252 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bc62952-7596-46df-a335-256ebaf2c293 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:17.410712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bc62952-7596-46df-a335-256ebaf2c293 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:17.411490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bc62952-7596-46df-a335-256ebaf2c293 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:17.411967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bc62952-7596-46df-a335-256ebaf2c293 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:17.528201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-92ea03e3-bb4a-4fda-9abf-364afff45722 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:17.528822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-92ea03e3-bb4a-4fda-9abf-364afff45722 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:17.534825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92ea03e3-bb4a-4fda-9abf-364afff45722 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:17.535283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92ea03e3-bb4a-4fda-9abf-364afff45722 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:17.536095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92ea03e3-bb4a-4fda-9abf-364afff45722 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:17.536540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92ea03e3-bb4a-4fda-9abf-364afff45722 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:17.539837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1bc62952-7596-46df-a335-256ebaf2c293 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:17.548213 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1bc62952-7596-46df-a335-256ebaf2c293 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:17.549684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1bc62952-7596-46df-a335-256ebaf2c293 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:17.550833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1bc62952-7596-46df-a335-256ebaf2c293 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151516 May 12 07:15:17.551391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1062/2210] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:17 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:17.600469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-92ea03e3-bb4a-4fda-9abf-364afff45722 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:17.608722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-92ea03e3-bb4a-4fda-9abf-364afff45722 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084453 May 12 07:15:17.609293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1149/2211] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:17 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:18.193970 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-901e8ead-d2e3-48d2-9dd6-28e1a2a3ef96 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:18.194588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-901e8ead-d2e3-48d2-9dd6-28e1a2a3ef96 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:18.200636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-901e8ead-d2e3-48d2-9dd6-28e1a2a3ef96 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:18.201083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-901e8ead-d2e3-48d2-9dd6-28e1a2a3ef96 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:18.201848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-901e8ead-d2e3-48d2-9dd6-28e1a2a3ef96 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:18.202288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-901e8ead-d2e3-48d2-9dd6-28e1a2a3ef96 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:18.325670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-901e8ead-d2e3-48d2-9dd6-28e1a2a3ef96 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:18.333464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-901e8ead-d2e3-48d2-9dd6-28e1a2a3ef96 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143402 May 12 07:15:18.334027 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1063/2212] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:18 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:18.569732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e6d67e5e-f95d-4182-91ec-4c2460425111 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:18.570297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e6d67e5e-f95d-4182-91ec-4c2460425111 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:18.577060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6d67e5e-f95d-4182-91ec-4c2460425111 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:18.577511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6d67e5e-f95d-4182-91ec-4c2460425111 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:18.578269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6d67e5e-f95d-4182-91ec-4c2460425111 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:18.578705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6d67e5e-f95d-4182-91ec-4c2460425111 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:18.625594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6345a67f-3187-442d-952f-08bae33c8e36 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:18.626263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6345a67f-3187-442d-952f-08bae33c8e36 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:18.632492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6345a67f-3187-442d-952f-08bae33c8e36 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:18.632946 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6345a67f-3187-442d-952f-08bae33c8e36 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:18.633719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6345a67f-3187-442d-952f-08bae33c8e36 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:18.634164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6345a67f-3187-442d-952f-08bae33c8e36 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:18.704981 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6345a67f-3187-442d-952f-08bae33c8e36 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:18.712707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6345a67f-3187-442d-952f-08bae33c8e36 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.090976 May 12 07:15:18.713279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1064/2213] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:18 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:18.731875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e6d67e5e-f95d-4182-91ec-4c2460425111 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:18.740014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e6d67e5e-f95d-4182-91ec-4c2460425111 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:18.741542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e6d67e5e-f95d-4182-91ec-4c2460425111 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:18.742684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e6d67e5e-f95d-4182-91ec-4c2460425111 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.176972 May 12 07:15:18.743236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1150/2214] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:19.350432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-388a8bf1-b3bf-4cff-9e91-d663e1bd2911 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:19.350978 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-388a8bf1-b3bf-4cff-9e91-d663e1bd2911 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:19.357543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-388a8bf1-b3bf-4cff-9e91-d663e1bd2911 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:19.358004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-388a8bf1-b3bf-4cff-9e91-d663e1bd2911 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:19.358780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-388a8bf1-b3bf-4cff-9e91-d663e1bd2911 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:19.359231 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-388a8bf1-b3bf-4cff-9e91-d663e1bd2911 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:19.487415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-388a8bf1-b3bf-4cff-9e91-d663e1bd2911 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:19.495171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-388a8bf1-b3bf-4cff-9e91-d663e1bd2911 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148655 May 12 07:15:19.495760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1065/2215] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:19 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:19.730607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6eab5224-54c8-4ba4-af52-b5d9aa79a546 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:19.731144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6eab5224-54c8-4ba4-af52-b5d9aa79a546 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:19.737464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6eab5224-54c8-4ba4-af52-b5d9aa79a546 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:19.737961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6eab5224-54c8-4ba4-af52-b5d9aa79a546 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:19.738735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6eab5224-54c8-4ba4-af52-b5d9aa79a546 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:19.739171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6eab5224-54c8-4ba4-af52-b5d9aa79a546 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:19.761478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5871edb6-0abb-4472-aad7-ccf2b423737b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:19.762097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5871edb6-0abb-4472-aad7-ccf2b423737b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:19.768456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5871edb6-0abb-4472-aad7-ccf2b423737b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:19.768915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5871edb6-0abb-4472-aad7-ccf2b423737b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:19.769693 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5871edb6-0abb-4472-aad7-ccf2b423737b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:19.770144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5871edb6-0abb-4472-aad7-ccf2b423737b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:19.800265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6eab5224-54c8-4ba4-af52-b5d9aa79a546 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:19.808350 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6eab5224-54c8-4ba4-af52-b5d9aa79a546 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082197 May 12 07:15:19.808938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1151/2216] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:19 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:19.898494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5871edb6-0abb-4472-aad7-ccf2b423737b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:19.907523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5871edb6-0abb-4472-aad7-ccf2b423737b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:19.909138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5871edb6-0abb-4472-aad7-ccf2b423737b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:19.910296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5871edb6-0abb-4472-aad7-ccf2b423737b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152700 May 12 07:15:19.910857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1066/2217] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:19 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:15:20.511594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7b817a31-244a-43d3-9a46-56e0eb9e6a7c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:20.512919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7b817a31-244a-43d3-9a46-56e0eb9e6a7c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:20.518795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b817a31-244a-43d3-9a46-56e0eb9e6a7c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:20.519272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b817a31-244a-43d3-9a46-56e0eb9e6a7c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:20.520070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b817a31-244a-43d3-9a46-56e0eb9e6a7c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:20.520513 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7b817a31-244a-43d3-9a46-56e0eb9e6a7c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:20.650411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7b817a31-244a-43d3-9a46-56e0eb9e6a7c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:20.658208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7b817a31-244a-43d3-9a46-56e0eb9e6a7c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150533 May 12 07:15:20.658776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1152/2218] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:20 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:20.825216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-14a586b9-204d-4dd1-8235-a8467accb46a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:20.825766 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-14a586b9-204d-4dd1-8235-a8467accb46a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:20.832134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14a586b9-204d-4dd1-8235-a8467accb46a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:20.832587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14a586b9-204d-4dd1-8235-a8467accb46a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:20.833389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14a586b9-204d-4dd1-8235-a8467accb46a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:20.833904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14a586b9-204d-4dd1-8235-a8467accb46a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:20.894509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-14a586b9-204d-4dd1-8235-a8467accb46a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:20.902252 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-14a586b9-204d-4dd1-8235-a8467accb46a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080988 May 12 07:15:20.903318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1067/2219] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:20 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:20.928676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1c924dd8-7022-4940-851f-dda13a6d33bc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:20.929325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1c924dd8-7022-4940-851f-dda13a6d33bc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:20.935610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c924dd8-7022-4940-851f-dda13a6d33bc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:20.936107 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c924dd8-7022-4940-851f-dda13a6d33bc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:20.936888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c924dd8-7022-4940-851f-dda13a6d33bc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:20.937332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c924dd8-7022-4940-851f-dda13a6d33bc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:21.066828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1c924dd8-7022-4940-851f-dda13a6d33bc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:21.075000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1c924dd8-7022-4940-851f-dda13a6d33bc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:21.076579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1c924dd8-7022-4940-851f-dda13a6d33bc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:21.077677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1c924dd8-7022-4940-851f-dda13a6d33bc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152961 May 12 07:15:21.078234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1153/2220] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:20 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:21.675139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bbef6e13-3a17-486e-a5ee-f0a7b83dcecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:21.675777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bbef6e13-3a17-486e-a5ee-f0a7b83dcecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:21.682286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bbef6e13-3a17-486e-a5ee-f0a7b83dcecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:21.682792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bbef6e13-3a17-486e-a5ee-f0a7b83dcecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:21.683563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bbef6e13-3a17-486e-a5ee-f0a7b83dcecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:21.684131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bbef6e13-3a17-486e-a5ee-f0a7b83dcecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:21.808141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bbef6e13-3a17-486e-a5ee-f0a7b83dcecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:21.815798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bbef6e13-3a17-486e-a5ee-f0a7b83dcecb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144746 May 12 07:15:21.816367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1068/2221] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:21 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:21.919027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f5fbc93d-a428-4899-a6e7-bb3a0a7a1a98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:21.920302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f5fbc93d-a428-4899-a6e7-bb3a0a7a1a98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:21.926699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5fbc93d-a428-4899-a6e7-bb3a0a7a1a98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:21.927113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5fbc93d-a428-4899-a6e7-bb3a0a7a1a98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:21.927912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5fbc93d-a428-4899-a6e7-bb3a0a7a1a98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:21.928354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5fbc93d-a428-4899-a6e7-bb3a0a7a1a98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:21.988248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f5fbc93d-a428-4899-a6e7-bb3a0a7a1a98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:21.996092 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f5fbc93d-a428-4899-a6e7-bb3a0a7a1a98 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080894 May 12 07:15:21.996655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1154/2222] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:21 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:22.096354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e471dfce-9c50-405e-bd37-a31b2cc8cef2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:22.097135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e471dfce-9c50-405e-bd37-a31b2cc8cef2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:22.103206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e471dfce-9c50-405e-bd37-a31b2cc8cef2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:22.103657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e471dfce-9c50-405e-bd37-a31b2cc8cef2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:22.104462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e471dfce-9c50-405e-bd37-a31b2cc8cef2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:22.104902 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e471dfce-9c50-405e-bd37-a31b2cc8cef2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:22.232903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e471dfce-9c50-405e-bd37-a31b2cc8cef2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:22.241010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e471dfce-9c50-405e-bd37-a31b2cc8cef2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:22.242544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e471dfce-9c50-405e-bd37-a31b2cc8cef2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:22.243711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e471dfce-9c50-405e-bd37-a31b2cc8cef2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151190 May 12 07:15:22.244277 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1069/2223] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:22 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:22.832557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-70f67cb7-dff9-4231-b03e-94a472b6b895 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:22.833252 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-70f67cb7-dff9-4231-b03e-94a472b6b895 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:22.839658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70f67cb7-dff9-4231-b03e-94a472b6b895 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:22.844375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70f67cb7-dff9-4231-b03e-94a472b6b895 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:22.844375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70f67cb7-dff9-4231-b03e-94a472b6b895 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:22.844375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-70f67cb7-dff9-4231-b03e-94a472b6b895 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:22.966442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-70f67cb7-dff9-4231-b03e-94a472b6b895 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:22.974210 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-70f67cb7-dff9-4231-b03e-94a472b6b895 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145468 May 12 07:15:22.974776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1155/2224] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:22 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:23.013076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-aac65061-bbc5-4104-bdec-aa4bc7cb320f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:23.013692 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-aac65061-bbc5-4104-bdec-aa4bc7cb320f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:23.019652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aac65061-bbc5-4104-bdec-aa4bc7cb320f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:23.020130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aac65061-bbc5-4104-bdec-aa4bc7cb320f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:23.020894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aac65061-bbc5-4104-bdec-aa4bc7cb320f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:23.021334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aac65061-bbc5-4104-bdec-aa4bc7cb320f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:23.085364 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aac65061-bbc5-4104-bdec-aa4bc7cb320f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:23.093063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-aac65061-bbc5-4104-bdec-aa4bc7cb320f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083820 May 12 07:15:23.093632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1070/2225] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:23 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:23.262062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ff6d9308-7071-4c06-aeeb-54a92262a2f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:23.262700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ff6d9308-7071-4c06-aeeb-54a92262a2f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:23.268707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff6d9308-7071-4c06-aeeb-54a92262a2f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:23.269152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff6d9308-7071-4c06-aeeb-54a92262a2f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:23.269925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff6d9308-7071-4c06-aeeb-54a92262a2f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:23.270436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff6d9308-7071-4c06-aeeb-54a92262a2f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:23.397540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ff6d9308-7071-4c06-aeeb-54a92262a2f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:23.406501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ff6d9308-7071-4c06-aeeb-54a92262a2f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:23.408024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ff6d9308-7071-4c06-aeeb-54a92262a2f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:23.409182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ff6d9308-7071-4c06-aeeb-54a92262a2f7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151102 May 12 07:15:23.409776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1156/2226] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:23 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:23.992631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-807d563d-4e74-42e4-b090-32cbc081fec5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:23.993276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-807d563d-4e74-42e4-b090-32cbc081fec5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:24.000276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-807d563d-4e74-42e4-b090-32cbc081fec5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:24.000722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-807d563d-4e74-42e4-b090-32cbc081fec5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:24.001488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-807d563d-4e74-42e4-b090-32cbc081fec5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:24.001920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-807d563d-4e74-42e4-b090-32cbc081fec5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:24.109726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d5bf5092-427b-43f3-a32b-17ad7737b979 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:24.110477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d5bf5092-427b-43f3-a32b-17ad7737b979 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:24.116714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5bf5092-427b-43f3-a32b-17ad7737b979 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:24.117155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5bf5092-427b-43f3-a32b-17ad7737b979 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:24.117922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5bf5092-427b-43f3-a32b-17ad7737b979 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:24.118350 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5bf5092-427b-43f3-a32b-17ad7737b979 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:24.126611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-807d563d-4e74-42e4-b090-32cbc081fec5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:24.134311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-807d563d-4e74-42e4-b090-32cbc081fec5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146021 May 12 07:15:24.134867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1071/2227] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:23 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:24.182143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d5bf5092-427b-43f3-a32b-17ad7737b979 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:24.190846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d5bf5092-427b-43f3-a32b-17ad7737b979 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085007 May 12 07:15:24.191410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1157/2228] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:24 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:24.428548 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cf46e96e-1f6d-4c50-8a99-3a408d957584 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:24.429081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cf46e96e-1f6d-4c50-8a99-3a408d957584 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:24.435546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf46e96e-1f6d-4c50-8a99-3a408d957584 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:24.436016 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf46e96e-1f6d-4c50-8a99-3a408d957584 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:24.436776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf46e96e-1f6d-4c50-8a99-3a408d957584 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:24.437209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf46e96e-1f6d-4c50-8a99-3a408d957584 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:24.561361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cf46e96e-1f6d-4c50-8a99-3a408d957584 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:24.570785 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cf46e96e-1f6d-4c50-8a99-3a408d957584 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:24.572321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cf46e96e-1f6d-4c50-8a99-3a408d957584 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:24.573476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cf46e96e-1f6d-4c50-8a99-3a408d957584 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148900 May 12 07:15:24.574035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1072/2229] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:24 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:25.151776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1171f403-3bfb-43f7-850e-2f9d4da76f46 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:25.152394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1171f403-3bfb-43f7-850e-2f9d4da76f46 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:25.159588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1171f403-3bfb-43f7-850e-2f9d4da76f46 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:25.160079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1171f403-3bfb-43f7-850e-2f9d4da76f46 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:25.160843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1171f403-3bfb-43f7-850e-2f9d4da76f46 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:25.161304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1171f403-3bfb-43f7-850e-2f9d4da76f46 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:25.207588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dc44a188-abad-4901-94b3-60a356366ed4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:25.208221 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dc44a188-abad-4901-94b3-60a356366ed4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:25.214452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc44a188-abad-4901-94b3-60a356366ed4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:25.214900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc44a188-abad-4901-94b3-60a356366ed4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:25.215709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc44a188-abad-4901-94b3-60a356366ed4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:25.216148 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc44a188-abad-4901-94b3-60a356366ed4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:25.293828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dc44a188-abad-4901-94b3-60a356366ed4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:25.302045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dc44a188-abad-4901-94b3-60a356366ed4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.098219 May 12 07:15:25.302608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1073/2230] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:25 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:25.315656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1171f403-3bfb-43f7-850e-2f9d4da76f46 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:25.323360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1171f403-3bfb-43f7-850e-2f9d4da76f46 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.175541 May 12 07:15:25.323949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1158/2231] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:25 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:25.766439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f0bed1a7-4dfb-4419-871f-a7a3455577ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:25.767062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f0bed1a7-4dfb-4419-871f-a7a3455577ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:25.772963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0bed1a7-4dfb-4419-871f-a7a3455577ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:25.773420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0bed1a7-4dfb-4419-871f-a7a3455577ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:25.774191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0bed1a7-4dfb-4419-871f-a7a3455577ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:25.774634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f0bed1a7-4dfb-4419-871f-a7a3455577ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:25.901382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f0bed1a7-4dfb-4419-871f-a7a3455577ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:25.910330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f0bed1a7-4dfb-4419-871f-a7a3455577ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:25.911855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f0bed1a7-4dfb-4419-871f-a7a3455577ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:25.913034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f0bed1a7-4dfb-4419-871f-a7a3455577ff tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.325099 May 12 07:15:25.913596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1074/2232] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:25 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:26.319555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3a001768-e15f-4474-b460-695e781fa4ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:26.320209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3a001768-e15f-4474-b460-695e781fa4ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:26.327234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a001768-e15f-4474-b460-695e781fa4ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:26.327705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a001768-e15f-4474-b460-695e781fa4ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:26.328494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a001768-e15f-4474-b460-695e781fa4ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:26.328938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a001768-e15f-4474-b460-695e781fa4ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:26.339998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cfeef075-805f-40ce-ba4b-8d856fe69858 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:26.340623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cfeef075-805f-40ce-ba4b-8d856fe69858 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:26.347022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfeef075-805f-40ce-ba4b-8d856fe69858 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:26.347471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfeef075-805f-40ce-ba4b-8d856fe69858 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:26.348273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfeef075-805f-40ce-ba4b-8d856fe69858 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:26.348713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cfeef075-805f-40ce-ba4b-8d856fe69858 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:26.392306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3a001768-e15f-4474-b460-695e781fa4ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:26.401035 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3a001768-e15f-4474-b460-695e781fa4ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085360 May 12 07:15:26.401612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1159/2233] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:26 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:26.485036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cfeef075-805f-40ce-ba4b-8d856fe69858 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:26.492857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cfeef075-805f-40ce-ba4b-8d856fe69858 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.156741 May 12 07:15:26.493433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1075/2234] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:26 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:26.932405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-de6e7d7f-c321-455d-b286-f426476e097d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:26.933052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-de6e7d7f-c321-455d-b286-f426476e097d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:26.938993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de6e7d7f-c321-455d-b286-f426476e097d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:26.939440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de6e7d7f-c321-455d-b286-f426476e097d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:26.940249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de6e7d7f-c321-455d-b286-f426476e097d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:26.940687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de6e7d7f-c321-455d-b286-f426476e097d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:27.066496 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de6e7d7f-c321-455d-b286-f426476e097d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:27.074958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de6e7d7f-c321-455d-b286-f426476e097d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:27.076573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de6e7d7f-c321-455d-b286-f426476e097d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:27.077771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-de6e7d7f-c321-455d-b286-f426476e097d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149709 May 12 07:15:27.078335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1160/2235] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:26 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:27.417722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ebf3efef-469e-4427-9b44-29f9817c5d23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:27.418338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ebf3efef-469e-4427-9b44-29f9817c5d23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:27.424896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebf3efef-469e-4427-9b44-29f9817c5d23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:27.425340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebf3efef-469e-4427-9b44-29f9817c5d23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:27.426102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebf3efef-469e-4427-9b44-29f9817c5d23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:27.426534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ebf3efef-469e-4427-9b44-29f9817c5d23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:27.486643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ebf3efef-469e-4427-9b44-29f9817c5d23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:27.494535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ebf3efef-469e-4427-9b44-29f9817c5d23 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080654 May 12 07:15:27.495098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1076/2236] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:27 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:27.510055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-534f2999-256e-411c-850c-292fa1bb55ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:27.510677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-534f2999-256e-411c-850c-292fa1bb55ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:27.517450 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-534f2999-256e-411c-850c-292fa1bb55ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:27.517902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-534f2999-256e-411c-850c-292fa1bb55ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:27.518673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-534f2999-256e-411c-850c-292fa1bb55ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:27.519121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-534f2999-256e-411c-850c-292fa1bb55ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:27.647939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-534f2999-256e-411c-850c-292fa1bb55ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:27.656374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-534f2999-256e-411c-850c-292fa1bb55ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150105 May 12 07:15:27.656948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1161/2237] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:27 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:28.096425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a722d25d-24ad-48cf-9c50-2babf44c0f6b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:28.097040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a722d25d-24ad-48cf-9c50-2babf44c0f6b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:28.103058 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a722d25d-24ad-48cf-9c50-2babf44c0f6b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:28.103513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a722d25d-24ad-48cf-9c50-2babf44c0f6b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:28.104318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a722d25d-24ad-48cf-9c50-2babf44c0f6b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:28.104761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a722d25d-24ad-48cf-9c50-2babf44c0f6b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:28.235213 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a722d25d-24ad-48cf-9c50-2babf44c0f6b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:28.243491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a722d25d-24ad-48cf-9c50-2babf44c0f6b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:28.244972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a722d25d-24ad-48cf-9c50-2babf44c0f6b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:28.246133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a722d25d-24ad-48cf-9c50-2babf44c0f6b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.153616 May 12 07:15:28.247343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1077/2238] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:28 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:28.511225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fad9bf4f-7f98-4ac1-837b-4432412215a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:28.511822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fad9bf4f-7f98-4ac1-837b-4432412215a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:28.518687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fad9bf4f-7f98-4ac1-837b-4432412215a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:28.519136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fad9bf4f-7f98-4ac1-837b-4432412215a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:28.519931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fad9bf4f-7f98-4ac1-837b-4432412215a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:28.520374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fad9bf4f-7f98-4ac1-837b-4432412215a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:28.579957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fad9bf4f-7f98-4ac1-837b-4432412215a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:28.587573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fad9bf4f-7f98-4ac1-837b-4432412215a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080317 May 12 07:15:28.588170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1162/2239] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:28 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:28.672922 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8b66c036-c357-440f-b077-8eb38309a865 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:28.673546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8b66c036-c357-440f-b077-8eb38309a865 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:28.679757 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8b66c036-c357-440f-b077-8eb38309a865 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:28.680222 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8b66c036-c357-440f-b077-8eb38309a865 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:28.680981 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8b66c036-c357-440f-b077-8eb38309a865 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:28.681413 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8b66c036-c357-440f-b077-8eb38309a865 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:28.810676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8b66c036-c357-440f-b077-8eb38309a865 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:28.818531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8b66c036-c357-440f-b077-8eb38309a865 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149678 May 12 07:15:28.819096 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1078/2240] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:28 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:29.265680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2d1182d4-4d45-41e5-9abe-528710e2762d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:29.266333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2d1182d4-4d45-41e5-9abe-528710e2762d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:29.272263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d1182d4-4d45-41e5-9abe-528710e2762d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:29.272706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d1182d4-4d45-41e5-9abe-528710e2762d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:29.273465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d1182d4-4d45-41e5-9abe-528710e2762d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:29.273896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d1182d4-4d45-41e5-9abe-528710e2762d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:29.399070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2d1182d4-4d45-41e5-9abe-528710e2762d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:29.408047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2d1182d4-4d45-41e5-9abe-528710e2762d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:29.409543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2d1182d4-4d45-41e5-9abe-528710e2762d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:29.410695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2d1182d4-4d45-41e5-9abe-528710e2762d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149020 May 12 07:15:29.411249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1163/2241] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:29 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:29.604386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c8833e6f-b82b-4598-b9a4-f913ad6ccae4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:29.605009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c8833e6f-b82b-4598-b9a4-f913ad6ccae4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:29.611405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8833e6f-b82b-4598-b9a4-f913ad6ccae4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:29.611906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8833e6f-b82b-4598-b9a4-f913ad6ccae4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:29.612684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8833e6f-b82b-4598-b9a4-f913ad6ccae4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:29.613129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8833e6f-b82b-4598-b9a4-f913ad6ccae4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:29.672757 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c8833e6f-b82b-4598-b9a4-f913ad6ccae4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:29.680482 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c8833e6f-b82b-4598-b9a4-f913ad6ccae4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080019 May 12 07:15:29.681049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1079/2242] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:29 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:29.835421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c67e8412-9135-4c1b-9650-5cb874348345 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:29.839887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c67e8412-9135-4c1b-9650-5cb874348345 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:29.842916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c67e8412-9135-4c1b-9650-5cb874348345 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:29.843369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c67e8412-9135-4c1b-9650-5cb874348345 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:29.844162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c67e8412-9135-4c1b-9650-5cb874348345 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:29.844598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c67e8412-9135-4c1b-9650-5cb874348345 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:29.971091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c67e8412-9135-4c1b-9650-5cb874348345 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:29.978800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c67e8412-9135-4c1b-9650-5cb874348345 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147239 May 12 07:15:29.979372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1164/2243] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:29 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:30.429934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1cd854cc-396e-4a55-94e3-79060276c146 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:30.430557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1cd854cc-396e-4a55-94e3-79060276c146 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:30.437052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cd854cc-396e-4a55-94e3-79060276c146 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:30.437503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cd854cc-396e-4a55-94e3-79060276c146 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:30.438273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cd854cc-396e-4a55-94e3-79060276c146 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:30.438711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cd854cc-396e-4a55-94e3-79060276c146 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:30.570084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1cd854cc-396e-4a55-94e3-79060276c146 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:30.578224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1cd854cc-396e-4a55-94e3-79060276c146 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:30.579765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1cd854cc-396e-4a55-94e3-79060276c146 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:30.580906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1cd854cc-396e-4a55-94e3-79060276c146 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.154953 May 12 07:15:30.581462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1080/2244] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:30 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:30.697857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-15f1e17e-1189-4f59-850c-ccfe0a44996b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:30.698390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-15f1e17e-1189-4f59-850c-ccfe0a44996b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:30.704240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15f1e17e-1189-4f59-850c-ccfe0a44996b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:30.704690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15f1e17e-1189-4f59-850c-ccfe0a44996b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:30.705444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15f1e17e-1189-4f59-850c-ccfe0a44996b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:30.705875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15f1e17e-1189-4f59-850c-ccfe0a44996b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:30.768077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-15f1e17e-1189-4f59-850c-ccfe0a44996b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:30.775858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-15f1e17e-1189-4f59-850c-ccfe0a44996b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081826 May 12 07:15:30.776419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1165/2245] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:30 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:30.995764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bdc050a8-bc12-4bde-be79-e68d9d7876ea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:30.996869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bdc050a8-bc12-4bde-be79-e68d9d7876ea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:31.002780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdc050a8-bc12-4bde-be79-e68d9d7876ea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:31.003226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdc050a8-bc12-4bde-be79-e68d9d7876ea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:31.004013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdc050a8-bc12-4bde-be79-e68d9d7876ea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:31.004451 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bdc050a8-bc12-4bde-be79-e68d9d7876ea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:31.127360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bdc050a8-bc12-4bde-be79-e68d9d7876ea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:31.135433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bdc050a8-bc12-4bde-be79-e68d9d7876ea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143689 May 12 07:15:31.136025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1081/2246] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:30 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:31.599147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0b1fa4da-9872-4ab5-84bd-bd4560c27a9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:31.599780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0b1fa4da-9872-4ab5-84bd-bd4560c27a9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:31.606671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b1fa4da-9872-4ab5-84bd-bd4560c27a9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:31.607114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b1fa4da-9872-4ab5-84bd-bd4560c27a9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:31.607900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b1fa4da-9872-4ab5-84bd-bd4560c27a9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:31.608333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b1fa4da-9872-4ab5-84bd-bd4560c27a9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:31.732390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0b1fa4da-9872-4ab5-84bd-bd4560c27a9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:31.740854 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0b1fa4da-9872-4ab5-84bd-bd4560c27a9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:31.742371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0b1fa4da-9872-4ab5-84bd-bd4560c27a9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:31.743559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0b1fa4da-9872-4ab5-84bd-bd4560c27a9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148355 May 12 07:15:31.744141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1166/2247] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:31 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:31.792898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8d7f5f0d-7068-4f9a-abb4-7b41425b9385 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:31.793539 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8d7f5f0d-7068-4f9a-abb4-7b41425b9385 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:31.799623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7f5f0d-7068-4f9a-abb4-7b41425b9385 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:31.800102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7f5f0d-7068-4f9a-abb4-7b41425b9385 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:31.800862 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7f5f0d-7068-4f9a-abb4-7b41425b9385 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:31.801298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8d7f5f0d-7068-4f9a-abb4-7b41425b9385 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:31.863655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8d7f5f0d-7068-4f9a-abb4-7b41425b9385 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:31.871471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8d7f5f0d-7068-4f9a-abb4-7b41425b9385 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082402 May 12 07:15:31.872069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1082/2248] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:31 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:32.152342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7312ab53-51a9-4e8f-803b-8ad792175ee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:32.153450 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7312ab53-51a9-4e8f-803b-8ad792175ee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:32.159335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7312ab53-51a9-4e8f-803b-8ad792175ee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:32.159817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7312ab53-51a9-4e8f-803b-8ad792175ee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:32.160592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7312ab53-51a9-4e8f-803b-8ad792175ee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:32.161030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7312ab53-51a9-4e8f-803b-8ad792175ee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:32.286865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7312ab53-51a9-4e8f-803b-8ad792175ee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:32.294657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7312ab53-51a9-4e8f-803b-8ad792175ee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146275 May 12 07:15:32.295225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1167/2249] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:32 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:32.761574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-47833e54-5f5a-45b0-9744-d7c786c67966 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:32.762186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-47833e54-5f5a-45b0-9744-d7c786c67966 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:32.768561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47833e54-5f5a-45b0-9744-d7c786c67966 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:32.769008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47833e54-5f5a-45b0-9744-d7c786c67966 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:32.769772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47833e54-5f5a-45b0-9744-d7c786c67966 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:32.770207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-47833e54-5f5a-45b0-9744-d7c786c67966 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:32.888446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ff3b5912-79e0-43cd-a3cf-2d489412c21f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:32.889200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ff3b5912-79e0-43cd-a3cf-2d489412c21f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:32.895231 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-47833e54-5f5a-45b0-9744-d7c786c67966 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:32.895731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff3b5912-79e0-43cd-a3cf-2d489412c21f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:32.896190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff3b5912-79e0-43cd-a3cf-2d489412c21f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:32.896973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff3b5912-79e0-43cd-a3cf-2d489412c21f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:32.897427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff3b5912-79e0-43cd-a3cf-2d489412c21f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:32.904110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-47833e54-5f5a-45b0-9744-d7c786c67966 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:32.905603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-47833e54-5f5a-45b0-9744-d7c786c67966 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:32.906786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-47833e54-5f5a-45b0-9744-d7c786c67966 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149109 May 12 07:15:32.907581 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1083/2250] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:32 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:32.961053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ff3b5912-79e0-43cd-a3cf-2d489412c21f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:32.969385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ff3b5912-79e0-43cd-a3cf-2d489412c21f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084961 May 12 07:15:32.969953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1168/2251] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:32 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:33.311772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f570fbf2-d3eb-46af-956c-01c1eefe0a4a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:33.312423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f570fbf2-d3eb-46af-956c-01c1eefe0a4a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:33.318342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f570fbf2-d3eb-46af-956c-01c1eefe0a4a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:33.318789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f570fbf2-d3eb-46af-956c-01c1eefe0a4a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:33.319552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f570fbf2-d3eb-46af-956c-01c1eefe0a4a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:33.320018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f570fbf2-d3eb-46af-956c-01c1eefe0a4a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:33.442519 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f570fbf2-d3eb-46af-956c-01c1eefe0a4a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:33.450913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f570fbf2-d3eb-46af-956c-01c1eefe0a4a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143050 May 12 07:15:33.451478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1084/2252] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:33 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:33.925487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6bbb20a6-adfd-4e54-a16e-d37cc44a8454 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:33.926101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6bbb20a6-adfd-4e54-a16e-d37cc44a8454 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:33.932418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bbb20a6-adfd-4e54-a16e-d37cc44a8454 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:33.932873 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bbb20a6-adfd-4e54-a16e-d37cc44a8454 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:33.934142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bbb20a6-adfd-4e54-a16e-d37cc44a8454 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:33.934585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6bbb20a6-adfd-4e54-a16e-d37cc44a8454 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:33.985191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f86050e5-1807-4632-9225-b197282f8aa5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:33.985904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f86050e5-1807-4632-9225-b197282f8aa5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:33.993225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f86050e5-1807-4632-9225-b197282f8aa5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:33.993449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f86050e5-1807-4632-9225-b197282f8aa5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:33.994305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f86050e5-1807-4632-9225-b197282f8aa5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:33.994840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f86050e5-1807-4632-9225-b197282f8aa5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:34.068003 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f86050e5-1807-4632-9225-b197282f8aa5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:34.075851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f86050e5-1807-4632-9225-b197282f8aa5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.094638 May 12 07:15:34.076437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1085/2253] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:33 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:34.088256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6bbb20a6-adfd-4e54-a16e-d37cc44a8454 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:34.096597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6bbb20a6-adfd-4e54-a16e-d37cc44a8454 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:34.098093 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6bbb20a6-adfd-4e54-a16e-d37cc44a8454 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:34.099250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6bbb20a6-adfd-4e54-a16e-d37cc44a8454 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.178001 May 12 07:15:34.099830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1169/2254] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:33 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:34.468212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-99e29190-6f39-4172-bbcc-7527d9484c95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:34.468857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-99e29190-6f39-4172-bbcc-7527d9484c95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:34.474724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e29190-6f39-4172-bbcc-7527d9484c95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:34.475173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e29190-6f39-4172-bbcc-7527d9484c95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:34.475960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e29190-6f39-4172-bbcc-7527d9484c95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:34.476399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-99e29190-6f39-4172-bbcc-7527d9484c95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:34.601516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-99e29190-6f39-4172-bbcc-7527d9484c95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:34.609950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-99e29190-6f39-4172-bbcc-7527d9484c95 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146158 May 12 07:15:34.610516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1086/2255] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:34 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:35.093469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e0db326a-f7a8-4692-b654-dd55e7d0563a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:35.094091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e0db326a-f7a8-4692-b654-dd55e7d0563a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:35.100477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0db326a-f7a8-4692-b654-dd55e7d0563a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:35.100935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0db326a-f7a8-4692-b654-dd55e7d0563a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:35.101714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0db326a-f7a8-4692-b654-dd55e7d0563a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:35.102156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0db326a-f7a8-4692-b654-dd55e7d0563a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:35.117965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-39081c87-b809-4c40-b36e-3f3c69bcb726 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:35.118583 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-39081c87-b809-4c40-b36e-3f3c69bcb726 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:35.125236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39081c87-b809-4c40-b36e-3f3c69bcb726 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:35.125684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39081c87-b809-4c40-b36e-3f3c69bcb726 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:35.126449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39081c87-b809-4c40-b36e-3f3c69bcb726 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:35.126887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39081c87-b809-4c40-b36e-3f3c69bcb726 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:35.165997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e0db326a-f7a8-4692-b654-dd55e7d0563a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:35.174413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e0db326a-f7a8-4692-b654-dd55e7d0563a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085425 May 12 07:15:35.175221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1170/2256] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:35 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:35.264516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-39081c87-b809-4c40-b36e-3f3c69bcb726 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:35.272668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-39081c87-b809-4c40-b36e-3f3c69bcb726 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:35.274158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-39081c87-b809-4c40-b36e-3f3c69bcb726 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:35.275318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-39081c87-b809-4c40-b36e-3f3c69bcb726 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.161200 May 12 07:15:35.275892 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1087/2257] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:35 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:35.626984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7120747a-85a0-4000-b803-afd7f2cfeaef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:35.627526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7120747a-85a0-4000-b803-afd7f2cfeaef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:35.633492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7120747a-85a0-4000-b803-afd7f2cfeaef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:35.633944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7120747a-85a0-4000-b803-afd7f2cfeaef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:35.634715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7120747a-85a0-4000-b803-afd7f2cfeaef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:35.635155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7120747a-85a0-4000-b803-afd7f2cfeaef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:35.758282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7120747a-85a0-4000-b803-afd7f2cfeaef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:35.766038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7120747a-85a0-4000-b803-afd7f2cfeaef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143070 May 12 07:15:35.766612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1171/2258] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:35 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:36.192015 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-801970fc-73c8-4df9-a06a-53b014a921fd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:36.192632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-801970fc-73c8-4df9-a06a-53b014a921fd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:36.198872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-801970fc-73c8-4df9-a06a-53b014a921fd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:36.199323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-801970fc-73c8-4df9-a06a-53b014a921fd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:36.200113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-801970fc-73c8-4df9-a06a-53b014a921fd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:36.200551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-801970fc-73c8-4df9-a06a-53b014a921fd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:36.259258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-801970fc-73c8-4df9-a06a-53b014a921fd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:36.267374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-801970fc-73c8-4df9-a06a-53b014a921fd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079376 May 12 07:15:36.267966 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1088/2259] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:36 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:36.293363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-237e4b7a-67ec-430d-8aac-59e5a364993e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:36.293980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-237e4b7a-67ec-430d-8aac-59e5a364993e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:36.300507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-237e4b7a-67ec-430d-8aac-59e5a364993e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:36.300960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-237e4b7a-67ec-430d-8aac-59e5a364993e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:36.301729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-237e4b7a-67ec-430d-8aac-59e5a364993e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:36.302169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-237e4b7a-67ec-430d-8aac-59e5a364993e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:36.668306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-237e4b7a-67ec-430d-8aac-59e5a364993e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:36.676807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-237e4b7a-67ec-430d-8aac-59e5a364993e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:36.678332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-237e4b7a-67ec-430d-8aac-59e5a364993e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:36.679491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-237e4b7a-67ec-430d-8aac-59e5a364993e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.390078 May 12 07:15:36.680078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1172/2260] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:36 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:36.782273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-930e33ca-52ab-4d28-bb62-33c7fc76bbe2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:36.782879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-930e33ca-52ab-4d28-bb62-33c7fc76bbe2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:36.788768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-930e33ca-52ab-4d28-bb62-33c7fc76bbe2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:36.789212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-930e33ca-52ab-4d28-bb62-33c7fc76bbe2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:36.789973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-930e33ca-52ab-4d28-bb62-33c7fc76bbe2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:36.790404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-930e33ca-52ab-4d28-bb62-33c7fc76bbe2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:36.912540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-930e33ca-52ab-4d28-bb62-33c7fc76bbe2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:36.920417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-930e33ca-52ab-4d28-bb62-33c7fc76bbe2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.141937 May 12 07:15:36.920917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1089/2261] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:36 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:37.284017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f69dbea8-27fd-46f1-b777-b84212e456e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:37.284626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f69dbea8-27fd-46f1-b777-b84212e456e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:37.290494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69dbea8-27fd-46f1-b777-b84212e456e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:37.290940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69dbea8-27fd-46f1-b777-b84212e456e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:37.291717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69dbea8-27fd-46f1-b777-b84212e456e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:37.292152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69dbea8-27fd-46f1-b777-b84212e456e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:37.352393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f69dbea8-27fd-46f1-b777-b84212e456e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:37.360593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f69dbea8-27fd-46f1-b777-b84212e456e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080368 May 12 07:15:37.361161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1173/2262] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:37 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:37.698181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4fcc20c7-3f80-4bfd-9007-6fbf76d9502c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:37.698836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4fcc20c7-3f80-4bfd-9007-6fbf76d9502c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:37.705786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4fcc20c7-3f80-4bfd-9007-6fbf76d9502c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:37.706245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4fcc20c7-3f80-4bfd-9007-6fbf76d9502c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:37.707023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4fcc20c7-3f80-4bfd-9007-6fbf76d9502c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:37.707470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4fcc20c7-3f80-4bfd-9007-6fbf76d9502c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:37.833276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4fcc20c7-3f80-4bfd-9007-6fbf76d9502c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:37.841510 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4fcc20c7-3f80-4bfd-9007-6fbf76d9502c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:37.843005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4fcc20c7-3f80-4bfd-9007-6fbf76d9502c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:37.844195 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4fcc20c7-3f80-4bfd-9007-6fbf76d9502c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149920 May 12 07:15:37.844756 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1090/2263] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:37 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:37.937881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-90779a53-de85-40b5-a592-5a47564b82e2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:37.938496 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-90779a53-de85-40b5-a592-5a47564b82e2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:37.944436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90779a53-de85-40b5-a592-5a47564b82e2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:37.944892 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90779a53-de85-40b5-a592-5a47564b82e2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:37.945665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90779a53-de85-40b5-a592-5a47564b82e2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:37.946104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-90779a53-de85-40b5-a592-5a47564b82e2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:38.069087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-90779a53-de85-40b5-a592-5a47564b82e2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:38.076863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-90779a53-de85-40b5-a592-5a47564b82e2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143447 May 12 07:15:38.077434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1174/2264] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:37 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:38.376919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-05c1a15d-ae51-4830-a79e-e198382ff0f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:38.377534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-05c1a15d-ae51-4830-a79e-e198382ff0f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:38.383371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-05c1a15d-ae51-4830-a79e-e198382ff0f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:38.383850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-05c1a15d-ae51-4830-a79e-e198382ff0f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:38.384607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-05c1a15d-ae51-4830-a79e-e198382ff0f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:38.385038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-05c1a15d-ae51-4830-a79e-e198382ff0f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:38.444775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-05c1a15d-ae51-4830-a79e-e198382ff0f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:38.452458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-05c1a15d-ae51-4830-a79e-e198382ff0f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079404 May 12 07:15:38.453019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1091/2265] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:38 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:38.862867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c9b20669-895a-4889-af30-f65e954b8b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:38.863488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c9b20669-895a-4889-af30-f65e954b8b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:38.869909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9b20669-895a-4889-af30-f65e954b8b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:38.870396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9b20669-895a-4889-af30-f65e954b8b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:38.871171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9b20669-895a-4889-af30-f65e954b8b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:38.871615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9b20669-895a-4889-af30-f65e954b8b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:39.003377 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c9b20669-895a-4889-af30-f65e954b8b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:39.012597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c9b20669-895a-4889-af30-f65e954b8b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:39.014106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c9b20669-895a-4889-af30-f65e954b8b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:39.015271 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c9b20669-895a-4889-af30-f65e954b8b50 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.156419 May 12 07:15:39.015855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1175/2266] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:38 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:39.094001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-80678344-529f-49ff-9f13-6a1b5d0d8d02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:39.094618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-80678344-529f-49ff-9f13-6a1b5d0d8d02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:39.100912 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80678344-529f-49ff-9f13-6a1b5d0d8d02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:39.101359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80678344-529f-49ff-9f13-6a1b5d0d8d02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:39.102120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80678344-529f-49ff-9f13-6a1b5d0d8d02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:39.102557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80678344-529f-49ff-9f13-6a1b5d0d8d02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:39.226672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-80678344-529f-49ff-9f13-6a1b5d0d8d02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:39.234889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-80678344-529f-49ff-9f13-6a1b5d0d8d02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144665 May 12 07:15:39.235462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1092/2267] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:39 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:39.469415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f12be85b-6ed5-4faa-a7fb-9e4d7db660b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:39.469948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f12be85b-6ed5-4faa-a7fb-9e4d7db660b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:39.475929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f12be85b-6ed5-4faa-a7fb-9e4d7db660b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:39.476385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f12be85b-6ed5-4faa-a7fb-9e4d7db660b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:39.477152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f12be85b-6ed5-4faa-a7fb-9e4d7db660b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:39.477592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f12be85b-6ed5-4faa-a7fb-9e4d7db660b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:39.539433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f12be85b-6ed5-4faa-a7fb-9e4d7db660b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:39.547975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f12be85b-6ed5-4faa-a7fb-9e4d7db660b1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082289 May 12 07:15:39.548547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1176/2268] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:39 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:40.034243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-79665a35-2208-4e01-848d-df6613cb2c53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:40.034886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-79665a35-2208-4e01-848d-df6613cb2c53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:40.040998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79665a35-2208-4e01-848d-df6613cb2c53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:40.041483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79665a35-2208-4e01-848d-df6613cb2c53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:40.042253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79665a35-2208-4e01-848d-df6613cb2c53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:40.042717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79665a35-2208-4e01-848d-df6613cb2c53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:40.167668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-79665a35-2208-4e01-848d-df6613cb2c53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:40.176230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-79665a35-2208-4e01-848d-df6613cb2c53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:40.177682 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-79665a35-2208-4e01-848d-df6613cb2c53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:40.178842 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-79665a35-2208-4e01-848d-df6613cb2c53 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148519 May 12 07:15:40.179401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1093/2269] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:40 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:40.251823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-42bf6d1f-6159-4ea4-b2f1-dd11a2ba73b1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:40.252437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-42bf6d1f-6159-4ea4-b2f1-dd11a2ba73b1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:40.258718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42bf6d1f-6159-4ea4-b2f1-dd11a2ba73b1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:40.263143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42bf6d1f-6159-4ea4-b2f1-dd11a2ba73b1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:40.263143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42bf6d1f-6159-4ea4-b2f1-dd11a2ba73b1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:40.263143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-42bf6d1f-6159-4ea4-b2f1-dd11a2ba73b1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:40.384953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-42bf6d1f-6159-4ea4-b2f1-dd11a2ba73b1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:40.393459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-42bf6d1f-6159-4ea4-b2f1-dd11a2ba73b1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145482 May 12 07:15:40.394030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1177/2270] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:40 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:40.565192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e23451e8-eabc-40ad-90ea-05f61e795bcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:40.565810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e23451e8-eabc-40ad-90ea-05f61e795bcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:40.571826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e23451e8-eabc-40ad-90ea-05f61e795bcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:40.572285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e23451e8-eabc-40ad-90ea-05f61e795bcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:40.573048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e23451e8-eabc-40ad-90ea-05f61e795bcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:40.573486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e23451e8-eabc-40ad-90ea-05f61e795bcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:40.635849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e23451e8-eabc-40ad-90ea-05f61e795bcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:40.644392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e23451e8-eabc-40ad-90ea-05f61e795bcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083073 May 12 07:15:40.644963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1094/2271] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:40 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:41.197015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d3b37967-06a7-49ba-abb9-bbdc77103b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:41.197622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d3b37967-06a7-49ba-abb9-bbdc77103b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:41.203500 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3b37967-06a7-49ba-abb9-bbdc77103b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:41.203975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3b37967-06a7-49ba-abb9-bbdc77103b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:41.204732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3b37967-06a7-49ba-abb9-bbdc77103b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:41.205167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3b37967-06a7-49ba-abb9-bbdc77103b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:41.337099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d3b37967-06a7-49ba-abb9-bbdc77103b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:41.345858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d3b37967-06a7-49ba-abb9-bbdc77103b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:41.347354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d3b37967-06a7-49ba-abb9-bbdc77103b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:41.348671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d3b37967-06a7-49ba-abb9-bbdc77103b33 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.155617 May 12 07:15:41.349222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1178/2272] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:41 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:41.411147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-78d82c47-2368-47ef-a5b4-224ceb5975a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:41.411904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-78d82c47-2368-47ef-a5b4-224ceb5975a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:41.419113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d82c47-2368-47ef-a5b4-224ceb5975a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:41.420542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d82c47-2368-47ef-a5b4-224ceb5975a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:41.420542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d82c47-2368-47ef-a5b4-224ceb5975a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:41.420834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-78d82c47-2368-47ef-a5b4-224ceb5975a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:41.544379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-78d82c47-2368-47ef-a5b4-224ceb5975a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:41.552367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-78d82c47-2368-47ef-a5b4-224ceb5975a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145199 May 12 07:15:41.552945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1095/2273] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:41 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:41.661018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2e5bceb3-8539-4af4-8428-23380943dad2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:41.661651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2e5bceb3-8539-4af4-8428-23380943dad2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:41.667630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e5bceb3-8539-4af4-8428-23380943dad2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:41.668182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e5bceb3-8539-4af4-8428-23380943dad2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:41.668956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e5bceb3-8539-4af4-8428-23380943dad2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:41.669396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e5bceb3-8539-4af4-8428-23380943dad2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:41.732658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2e5bceb3-8539-4af4-8428-23380943dad2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:41.740453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2e5bceb3-8539-4af4-8428-23380943dad2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083337 May 12 07:15:41.741026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1179/2274] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:41 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:42.367753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-efa8f369-354f-4b7b-b24a-ca20a5c1a514 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:42.368297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-efa8f369-354f-4b7b-b24a-ca20a5c1a514 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:42.374857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efa8f369-354f-4b7b-b24a-ca20a5c1a514 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:42.375307 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efa8f369-354f-4b7b-b24a-ca20a5c1a514 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:42.376101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efa8f369-354f-4b7b-b24a-ca20a5c1a514 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:42.376540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-efa8f369-354f-4b7b-b24a-ca20a5c1a514 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:42.499271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-efa8f369-354f-4b7b-b24a-ca20a5c1a514 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:42.507589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-efa8f369-354f-4b7b-b24a-ca20a5c1a514 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:42.509019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-efa8f369-354f-4b7b-b24a-ca20a5c1a514 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:42.510184 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-efa8f369-354f-4b7b-b24a-ca20a5c1a514 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146498 May 12 07:15:42.510745 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1096/2275] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:42 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:42.568985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7dd7215d-cbe5-41e0-9df3-e1ba29597ca8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:42.569604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7dd7215d-cbe5-41e0-9df3-e1ba29597ca8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:42.575895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7dd7215d-cbe5-41e0-9df3-e1ba29597ca8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:42.576346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7dd7215d-cbe5-41e0-9df3-e1ba29597ca8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:42.577111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7dd7215d-cbe5-41e0-9df3-e1ba29597ca8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:42.577545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7dd7215d-cbe5-41e0-9df3-e1ba29597ca8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:42.700492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7dd7215d-cbe5-41e0-9df3-e1ba29597ca8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:42.708176 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7dd7215d-cbe5-41e0-9df3-e1ba29597ca8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.142949 May 12 07:15:42.708749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1180/2276] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:42 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:42.757045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dca15f62-8950-4049-bb19-511f0ec9169f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:42.757729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dca15f62-8950-4049-bb19-511f0ec9169f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:42.763543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dca15f62-8950-4049-bb19-511f0ec9169f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:42.764037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dca15f62-8950-4049-bb19-511f0ec9169f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:42.764810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dca15f62-8950-4049-bb19-511f0ec9169f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:42.765251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dca15f62-8950-4049-bb19-511f0ec9169f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:42.827830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dca15f62-8950-4049-bb19-511f0ec9169f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:42.835589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dca15f62-8950-4049-bb19-511f0ec9169f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082377 May 12 07:15:42.836196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1097/2277] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:42 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:43.528658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-de6cdfe4-aac4-4a01-9cec-d423b2b8a371 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:43.529308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-de6cdfe4-aac4-4a01-9cec-d423b2b8a371 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:43.535258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de6cdfe4-aac4-4a01-9cec-d423b2b8a371 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:43.535729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de6cdfe4-aac4-4a01-9cec-d423b2b8a371 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:43.536503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de6cdfe4-aac4-4a01-9cec-d423b2b8a371 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:43.536940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de6cdfe4-aac4-4a01-9cec-d423b2b8a371 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:43.660460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de6cdfe4-aac4-4a01-9cec-d423b2b8a371 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:43.668651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de6cdfe4-aac4-4a01-9cec-d423b2b8a371 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:43.670150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de6cdfe4-aac4-4a01-9cec-d423b2b8a371 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:43.671301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-de6cdfe4-aac4-4a01-9cec-d423b2b8a371 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146626 May 12 07:15:43.671899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1181/2278] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:43 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:43.725374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e68edac4-fa2b-420e-be2c-210927b31b31 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:43.725976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e68edac4-fa2b-420e-be2c-210927b31b31 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:43.732235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e68edac4-fa2b-420e-be2c-210927b31b31 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:43.732683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e68edac4-fa2b-420e-be2c-210927b31b31 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:43.733439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e68edac4-fa2b-420e-be2c-210927b31b31 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:43.733875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e68edac4-fa2b-420e-be2c-210927b31b31 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:43.851946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-caa54578-6f92-4bbf-b763-65f645f210a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:43.852685 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-caa54578-6f92-4bbf-b763-65f645f210a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:43.859075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-caa54578-6f92-4bbf-b763-65f645f210a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:43.859500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e68edac4-fa2b-420e-be2c-210927b31b31 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:43.859710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-caa54578-6f92-4bbf-b763-65f645f210a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:43.860331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-caa54578-6f92-4bbf-b763-65f645f210a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:43.860764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-caa54578-6f92-4bbf-b763-65f645f210a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:43.867475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e68edac4-fa2b-420e-be2c-210927b31b31 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145883 May 12 07:15:43.868068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1098/2279] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:43 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:43.924311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-caa54578-6f92-4bbf-b763-65f645f210a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:43.932020 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-caa54578-6f92-4bbf-b763-65f645f210a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083947 May 12 07:15:43.932585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1182/2280] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:43 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:44.689425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c9e50cfa-e530-4934-94e5-2bc887af1f2e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:44.690033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c9e50cfa-e530-4934-94e5-2bc887af1f2e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:44.695815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9e50cfa-e530-4934-94e5-2bc887af1f2e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:44.696266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9e50cfa-e530-4934-94e5-2bc887af1f2e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:44.697024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9e50cfa-e530-4934-94e5-2bc887af1f2e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:44.697462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9e50cfa-e530-4934-94e5-2bc887af1f2e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:44.820909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c9e50cfa-e530-4934-94e5-2bc887af1f2e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:44.829507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c9e50cfa-e530-4934-94e5-2bc887af1f2e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:44.830989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c9e50cfa-e530-4934-94e5-2bc887af1f2e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:44.832163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c9e50cfa-e530-4934-94e5-2bc887af1f2e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.146744 May 12 07:15:44.832720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1099/2281] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:44 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:44.884826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-41f8267b-6a7c-4de0-b480-22a6524d0cc0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:44.885516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-41f8267b-6a7c-4de0-b480-22a6524d0cc0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:44.892256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41f8267b-6a7c-4de0-b480-22a6524d0cc0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:44.892701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41f8267b-6a7c-4de0-b480-22a6524d0cc0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:44.893492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41f8267b-6a7c-4de0-b480-22a6524d0cc0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:44.893924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41f8267b-6a7c-4de0-b480-22a6524d0cc0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:44.950112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ff59785c-c9da-4fab-ac8e-e879d8044423 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:44.950746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ff59785c-c9da-4fab-ac8e-e879d8044423 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:44.956676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff59785c-c9da-4fab-ac8e-e879d8044423 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:44.957199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff59785c-c9da-4fab-ac8e-e879d8044423 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:44.958057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff59785c-c9da-4fab-ac8e-e879d8044423 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:44.958567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff59785c-c9da-4fab-ac8e-e879d8044423 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:45.031835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ff59785c-c9da-4fab-ac8e-e879d8044423 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:45.039494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ff59785c-c9da-4fab-ac8e-e879d8044423 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.093830 May 12 07:15:45.040090 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1100/2282] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:44 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:45.048229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-41f8267b-6a7c-4de0-b480-22a6524d0cc0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:45.056094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-41f8267b-6a7c-4de0-b480-22a6524d0cc0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.175102 May 12 07:15:45.056672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1183/2283] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:44 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:45.850272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-66ef07cc-9c8b-471d-bc19-f344a34fec17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:45.850879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-66ef07cc-9c8b-471d-bc19-f344a34fec17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:45.857170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66ef07cc-9c8b-471d-bc19-f344a34fec17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:45.857622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66ef07cc-9c8b-471d-bc19-f344a34fec17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:45.858377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66ef07cc-9c8b-471d-bc19-f344a34fec17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:45.858812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66ef07cc-9c8b-471d-bc19-f344a34fec17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:45.984564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-66ef07cc-9c8b-471d-bc19-f344a34fec17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:45.992906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-66ef07cc-9c8b-471d-bc19-f344a34fec17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:45.994400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-66ef07cc-9c8b-471d-bc19-f344a34fec17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:45.996092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-66ef07cc-9c8b-471d-bc19-f344a34fec17 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149180 May 12 07:15:45.996644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1101/2284] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:45 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:46.056469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0a0a6f0a-aedc-483a-9cdd-abd143469ddc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:46.057078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0a0a6f0a-aedc-483a-9cdd-abd143469ddc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:46.064184 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0a6f0a-aedc-483a-9cdd-abd143469ddc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:46.064632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0a6f0a-aedc-483a-9cdd-abd143469ddc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:46.065398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0a6f0a-aedc-483a-9cdd-abd143469ddc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:46.065833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0a6f0a-aedc-483a-9cdd-abd143469ddc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:46.073236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a9ec1d47-eebd-4da0-876b-297c3d19ab55 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:46.075750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a9ec1d47-eebd-4da0-876b-297c3d19ab55 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:46.079799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9ec1d47-eebd-4da0-876b-297c3d19ab55 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:46.080258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9ec1d47-eebd-4da0-876b-297c3d19ab55 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:46.081033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9ec1d47-eebd-4da0-876b-297c3d19ab55 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:46.081470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9ec1d47-eebd-4da0-876b-297c3d19ab55 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:46.128693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0a0a6f0a-aedc-483a-9cdd-abd143469ddc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:46.136671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0a0a6f0a-aedc-483a-9cdd-abd143469ddc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084152 May 12 07:15:46.137244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1184/2285] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:46 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:46.221632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a9ec1d47-eebd-4da0-876b-297c3d19ab55 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:46.229372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a9ec1d47-eebd-4da0-876b-297c3d19ab55 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.159949 May 12 07:15:46.230481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1102/2286] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:46 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:47.015295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e1a853d6-00ad-4dba-af46-83efd240061f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:47.015943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e1a853d6-00ad-4dba-af46-83efd240061f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:47.021834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1a853d6-00ad-4dba-af46-83efd240061f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:47.022264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1a853d6-00ad-4dba-af46-83efd240061f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:47.023022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1a853d6-00ad-4dba-af46-83efd240061f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:47.023451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1a853d6-00ad-4dba-af46-83efd240061f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:47.146419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e1a853d6-00ad-4dba-af46-83efd240061f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:47.154246 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-49d7deb3-b77c-407a-b7bb-173176b98127 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:47.154873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-49d7deb3-b77c-407a-b7bb-173176b98127 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:47.155185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e1a853d6-00ad-4dba-af46-83efd240061f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:47.156709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e1a853d6-00ad-4dba-af46-83efd240061f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:47.157982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e1a853d6-00ad-4dba-af46-83efd240061f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147139 May 12 07:15:47.158542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1185/2287] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:47 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:47.161598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49d7deb3-b77c-407a-b7bb-173176b98127 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:47.162171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49d7deb3-b77c-407a-b7bb-173176b98127 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:47.162979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49d7deb3-b77c-407a-b7bb-173176b98127 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:47.163418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49d7deb3-b77c-407a-b7bb-173176b98127 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:47.224994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-49d7deb3-b77c-407a-b7bb-173176b98127 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:47.232700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-49d7deb3-b77c-407a-b7bb-173176b98127 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082918 May 12 07:15:47.233265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1103/2288] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:47 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:47.246647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-98a3508c-fcad-4d27-8d6a-bcbe7fccf2f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:47.247198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-98a3508c-fcad-4d27-8d6a-bcbe7fccf2f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:47.252989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98a3508c-fcad-4d27-8d6a-bcbe7fccf2f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:47.253437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98a3508c-fcad-4d27-8d6a-bcbe7fccf2f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:47.254202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98a3508c-fcad-4d27-8d6a-bcbe7fccf2f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:47.254638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98a3508c-fcad-4d27-8d6a-bcbe7fccf2f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:47.381260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-98a3508c-fcad-4d27-8d6a-bcbe7fccf2f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:47.389608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-98a3508c-fcad-4d27-8d6a-bcbe7fccf2f1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147300 May 12 07:15:47.390169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1186/2289] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:47 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:48.176442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e49dd26c-6650-4fdb-a48c-bef67154975e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:48.177060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e49dd26c-6650-4fdb-a48c-bef67154975e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:48.183371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e49dd26c-6650-4fdb-a48c-bef67154975e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:48.183872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e49dd26c-6650-4fdb-a48c-bef67154975e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:48.184625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e49dd26c-6650-4fdb-a48c-bef67154975e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:48.185064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e49dd26c-6650-4fdb-a48c-bef67154975e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:48.249778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3dfa4f48-9b57-49bc-804a-bedeb41733ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:48.250446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3dfa4f48-9b57-49bc-804a-bedeb41733ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:48.256767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dfa4f48-9b57-49bc-804a-bedeb41733ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:48.257296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dfa4f48-9b57-49bc-804a-bedeb41733ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:48.258138 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dfa4f48-9b57-49bc-804a-bedeb41733ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:48.258649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3dfa4f48-9b57-49bc-804a-bedeb41733ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:48.329634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3dfa4f48-9b57-49bc-804a-bedeb41733ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:48.334055 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e49dd26c-6650-4fdb-a48c-bef67154975e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:48.337476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3dfa4f48-9b57-49bc-804a-bedeb41733ca tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.091641 May 12 07:15:48.338054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1187/2290] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:48 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:48.343472 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e49dd26c-6650-4fdb-a48c-bef67154975e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:48.345149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e49dd26c-6650-4fdb-a48c-bef67154975e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:48.346359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e49dd26c-6650-4fdb-a48c-bef67154975e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.174078 May 12 07:15:48.346864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1104/2291] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:48 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:48.406817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a6a109f9-2906-41cf-af6b-7c03d0cf3745 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:48.407498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a6a109f9-2906-41cf-af6b-7c03d0cf3745 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:48.413322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6a109f9-2906-41cf-af6b-7c03d0cf3745 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:48.413766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6a109f9-2906-41cf-af6b-7c03d0cf3745 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:48.414521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6a109f9-2906-41cf-af6b-7c03d0cf3745 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:48.414957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a6a109f9-2906-41cf-af6b-7c03d0cf3745 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:48.541841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a6a109f9-2906-41cf-af6b-7c03d0cf3745 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:48.549839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a6a109f9-2906-41cf-af6b-7c03d0cf3745 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146707 May 12 07:15:48.550400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1188/2292] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:48 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:49.355174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9cbb9ee8-3cac-4430-a800-51f78e03d718 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:49.355771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9cbb9ee8-3cac-4430-a800-51f78e03d718 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:49.362080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cbb9ee8-3cac-4430-a800-51f78e03d718 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:49.362526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cbb9ee8-3cac-4430-a800-51f78e03d718 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:49.363317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cbb9ee8-3cac-4430-a800-51f78e03d718 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:49.363783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9cbb9ee8-3cac-4430-a800-51f78e03d718 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:49.366207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0f72d6a4-8a58-4ba7-937f-be2d182d08c2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:49.366825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0f72d6a4-8a58-4ba7-937f-be2d182d08c2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:49.373757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f72d6a4-8a58-4ba7-937f-be2d182d08c2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:49.374211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f72d6a4-8a58-4ba7-937f-be2d182d08c2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:49.374985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f72d6a4-8a58-4ba7-937f-be2d182d08c2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:49.375425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f72d6a4-8a58-4ba7-937f-be2d182d08c2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:49.434246 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9cbb9ee8-3cac-4430-a800-51f78e03d718 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:49.442244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9cbb9ee8-3cac-4430-a800-51f78e03d718 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.091633 May 12 07:15:49.442814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1105/2293] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:49 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:49.514977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0f72d6a4-8a58-4ba7-937f-be2d182d08c2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:49.523249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0f72d6a4-8a58-4ba7-937f-be2d182d08c2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:49.524806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0f72d6a4-8a58-4ba7-937f-be2d182d08c2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:49.525974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0f72d6a4-8a58-4ba7-937f-be2d182d08c2 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.163637 May 12 07:15:49.527070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1189/2294] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:49 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:15:49.566556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4eac910d-5f90-4cb9-b3dc-474221cbca3c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:49.567182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4eac910d-5f90-4cb9-b3dc-474221cbca3c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:49.573050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4eac910d-5f90-4cb9-b3dc-474221cbca3c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:49.573505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4eac910d-5f90-4cb9-b3dc-474221cbca3c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:49.574275 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4eac910d-5f90-4cb9-b3dc-474221cbca3c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:49.574719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4eac910d-5f90-4cb9-b3dc-474221cbca3c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:49.702793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4eac910d-5f90-4cb9-b3dc-474221cbca3c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:49.710751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4eac910d-5f90-4cb9-b3dc-474221cbca3c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148081 May 12 07:15:49.711312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1106/2295] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:49 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:50.459041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e1a39d85-e31a-4404-9f32-c6c4187227cd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:50.459593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e1a39d85-e31a-4404-9f32-c6c4187227cd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:50.465959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1a39d85-e31a-4404-9f32-c6c4187227cd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:50.466417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1a39d85-e31a-4404-9f32-c6c4187227cd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:50.467191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1a39d85-e31a-4404-9f32-c6c4187227cd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:50.467634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e1a39d85-e31a-4404-9f32-c6c4187227cd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:50.527514 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e1a39d85-e31a-4404-9f32-c6c4187227cd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:50.535253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e1a39d85-e31a-4404-9f32-c6c4187227cd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080188 May 12 07:15:50.535876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1190/2296] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:50 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:50.547194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-271748c9-7699-4f0f-bcd2-d0983a4b87fc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:50.548119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-271748c9-7699-4f0f-bcd2-d0983a4b87fc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:50.554457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-271748c9-7699-4f0f-bcd2-d0983a4b87fc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:50.554906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-271748c9-7699-4f0f-bcd2-d0983a4b87fc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:50.555670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-271748c9-7699-4f0f-bcd2-d0983a4b87fc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:50.556130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-271748c9-7699-4f0f-bcd2-d0983a4b87fc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:50.683894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-271748c9-7699-4f0f-bcd2-d0983a4b87fc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:50.692158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-271748c9-7699-4f0f-bcd2-d0983a4b87fc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:50.693657 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-271748c9-7699-4f0f-bcd2-d0983a4b87fc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:50.694814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-271748c9-7699-4f0f-bcd2-d0983a4b87fc tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.153313 May 12 07:15:50.695366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1107/2297] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:50 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:50.728111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ab4aabb8-0d25-42be-b5a3-2245a550af07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:50.728662 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ab4aabb8-0d25-42be-b5a3-2245a550af07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:50.735024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab4aabb8-0d25-42be-b5a3-2245a550af07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:50.735477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab4aabb8-0d25-42be-b5a3-2245a550af07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:50.736275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab4aabb8-0d25-42be-b5a3-2245a550af07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:50.736717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab4aabb8-0d25-42be-b5a3-2245a550af07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:50.860266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ab4aabb8-0d25-42be-b5a3-2245a550af07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:50.868179 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ab4aabb8-0d25-42be-b5a3-2245a550af07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143914 May 12 07:15:50.868745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1191/2298] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:50 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:51.553074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-91519702-7246-437a-aad8-ba391dd80062 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:51.553687 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-91519702-7246-437a-aad8-ba391dd80062 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:51.560891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91519702-7246-437a-aad8-ba391dd80062 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:51.561339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91519702-7246-437a-aad8-ba391dd80062 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:51.562105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91519702-7246-437a-aad8-ba391dd80062 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:51.562545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-91519702-7246-437a-aad8-ba391dd80062 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:51.622928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-91519702-7246-437a-aad8-ba391dd80062 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:51.630949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-91519702-7246-437a-aad8-ba391dd80062 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081738 May 12 07:15:51.631510 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1108/2299] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:51 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:51.712900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0bb86a19-20b7-4f7e-bcca-a7553d178a61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:51.713508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0bb86a19-20b7-4f7e-bcca-a7553d178a61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:51.720878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bb86a19-20b7-4f7e-bcca-a7553d178a61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:51.721327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bb86a19-20b7-4f7e-bcca-a7553d178a61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:51.722097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bb86a19-20b7-4f7e-bcca-a7553d178a61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:51.722538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bb86a19-20b7-4f7e-bcca-a7553d178a61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:51.848659 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0bb86a19-20b7-4f7e-bcca-a7553d178a61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:51.857006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0bb86a19-20b7-4f7e-bcca-a7553d178a61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:51.858554 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0bb86a19-20b7-4f7e-bcca-a7553d178a61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:51.859732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0bb86a19-20b7-4f7e-bcca-a7553d178a61 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150676 May 12 07:15:51.860298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1192/2300] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:51 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:51.885515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bb7c23da-82cb-4bfc-a373-b58c87b9ae8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:51.886740 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bb7c23da-82cb-4bfc-a373-b58c87b9ae8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:51.892603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb7c23da-82cb-4bfc-a373-b58c87b9ae8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:51.893053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb7c23da-82cb-4bfc-a373-b58c87b9ae8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:51.893873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb7c23da-82cb-4bfc-a373-b58c87b9ae8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:51.894316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb7c23da-82cb-4bfc-a373-b58c87b9ae8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:52.020882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bb7c23da-82cb-4bfc-a373-b58c87b9ae8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:52.028783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bb7c23da-82cb-4bfc-a373-b58c87b9ae8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147118 May 12 07:15:52.029355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1109/2301] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:51 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:52.647245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3ce0b322-c81e-4590-a7d8-ecf2a8fcaadb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:52.647890 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3ce0b322-c81e-4590-a7d8-ecf2a8fcaadb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:52.654349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ce0b322-c81e-4590-a7d8-ecf2a8fcaadb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:52.654799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ce0b322-c81e-4590-a7d8-ecf2a8fcaadb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:52.655574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ce0b322-c81e-4590-a7d8-ecf2a8fcaadb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:52.656038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ce0b322-c81e-4590-a7d8-ecf2a8fcaadb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:52.716021 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3ce0b322-c81e-4590-a7d8-ecf2a8fcaadb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:52.724193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3ce0b322-c81e-4590-a7d8-ecf2a8fcaadb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080786 May 12 07:15:52.724765 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1193/2302] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:52 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:52.878099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-860bc3ae-1dc3-4346-b7e5-c87299653b80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:52.878702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-860bc3ae-1dc3-4346-b7e5-c87299653b80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:52.885240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-860bc3ae-1dc3-4346-b7e5-c87299653b80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:52.886188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-860bc3ae-1dc3-4346-b7e5-c87299653b80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:52.886949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-860bc3ae-1dc3-4346-b7e5-c87299653b80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:52.887381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-860bc3ae-1dc3-4346-b7e5-c87299653b80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:53.015227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-860bc3ae-1dc3-4346-b7e5-c87299653b80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:53.023466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-860bc3ae-1dc3-4346-b7e5-c87299653b80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:53.025013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-860bc3ae-1dc3-4346-b7e5-c87299653b80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:53.026170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-860bc3ae-1dc3-4346-b7e5-c87299653b80 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151982 May 12 07:15:53.026870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1110/2303] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:52 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:53.045960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-de9cc269-dca5-40ae-a56f-d4594b90f0c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:53.046581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-de9cc269-dca5-40ae-a56f-d4594b90f0c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:53.052713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de9cc269-dca5-40ae-a56f-d4594b90f0c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:53.053170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de9cc269-dca5-40ae-a56f-d4594b90f0c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:53.053944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de9cc269-dca5-40ae-a56f-d4594b90f0c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:53.054388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-de9cc269-dca5-40ae-a56f-d4594b90f0c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:53.179343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-de9cc269-dca5-40ae-a56f-d4594b90f0c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:53.187193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-de9cc269-dca5-40ae-a56f-d4594b90f0c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145494 May 12 07:15:53.187799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1194/2304] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:53 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:53.741445 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ed001c27-980e-43df-ab03-6aefa611b474 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:53.742062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ed001c27-980e-43df-ab03-6aefa611b474 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:53.748829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed001c27-980e-43df-ab03-6aefa611b474 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:53.749280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed001c27-980e-43df-ab03-6aefa611b474 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:53.750048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed001c27-980e-43df-ab03-6aefa611b474 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:53.750489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed001c27-980e-43df-ab03-6aefa611b474 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:53.810774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ed001c27-980e-43df-ab03-6aefa611b474 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:53.818517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ed001c27-980e-43df-ab03-6aefa611b474 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080948 May 12 07:15:53.819073 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1111/2305] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:53 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:54.045209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6e14260e-0075-4ee2-a3dd-9c2080438e98 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:54.045820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6e14260e-0075-4ee2-a3dd-9c2080438e98 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:54.052470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e14260e-0075-4ee2-a3dd-9c2080438e98 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:54.052921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e14260e-0075-4ee2-a3dd-9c2080438e98 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:54.053686 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e14260e-0075-4ee2-a3dd-9c2080438e98 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:54.054152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e14260e-0075-4ee2-a3dd-9c2080438e98 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:54.181883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6e14260e-0075-4ee2-a3dd-9c2080438e98 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:54.190134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6e14260e-0075-4ee2-a3dd-9c2080438e98 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:54.191628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6e14260e-0075-4ee2-a3dd-9c2080438e98 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:54.192808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6e14260e-0075-4ee2-a3dd-9c2080438e98 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152190 May 12 07:15:54.193368 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1195/2306] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:54 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:54.203233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7ff589b8-b84e-414e-a7d1-a2e88ca8a861 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:54.203910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7ff589b8-b84e-414e-a7d1-a2e88ca8a861 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:54.210272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ff589b8-b84e-414e-a7d1-a2e88ca8a861 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:54.210734 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ff589b8-b84e-414e-a7d1-a2e88ca8a861 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:54.211510 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ff589b8-b84e-414e-a7d1-a2e88ca8a861 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:54.211998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7ff589b8-b84e-414e-a7d1-a2e88ca8a861 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:54.336244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7ff589b8-b84e-414e-a7d1-a2e88ca8a861 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:54.344626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7ff589b8-b84e-414e-a7d1-a2e88ca8a861 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145211 May 12 07:15:54.345198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1112/2307] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:54 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:54.834281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8653d71b-d78e-4a8f-b12b-78e442b54700 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:54.834919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8653d71b-d78e-4a8f-b12b-78e442b54700 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:54.840924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8653d71b-d78e-4a8f-b12b-78e442b54700 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:54.841368 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8653d71b-d78e-4a8f-b12b-78e442b54700 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:54.842155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8653d71b-d78e-4a8f-b12b-78e442b54700 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:54.842585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8653d71b-d78e-4a8f-b12b-78e442b54700 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:54.904302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8653d71b-d78e-4a8f-b12b-78e442b54700 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:54.912096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8653d71b-d78e-4a8f-b12b-78e442b54700 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081673 May 12 07:15:54.912670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1196/2308] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:54 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:55.210396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-302afc60-9e96-4e5f-aff9-7a6e60864337 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:55.211043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-302afc60-9e96-4e5f-aff9-7a6e60864337 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:55.217487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-302afc60-9e96-4e5f-aff9-7a6e60864337 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:55.217945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-302afc60-9e96-4e5f-aff9-7a6e60864337 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:55.218717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-302afc60-9e96-4e5f-aff9-7a6e60864337 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:55.219159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-302afc60-9e96-4e5f-aff9-7a6e60864337 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:55.345755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-302afc60-9e96-4e5f-aff9-7a6e60864337 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:55.353957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-302afc60-9e96-4e5f-aff9-7a6e60864337 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:55.356044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-302afc60-9e96-4e5f-aff9-7a6e60864337 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:55.357263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-302afc60-9e96-4e5f-aff9-7a6e60864337 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150795 May 12 07:15:55.358014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1113/2309] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:55 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:55.363367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d7fddc64-1682-422c-a77b-bfc8d202a884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:55.364037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d7fddc64-1682-422c-a77b-bfc8d202a884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:55.371007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7fddc64-1682-422c-a77b-bfc8d202a884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:55.371455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7fddc64-1682-422c-a77b-bfc8d202a884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:55.372251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7fddc64-1682-422c-a77b-bfc8d202a884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:55.372692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7fddc64-1682-422c-a77b-bfc8d202a884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:55.497359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d7fddc64-1682-422c-a77b-bfc8d202a884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:55.505017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d7fddc64-1682-422c-a77b-bfc8d202a884 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145452 May 12 07:15:55.505590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1197/2310] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:55 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:55.929144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-796e1dd6-332a-43fd-8d65-a254a0b10994 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:55.929764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-796e1dd6-332a-43fd-8d65-a254a0b10994 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:55.936393 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-796e1dd6-332a-43fd-8d65-a254a0b10994 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:55.936847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-796e1dd6-332a-43fd-8d65-a254a0b10994 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:55.937621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-796e1dd6-332a-43fd-8d65-a254a0b10994 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:55.938064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-796e1dd6-332a-43fd-8d65-a254a0b10994 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:56.001507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-796e1dd6-332a-43fd-8d65-a254a0b10994 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:56.009389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-796e1dd6-332a-43fd-8d65-a254a0b10994 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084093 May 12 07:15:56.009962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1114/2311] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:55 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:56.376047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c8a4bca8-9ba1-4582-b502-45bafe8cb1a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:56.376655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c8a4bca8-9ba1-4582-b502-45bafe8cb1a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:56.382874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8a4bca8-9ba1-4582-b502-45bafe8cb1a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:56.383319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8a4bca8-9ba1-4582-b502-45bafe8cb1a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:56.384105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8a4bca8-9ba1-4582-b502-45bafe8cb1a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:56.384538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c8a4bca8-9ba1-4582-b502-45bafe8cb1a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:56.507546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c8a4bca8-9ba1-4582-b502-45bafe8cb1a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:56.516225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c8a4bca8-9ba1-4582-b502-45bafe8cb1a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:56.518013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c8a4bca8-9ba1-4582-b502-45bafe8cb1a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:56.519175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c8a4bca8-9ba1-4582-b502-45bafe8cb1a5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147304 May 12 07:15:56.519746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1198/2312] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:56 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:56.522436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b51db9c4-c674-4d0a-8c6f-c94a3b9dfd30 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:56.523054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b51db9c4-c674-4d0a-8c6f-c94a3b9dfd30 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:56.530133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b51db9c4-c674-4d0a-8c6f-c94a3b9dfd30 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:56.530593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b51db9c4-c674-4d0a-8c6f-c94a3b9dfd30 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:56.531364 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b51db9c4-c674-4d0a-8c6f-c94a3b9dfd30 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:56.531831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b51db9c4-c674-4d0a-8c6f-c94a3b9dfd30 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:56.655732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b51db9c4-c674-4d0a-8c6f-c94a3b9dfd30 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:56.663394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b51db9c4-c674-4d0a-8c6f-c94a3b9dfd30 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144933 May 12 07:15:56.669051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1115/2313] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:56 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:57.026277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1493e0b4-df9f-4678-9aba-8c59188f1b89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:57.027018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1493e0b4-df9f-4678-9aba-8c59188f1b89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:57.032972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1493e0b4-df9f-4678-9aba-8c59188f1b89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:57.033424 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1493e0b4-df9f-4678-9aba-8c59188f1b89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:57.034193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1493e0b4-df9f-4678-9aba-8c59188f1b89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:57.034628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1493e0b4-df9f-4678-9aba-8c59188f1b89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:57.097968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1493e0b4-df9f-4678-9aba-8c59188f1b89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:57.106319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1493e0b4-df9f-4678-9aba-8c59188f1b89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083908 May 12 07:15:57.106887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1199/2314] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:57 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:57.537996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b0e709b1-fa9c-4a81-8ffe-cfb6fab9cc8b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:57.538620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b0e709b1-fa9c-4a81-8ffe-cfb6fab9cc8b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:57.545537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0e709b1-fa9c-4a81-8ffe-cfb6fab9cc8b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:57.545984 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0e709b1-fa9c-4a81-8ffe-cfb6fab9cc8b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:57.546747 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0e709b1-fa9c-4a81-8ffe-cfb6fab9cc8b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:57.547182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0e709b1-fa9c-4a81-8ffe-cfb6fab9cc8b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:57.673450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b0e709b1-fa9c-4a81-8ffe-cfb6fab9cc8b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:57.680718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2da178c0-477b-4b6f-9863-cade5cea2f4c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:57.681359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2da178c0-477b-4b6f-9863-cade5cea2f4c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:57.681929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b0e709b1-fa9c-4a81-8ffe-cfb6fab9cc8b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:57.684114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b0e709b1-fa9c-4a81-8ffe-cfb6fab9cc8b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:57.685165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b0e709b1-fa9c-4a81-8ffe-cfb6fab9cc8b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151071 May 12 07:15:57.685729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1116/2315] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:57 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:57.688465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2da178c0-477b-4b6f-9863-cade5cea2f4c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:57.688911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2da178c0-477b-4b6f-9863-cade5cea2f4c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:57.689683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2da178c0-477b-4b6f-9863-cade5cea2f4c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:57.690113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2da178c0-477b-4b6f-9863-cade5cea2f4c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:57.814428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2da178c0-477b-4b6f-9863-cade5cea2f4c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:57.822095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2da178c0-477b-4b6f-9863-cade5cea2f4c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145189 May 12 07:15:57.822663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1200/2316] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:57 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:58.123819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-254dc0a7-82cb-492b-b346-f6ad7ecb845e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:58.124389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-254dc0a7-82cb-492b-b346-f6ad7ecb845e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:58.130339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-254dc0a7-82cb-492b-b346-f6ad7ecb845e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:58.130793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-254dc0a7-82cb-492b-b346-f6ad7ecb845e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:58.131562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-254dc0a7-82cb-492b-b346-f6ad7ecb845e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:58.132044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-254dc0a7-82cb-492b-b346-f6ad7ecb845e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:58.194425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-254dc0a7-82cb-492b-b346-f6ad7ecb845e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:58.202162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-254dc0a7-82cb-492b-b346-f6ad7ecb845e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082927 May 12 07:15:58.202728 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1117/2317] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:58 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:58.702985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ef13079b-c90f-4b7d-8970-5ce0683da8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:58.703592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ef13079b-c90f-4b7d-8970-5ce0683da8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:58.709855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef13079b-c90f-4b7d-8970-5ce0683da8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:58.710302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef13079b-c90f-4b7d-8970-5ce0683da8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:58.711056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef13079b-c90f-4b7d-8970-5ce0683da8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:58.711488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef13079b-c90f-4b7d-8970-5ce0683da8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:58.835581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ef13079b-c90f-4b7d-8970-5ce0683da8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:58.840099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-32ad0261-7204-4ca0-bb90-1ae9c43aceb3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:58.840724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-32ad0261-7204-4ca0-bb90-1ae9c43aceb3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:58.844553 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ef13079b-c90f-4b7d-8970-5ce0683da8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:58.846041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ef13079b-c90f-4b7d-8970-5ce0683da8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:58.847027 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32ad0261-7204-4ca0-bb90-1ae9c43aceb3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:58.847203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ef13079b-c90f-4b7d-8970-5ce0683da8de tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148177 May 12 07:15:58.847487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32ad0261-7204-4ca0-bb90-1ae9c43aceb3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:58.847777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1201/2318] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:58 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:15:58.848287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32ad0261-7204-4ca0-bb90-1ae9c43aceb3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:58.848727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32ad0261-7204-4ca0-bb90-1ae9c43aceb3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:58.973145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-32ad0261-7204-4ca0-bb90-1ae9c43aceb3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:58.980855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-32ad0261-7204-4ca0-bb90-1ae9c43aceb3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145183 May 12 07:15:58.981422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1118/2319] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:58 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:15:59.218342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-af656fb6-2ab4-4467-9ad8-a750110d1a11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:59.218955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-af656fb6-2ab4-4467-9ad8-a750110d1a11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:59.224883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af656fb6-2ab4-4467-9ad8-a750110d1a11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:59.225284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af656fb6-2ab4-4467-9ad8-a750110d1a11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:59.226049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af656fb6-2ab4-4467-9ad8-a750110d1a11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:59.226489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af656fb6-2ab4-4467-9ad8-a750110d1a11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:59.290446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-af656fb6-2ab4-4467-9ad8-a750110d1a11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:15:59.298556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-af656fb6-2ab4-4467-9ad8-a750110d1a11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084120 May 12 07:15:59.299121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1202/2320] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:59 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:15:59.865615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9fe2f57a-648a-45ab-aeb8-ff80bdc539d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:59.866227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9fe2f57a-648a-45ab-aeb8-ff80bdc539d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:59.873125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9fe2f57a-648a-45ab-aeb8-ff80bdc539d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:59.873574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9fe2f57a-648a-45ab-aeb8-ff80bdc539d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:59.874339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9fe2f57a-648a-45ab-aeb8-ff80bdc539d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:15:59.874784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9fe2f57a-648a-45ab-aeb8-ff80bdc539d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:15:59.997887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c9b79b84-5589-4ea2-b55e-0d8069176ba2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:15:59.998529 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c9b79b84-5589-4ea2-b55e-0d8069176ba2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:15:59.999620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9fe2f57a-648a-45ab-aeb8-ff80bdc539d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:00.004928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9b79b84-5589-4ea2-b55e-0d8069176ba2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:00.005380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9b79b84-5589-4ea2-b55e-0d8069176ba2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:00.006151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9b79b84-5589-4ea2-b55e-0d8069176ba2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:00.006591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c9b79b84-5589-4ea2-b55e-0d8069176ba2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:00.008046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9fe2f57a-648a-45ab-aeb8-ff80bdc539d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:00.009560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9fe2f57a-648a-45ab-aeb8-ff80bdc539d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:00.010727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9fe2f57a-648a-45ab-aeb8-ff80bdc539d3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149136 May 12 07:16:00.011316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1119/2321] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:15:59 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:00.131290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c9b79b84-5589-4ea2-b55e-0d8069176ba2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:00.140107 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c9b79b84-5589-4ea2-b55e-0d8069176ba2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146046 May 12 07:16:00.140675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1203/2322] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:15:59 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:00.316170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-63da1066-11f7-4224-9ea2-55aae5085b8e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:00.316849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-63da1066-11f7-4224-9ea2-55aae5085b8e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:00.322681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63da1066-11f7-4224-9ea2-55aae5085b8e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:00.323641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63da1066-11f7-4224-9ea2-55aae5085b8e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:00.324438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63da1066-11f7-4224-9ea2-55aae5085b8e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:00.324885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63da1066-11f7-4224-9ea2-55aae5085b8e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:00.387589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-63da1066-11f7-4224-9ea2-55aae5085b8e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:00.395534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-63da1066-11f7-4224-9ea2-55aae5085b8e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083380 May 12 07:16:00.396135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1120/2323] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:00 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:01.028674 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-edfc1e90-3a88-4fcb-874d-ac48d3fc4d3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:01.029391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-edfc1e90-3a88-4fcb-874d-ac48d3fc4d3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:01.035664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edfc1e90-3a88-4fcb-874d-ac48d3fc4d3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:01.036139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edfc1e90-3a88-4fcb-874d-ac48d3fc4d3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:01.036928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edfc1e90-3a88-4fcb-874d-ac48d3fc4d3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:01.037363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edfc1e90-3a88-4fcb-874d-ac48d3fc4d3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:01.156870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3a64c9da-1693-4581-b94b-d34c6cde38a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:01.157634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3a64c9da-1693-4581-b94b-d34c6cde38a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:01.162051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-edfc1e90-3a88-4fcb-874d-ac48d3fc4d3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:01.163780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a64c9da-1693-4581-b94b-d34c6cde38a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:01.164238 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a64c9da-1693-4581-b94b-d34c6cde38a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:01.165015 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a64c9da-1693-4581-b94b-d34c6cde38a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:01.165458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3a64c9da-1693-4581-b94b-d34c6cde38a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:01.171031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-edfc1e90-3a88-4fcb-874d-ac48d3fc4d3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:01.172831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-edfc1e90-3a88-4fcb-874d-ac48d3fc4d3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:01.174005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-edfc1e90-3a88-4fcb-874d-ac48d3fc4d3b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149255 May 12 07:16:01.174583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1204/2324] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:01 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:01.289292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3a64c9da-1693-4581-b94b-d34c6cde38a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:01.297735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3a64c9da-1693-4581-b94b-d34c6cde38a7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144485 May 12 07:16:01.298299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1121/2325] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:01 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:01.413253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-027fab96-2366-438e-8088-f5f1cc285a02 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:01.413942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-027fab96-2366-438e-8088-f5f1cc285a02 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:01.420561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-027fab96-2366-438e-8088-f5f1cc285a02 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:01.421050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-027fab96-2366-438e-8088-f5f1cc285a02 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:01.421832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-027fab96-2366-438e-8088-f5f1cc285a02 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:01.422523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-027fab96-2366-438e-8088-f5f1cc285a02 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:01.485877 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-027fab96-2366-438e-8088-f5f1cc285a02 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:01.494146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-027fab96-2366-438e-8088-f5f1cc285a02 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084952 May 12 07:16:01.494666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1205/2326] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:01 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:02.192359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-044775fd-876a-4e32-967c-39845366262b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:02.193004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-044775fd-876a-4e32-967c-39845366262b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:02.199250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-044775fd-876a-4e32-967c-39845366262b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:02.199717 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-044775fd-876a-4e32-967c-39845366262b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:02.200485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-044775fd-876a-4e32-967c-39845366262b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:02.200916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-044775fd-876a-4e32-967c-39845366262b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:02.314361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e0f222f0-9836-4b9e-95fb-30c5521931f3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:02.314971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e0f222f0-9836-4b9e-95fb-30c5521931f3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:02.321162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0f222f0-9836-4b9e-95fb-30c5521931f3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:02.321607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0f222f0-9836-4b9e-95fb-30c5521931f3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:02.322371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0f222f0-9836-4b9e-95fb-30c5521931f3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:02.323437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0f222f0-9836-4b9e-95fb-30c5521931f3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:02.325457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-044775fd-876a-4e32-967c-39845366262b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:02.333612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-044775fd-876a-4e32-967c-39845366262b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:02.335100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-044775fd-876a-4e32-967c-39845366262b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:02.336277 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-044775fd-876a-4e32-967c-39845366262b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.147848 May 12 07:16:02.336841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1122/2327] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:02 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:02.448385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e0f222f0-9836-4b9e-95fb-30c5521931f3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:02.456065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e0f222f0-9836-4b9e-95fb-30c5521931f3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145533 May 12 07:16:02.456629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1206/2328] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:02 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:02.510619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0dff3e7b-f15a-4f59-947b-a852ba311e15 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:02.511391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0dff3e7b-f15a-4f59-947b-a852ba311e15 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:02.517232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dff3e7b-f15a-4f59-947b-a852ba311e15 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:02.517689 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dff3e7b-f15a-4f59-947b-a852ba311e15 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:02.518456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dff3e7b-f15a-4f59-947b-a852ba311e15 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:02.518896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0dff3e7b-f15a-4f59-947b-a852ba311e15 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:02.581162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0dff3e7b-f15a-4f59-947b-a852ba311e15 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:02.589481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0dff3e7b-f15a-4f59-947b-a852ba311e15 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083166 May 12 07:16:02.590048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1123/2329] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:02 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:03.355218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-16bddd96-e738-4a91-bb06-ed643cb659bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:03.355796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-16bddd96-e738-4a91-bb06-ed643cb659bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:03.362101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16bddd96-e738-4a91-bb06-ed643cb659bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:03.362553 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16bddd96-e738-4a91-bb06-ed643cb659bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:03.363320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16bddd96-e738-4a91-bb06-ed643cb659bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:03.363789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16bddd96-e738-4a91-bb06-ed643cb659bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:03.472797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dc3cfc1c-ca1f-4207-9257-dcbf12b75b33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:03.473420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dc3cfc1c-ca1f-4207-9257-dcbf12b75b33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:03.480248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc3cfc1c-ca1f-4207-9257-dcbf12b75b33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:03.480706 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc3cfc1c-ca1f-4207-9257-dcbf12b75b33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:03.481479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc3cfc1c-ca1f-4207-9257-dcbf12b75b33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:03.481923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dc3cfc1c-ca1f-4207-9257-dcbf12b75b33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:03.487434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-16bddd96-e738-4a91-bb06-ed643cb659bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:03.496382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-16bddd96-e738-4a91-bb06-ed643cb659bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:03.497882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-16bddd96-e738-4a91-bb06-ed643cb659bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:03.499042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-16bddd96-e738-4a91-bb06-ed643cb659bf tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.148299 May 12 07:16:03.499603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1207/2330] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:03 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:03.608821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e3d5ef5e-094b-40a2-972f-b347843110dc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:03.609240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dc3cfc1c-ca1f-4207-9257-dcbf12b75b33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:03.609456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e3d5ef5e-094b-40a2-972f-b347843110dc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:03.615787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3d5ef5e-094b-40a2-972f-b347843110dc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:03.616235 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3d5ef5e-094b-40a2-972f-b347843110dc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:03.617020 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3d5ef5e-094b-40a2-972f-b347843110dc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:03.617214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dc3cfc1c-ca1f-4207-9257-dcbf12b75b33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148253 May 12 07:16:03.617473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3d5ef5e-094b-40a2-972f-b347843110dc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:03.617795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1124/2331] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:03 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:03.681844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e3d5ef5e-094b-40a2-972f-b347843110dc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:03.689734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e3d5ef5e-094b-40a2-972f-b347843110dc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.087358 May 12 07:16:03.690300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1208/2332] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:03 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:04.517781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-599715d8-1e97-4820-a3d6-47f3b21e6108 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:04.518404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-599715d8-1e97-4820-a3d6-47f3b21e6108 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:04.524676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-599715d8-1e97-4820-a3d6-47f3b21e6108 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:04.525128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-599715d8-1e97-4820-a3d6-47f3b21e6108 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:04.525925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-599715d8-1e97-4820-a3d6-47f3b21e6108 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:04.526364 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-599715d8-1e97-4820-a3d6-47f3b21e6108 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:04.634675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2a36a1b0-2a52-43d5-9381-e7116aa8ab54 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:04.636017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2a36a1b0-2a52-43d5-9381-e7116aa8ab54 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:04.642685 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a36a1b0-2a52-43d5-9381-e7116aa8ab54 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:04.642849 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a36a1b0-2a52-43d5-9381-e7116aa8ab54 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:04.643600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a36a1b0-2a52-43d5-9381-e7116aa8ab54 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:04.644057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2a36a1b0-2a52-43d5-9381-e7116aa8ab54 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:04.652607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-599715d8-1e97-4820-a3d6-47f3b21e6108 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:04.661147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-599715d8-1e97-4820-a3d6-47f3b21e6108 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:04.662877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-599715d8-1e97-4820-a3d6-47f3b21e6108 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:04.664074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-599715d8-1e97-4820-a3d6-47f3b21e6108 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.150193 May 12 07:16:04.666019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1125/2333] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:04 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:04.706452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c1a30ee7-2019-4a17-83b6-57370ca793ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:04.707067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c1a30ee7-2019-4a17-83b6-57370ca793ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:04.713117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1a30ee7-2019-4a17-83b6-57370ca793ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:04.713662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1a30ee7-2019-4a17-83b6-57370ca793ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:04.714420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1a30ee7-2019-4a17-83b6-57370ca793ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:04.714858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c1a30ee7-2019-4a17-83b6-57370ca793ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:04.784843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c1a30ee7-2019-4a17-83b6-57370ca793ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:04.793440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c1a30ee7-2019-4a17-83b6-57370ca793ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.090903 May 12 07:16:04.794019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1126/2334] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:04 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:04.798545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2a36a1b0-2a52-43d5-9381-e7116aa8ab54 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:04.806275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2a36a1b0-2a52-43d5-9381-e7116aa8ab54 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.175467 May 12 07:16:04.811997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1209/2335] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:04 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:05.682567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8c20fce2-2c55-4ad2-9dbf-2278f46e5db5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:05.683183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8c20fce2-2c55-4ad2-9dbf-2278f46e5db5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:05.689530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c20fce2-2c55-4ad2-9dbf-2278f46e5db5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:05.689982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c20fce2-2c55-4ad2-9dbf-2278f46e5db5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:05.690755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c20fce2-2c55-4ad2-9dbf-2278f46e5db5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:05.691193 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c20fce2-2c55-4ad2-9dbf-2278f46e5db5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:05.810240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dd5cc834-dd90-4337-bf81-f13f148cde0e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:05.810837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dd5cc834-dd90-4337-bf81-f13f148cde0e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:05.816793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8c20fce2-2c55-4ad2-9dbf-2278f46e5db5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:05.817156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd5cc834-dd90-4337-bf81-f13f148cde0e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:05.817608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd5cc834-dd90-4337-bf81-f13f148cde0e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:05.818761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd5cc834-dd90-4337-bf81-f13f148cde0e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:05.819202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dd5cc834-dd90-4337-bf81-f13f148cde0e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:05.825596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8c20fce2-2c55-4ad2-9dbf-2278f46e5db5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:05.827107 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8c20fce2-2c55-4ad2-9dbf-2278f46e5db5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:05.828780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8c20fce2-2c55-4ad2-9dbf-2278f46e5db5 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.149722 May 12 07:16:05.840721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1127/2336] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:05 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:05.840721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-51031d43-7a83-4836-8325-264ed376ac8b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:05.840721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-51031d43-7a83-4836-8325-264ed376ac8b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:05.841943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51031d43-7a83-4836-8325-264ed376ac8b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:05.842453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51031d43-7a83-4836-8325-264ed376ac8b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:05.843395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51031d43-7a83-4836-8325-264ed376ac8b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:05.843876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51031d43-7a83-4836-8325-264ed376ac8b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:05.883714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dd5cc834-dd90-4337-bf81-f13f148cde0e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:05.892258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dd5cc834-dd90-4337-bf81-f13f148cde0e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085810 May 12 07:16:05.892855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1210/2337] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:05 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:05.977866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-51031d43-7a83-4836-8325-264ed376ac8b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:05.986110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-51031d43-7a83-4836-8325-264ed376ac8b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.155200 May 12 07:16:05.999204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1128/2338] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:05 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:06.848033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8a0f8df1-1243-4591-b159-ece14fd3bc8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:06.848650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8a0f8df1-1243-4591-b159-ece14fd3bc8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:06.854924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a0f8df1-1243-4591-b159-ece14fd3bc8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:06.856145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a0f8df1-1243-4591-b159-ece14fd3bc8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:06.856919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a0f8df1-1243-4591-b159-ece14fd3bc8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:06.857361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a0f8df1-1243-4591-b159-ece14fd3bc8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:06.909580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-735106b5-3519-40a3-9975-59abda81c164 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:06.910329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-735106b5-3519-40a3-9975-59abda81c164 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:06.916864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-735106b5-3519-40a3-9975-59abda81c164 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:06.917412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-735106b5-3519-40a3-9975-59abda81c164 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:06.918857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-735106b5-3519-40a3-9975-59abda81c164 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:06.919309 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-735106b5-3519-40a3-9975-59abda81c164 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:06.987541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-735106b5-3519-40a3-9975-59abda81c164 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:06.997008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-735106b5-3519-40a3-9975-59abda81c164 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.091210 May 12 07:16:06.997833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1129/2339] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:06 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:07.008595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8a0f8df1-1243-4591-b159-ece14fd3bc8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:07.014389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1103a6ec-9a7d-4f47-a0a7-29f04ce1bcd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:07.015007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1103a6ec-9a7d-4f47-a0a7-29f04ce1bcd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:07.017630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8a0f8df1-1243-4591-b159-ece14fd3bc8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:07.019244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8a0f8df1-1243-4591-b159-ece14fd3bc8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:07.020361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8a0f8df1-1243-4591-b159-ece14fd3bc8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.176289 May 12 07:16:07.020809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1103a6ec-9a7d-4f47-a0a7-29f04ce1bcd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:07.020934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1211/2340] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:06 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:07.021268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1103a6ec-9a7d-4f47-a0a7-29f04ce1bcd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:07.022042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1103a6ec-9a7d-4f47-a0a7-29f04ce1bcd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:07.022483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1103a6ec-9a7d-4f47-a0a7-29f04ce1bcd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:07.151252 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1103a6ec-9a7d-4f47-a0a7-29f04ce1bcd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:07.159704 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1103a6ec-9a7d-4f47-a0a7-29f04ce1bcd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149566 May 12 07:16:07.160270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1130/2341] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:07 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:08.013684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-76f70e41-780a-49f8-9869-44dd1f752620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:08.014296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-76f70e41-780a-49f8-9869-44dd1f752620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:08.020829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76f70e41-780a-49f8-9869-44dd1f752620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:08.021274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76f70e41-780a-49f8-9869-44dd1f752620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:08.022032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76f70e41-780a-49f8-9869-44dd1f752620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:08.022465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-76f70e41-780a-49f8-9869-44dd1f752620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:08.047507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4ddcc497-f71f-4a0c-82c0-e0ca43276c8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:08.048176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4ddcc497-f71f-4a0c-82c0-e0ca43276c8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:08.054454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4ddcc497-f71f-4a0c-82c0-e0ca43276c8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:08.054911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4ddcc497-f71f-4a0c-82c0-e0ca43276c8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:08.055704 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4ddcc497-f71f-4a0c-82c0-e0ca43276c8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:08.056147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4ddcc497-f71f-4a0c-82c0-e0ca43276c8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:08.083549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-76f70e41-780a-49f8-9869-44dd1f752620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:08.091722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-76f70e41-780a-49f8-9869-44dd1f752620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081612 May 12 07:16:08.092281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1212/2342] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:08 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:08.177293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-234c1ab1-da93-4d28-8b72-e6d4127eccfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:08.177906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-234c1ab1-da93-4d28-8b72-e6d4127eccfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:08.182893 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4ddcc497-f71f-4a0c-82c0-e0ca43276c8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:08.183852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-234c1ab1-da93-4d28-8b72-e6d4127eccfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:08.184298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-234c1ab1-da93-4d28-8b72-e6d4127eccfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:08.185444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-234c1ab1-da93-4d28-8b72-e6d4127eccfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:08.185887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-234c1ab1-da93-4d28-8b72-e6d4127eccfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:08.191733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4ddcc497-f71f-4a0c-82c0-e0ca43276c8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:08.193240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4ddcc497-f71f-4a0c-82c0-e0ca43276c8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:08.194404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4ddcc497-f71f-4a0c-82c0-e0ca43276c8c tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.151800 May 12 07:16:08.195188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1131/2343] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:08 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:16:08.314444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-234c1ab1-da93-4d28-8b72-e6d4127eccfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:08.322306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-234c1ab1-da93-4d28-8b72-e6d4127eccfa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149762 May 12 07:16:08.322876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1213/2344] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:08 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:09.108352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-65e4264d-2d45-411c-bc14-9f57014c097c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:09.108974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-65e4264d-2d45-411c-bc14-9f57014c097c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:09.115300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65e4264d-2d45-411c-bc14-9f57014c097c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:09.115792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65e4264d-2d45-411c-bc14-9f57014c097c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:09.116569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65e4264d-2d45-411c-bc14-9f57014c097c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:09.117010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-65e4264d-2d45-411c-bc14-9f57014c097c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:09.177083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-65e4264d-2d45-411c-bc14-9f57014c097c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:09.184911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-65e4264d-2d45-411c-bc14-9f57014c097c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080561 May 12 07:16:09.185477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1132/2345] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:09 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:09.212576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-87a5f78c-f368-4213-a67f-d345cfb8a872 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:09.213230 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-87a5f78c-f368-4213-a67f-d345cfb8a872 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:09.221148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-87a5f78c-f368-4213-a67f-d345cfb8a872 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:09.221603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-87a5f78c-f368-4213-a67f-d345cfb8a872 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:09.222360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-87a5f78c-f368-4213-a67f-d345cfb8a872 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:09.222788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-87a5f78c-f368-4213-a67f-d345cfb8a872 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:09.340636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a7a6ed92-3291-4068-a249-8240fa85dd34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:09.341266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a7a6ed92-3291-4068-a249-8240fa85dd34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:09.347124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7a6ed92-3291-4068-a249-8240fa85dd34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:09.347582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7a6ed92-3291-4068-a249-8240fa85dd34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:09.348502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7a6ed92-3291-4068-a249-8240fa85dd34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:09.348925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7a6ed92-3291-4068-a249-8240fa85dd34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:09.350819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-87a5f78c-f368-4213-a67f-d345cfb8a872 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:09.359057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-87a5f78c-f368-4213-a67f-d345cfb8a872 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:09.360591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-87a5f78c-f368-4213-a67f-d345cfb8a872 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:09.361760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-87a5f78c-f368-4213-a67f-d345cfb8a872 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.153024 May 12 07:16:09.362315 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1214/2346] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:09 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:09.477211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a7a6ed92-3291-4068-a249-8240fa85dd34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:09.485000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a7a6ed92-3291-4068-a249-8240fa85dd34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148325 May 12 07:16:09.485565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1133/2347] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:09 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:10.201505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cbc7bf95-430e-43b3-92f1-ef83a27c14ad tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:10.202061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cbc7bf95-430e-43b3-92f1-ef83a27c14ad tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:10.207999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbc7bf95-430e-43b3-92f1-ef83a27c14ad tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:10.208446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbc7bf95-430e-43b3-92f1-ef83a27c14ad tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:10.209210 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbc7bf95-430e-43b3-92f1-ef83a27c14ad tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:10.209643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbc7bf95-430e-43b3-92f1-ef83a27c14ad tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:10.270800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cbc7bf95-430e-43b3-92f1-ef83a27c14ad tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:10.279134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cbc7bf95-430e-43b3-92f1-ef83a27c14ad tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081036 May 12 07:16:10.284212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1215/2348] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:10 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:10.380199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-eab330f6-2528-47e3-8600-9537a55a62b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:10.380817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-eab330f6-2528-47e3-8600-9537a55a62b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:10.387059 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab330f6-2528-47e3-8600-9537a55a62b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:10.387506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab330f6-2528-47e3-8600-9537a55a62b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:10.388807 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab330f6-2528-47e3-8600-9537a55a62b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:10.389247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eab330f6-2528-47e3-8600-9537a55a62b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:10.501525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5aa6d700-8fbd-4963-957a-d41d5a26c366 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:10.502146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5aa6d700-8fbd-4963-957a-d41d5a26c366 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:10.508044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa6d700-8fbd-4963-957a-d41d5a26c366 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:10.508494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa6d700-8fbd-4963-957a-d41d5a26c366 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:10.509274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa6d700-8fbd-4963-957a-d41d5a26c366 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:10.509717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa6d700-8fbd-4963-957a-d41d5a26c366 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:10.524868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eab330f6-2528-47e3-8600-9537a55a62b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:10.533720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eab330f6-2528-47e3-8600-9537a55a62b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:10.535225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eab330f6-2528-47e3-8600-9537a55a62b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:10.536420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-eab330f6-2528-47e3-8600-9537a55a62b0 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.160159 May 12 07:16:10.536989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1134/2349] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:10 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:10.636417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5aa6d700-8fbd-4963-957a-d41d5a26c366 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:10.644180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5aa6d700-8fbd-4963-957a-d41d5a26c366 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146516 May 12 07:16:10.644746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1216/2350] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:10 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:11.296308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cea5e60e-29ed-4c53-9543-205b9b9f9850 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:11.296854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cea5e60e-29ed-4c53-9543-205b9b9f9850 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:11.303037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cea5e60e-29ed-4c53-9543-205b9b9f9850 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:11.303487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cea5e60e-29ed-4c53-9543-205b9b9f9850 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:11.304287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cea5e60e-29ed-4c53-9543-205b9b9f9850 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:11.304725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cea5e60e-29ed-4c53-9543-205b9b9f9850 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:11.366752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cea5e60e-29ed-4c53-9543-205b9b9f9850 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:11.374587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cea5e60e-29ed-4c53-9543-205b9b9f9850 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082262 May 12 07:16:11.375164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1135/2351] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:11 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:11.554854 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5bac60c6-8cca-4191-a017-4b14800c8ef7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:11.555389 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5bac60c6-8cca-4191-a017-4b14800c8ef7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:11.562121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bac60c6-8cca-4191-a017-4b14800c8ef7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:11.562571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bac60c6-8cca-4191-a017-4b14800c8ef7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:11.563339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bac60c6-8cca-4191-a017-4b14800c8ef7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:11.563806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bac60c6-8cca-4191-a017-4b14800c8ef7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:11.660846 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-068cec05-64a6-4661-9ba2-497b82d2e384 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:11.661463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-068cec05-64a6-4661-9ba2-497b82d2e384 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:11.667860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-068cec05-64a6-4661-9ba2-497b82d2e384 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:11.668318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-068cec05-64a6-4661-9ba2-497b82d2e384 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:11.669083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-068cec05-64a6-4661-9ba2-497b82d2e384 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:11.669516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-068cec05-64a6-4661-9ba2-497b82d2e384 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:11.691853 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5bac60c6-8cca-4191-a017-4b14800c8ef7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:11.700046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5bac60c6-8cca-4191-a017-4b14800c8ef7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:11.702185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5bac60c6-8cca-4191-a017-4b14800c8ef7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:11.703347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5bac60c6-8cca-4191-a017-4b14800c8ef7 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.152481 May 12 07:16:11.704083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1217/2352] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:11 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:11.802559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-068cec05-64a6-4661-9ba2-497b82d2e384 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:11.811035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-068cec05-64a6-4661-9ba2-497b82d2e384 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.153982 May 12 07:16:11.811542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1136/2353] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:11 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:12.391262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b916d0d0-21db-4de9-8b30-48abf081f15a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:12.391919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b916d0d0-21db-4de9-8b30-48abf081f15a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:12.397693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b916d0d0-21db-4de9-8b30-48abf081f15a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:12.398154 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b916d0d0-21db-4de9-8b30-48abf081f15a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:12.398924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b916d0d0-21db-4de9-8b30-48abf081f15a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:12.399361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b916d0d0-21db-4de9-8b30-48abf081f15a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:12.466024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b916d0d0-21db-4de9-8b30-48abf081f15a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:12.473650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b916d0d0-21db-4de9-8b30-48abf081f15a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.086328 May 12 07:16:12.474212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1218/2354] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:12 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:12.722208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9af9b4b2-c67d-42c8-83b7-1412448e8790 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:12.722770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9af9b4b2-c67d-42c8-83b7-1412448e8790 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:12.729082 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9af9b4b2-c67d-42c8-83b7-1412448e8790 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:12.729532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9af9b4b2-c67d-42c8-83b7-1412448e8790 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:12.730288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9af9b4b2-c67d-42c8-83b7-1412448e8790 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:12.730719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9af9b4b2-c67d-42c8-83b7-1412448e8790 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:12.828764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bc466618-ba70-40a2-875e-7cc3d972fdaa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:12.829480 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bc466618-ba70-40a2-875e-7cc3d972fdaa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:12.836082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc466618-ba70-40a2-875e-7cc3d972fdaa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:12.836615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc466618-ba70-40a2-875e-7cc3d972fdaa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:12.837472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc466618-ba70-40a2-875e-7cc3d972fdaa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:12.838032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bc466618-ba70-40a2-875e-7cc3d972fdaa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:12.870311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9af9b4b2-c67d-42c8-83b7-1412448e8790 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:12.879241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9af9b4b2-c67d-42c8-83b7-1412448e8790 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:12.880790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9af9b4b2-c67d-42c8-83b7-1412448e8790 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:12.881966 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9af9b4b2-c67d-42c8-83b7-1412448e8790 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.163710 May 12 07:16:12.882732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1137/2355] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:12 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:12.963899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bc466618-ba70-40a2-875e-7cc3d972fdaa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:12.971718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bc466618-ba70-40a2-875e-7cc3d972fdaa tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147702 May 12 07:16:12.972349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1219/2356] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:12 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:13.490882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a50a6c61-f27e-4181-8758-9e4d9c919eaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:13.491493 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a50a6c61-f27e-4181-8758-9e4d9c919eaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:13.497878 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a50a6c61-f27e-4181-8758-9e4d9c919eaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:13.498328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a50a6c61-f27e-4181-8758-9e4d9c919eaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:13.499084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a50a6c61-f27e-4181-8758-9e4d9c919eaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:13.499516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a50a6c61-f27e-4181-8758-9e4d9c919eaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:13.557797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a50a6c61-f27e-4181-8758-9e4d9c919eaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:13.565913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a50a6c61-f27e-4181-8758-9e4d9c919eaa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.078856 May 12 07:16:13.566478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1138/2357] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:13 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:13.900821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-33dc6d3d-8116-44d3-96a3-f2d0d5b4881a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:13.901425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-33dc6d3d-8116-44d3-96a3-f2d0d5b4881a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:13.908421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-33dc6d3d-8116-44d3-96a3-f2d0d5b4881a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:13.908867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-33dc6d3d-8116-44d3-96a3-f2d0d5b4881a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:13.909629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-33dc6d3d-8116-44d3-96a3-f2d0d5b4881a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:13.910061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-33dc6d3d-8116-44d3-96a3-f2d0d5b4881a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:13.988639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c17ca2e1-5482-4ee5-a240-a54767eab2fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:13.989330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c17ca2e1-5482-4ee5-a240-a54767eab2fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:13.995877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c17ca2e1-5482-4ee5-a240-a54767eab2fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:13.996366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c17ca2e1-5482-4ee5-a240-a54767eab2fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:13.997711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c17ca2e1-5482-4ee5-a240-a54767eab2fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:13.998151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c17ca2e1-5482-4ee5-a240-a54767eab2fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:14.049104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-33dc6d3d-8116-44d3-96a3-f2d0d5b4881a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:14.057245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-33dc6d3d-8116-44d3-96a3-f2d0d5b4881a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:14.058731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-33dc6d3d-8116-44d3-96a3-f2d0d5b4881a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:14.060479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-33dc6d3d-8116-44d3-96a3-f2d0d5b4881a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.163023 May 12 07:16:14.061049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1220/2358] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:13 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:14.130950 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c17ca2e1-5482-4ee5-a240-a54767eab2fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:14.138633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c17ca2e1-5482-4ee5-a240-a54767eab2fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.154027 May 12 07:16:14.139195 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1139/2359] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:13 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:14.582586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-57b587e6-7429-4b70-84ad-1690eb6fd184 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:14.583196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-57b587e6-7429-4b70-84ad-1690eb6fd184 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:14.589056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57b587e6-7429-4b70-84ad-1690eb6fd184 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:14.589502 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57b587e6-7429-4b70-84ad-1690eb6fd184 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:14.590260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57b587e6-7429-4b70-84ad-1690eb6fd184 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:14.591349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-57b587e6-7429-4b70-84ad-1690eb6fd184 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:14.649713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-57b587e6-7429-4b70-84ad-1690eb6fd184 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:14.658091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-57b587e6-7429-4b70-84ad-1690eb6fd184 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079379 May 12 07:16:14.658829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1221/2360] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:14 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:15.078794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1da21663-44e0-44da-9878-c306ffd3262f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:15.079407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1da21663-44e0-44da-9878-c306ffd3262f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:15.085711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1da21663-44e0-44da-9878-c306ffd3262f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:15.086161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1da21663-44e0-44da-9878-c306ffd3262f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:15.086922 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1da21663-44e0-44da-9878-c306ffd3262f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:15.087355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1da21663-44e0-44da-9878-c306ffd3262f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:15.156022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e6c5b10f-5017-494e-9b70-95f41dc03d56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:15.156650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e6c5b10f-5017-494e-9b70-95f41dc03d56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:15.162848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6c5b10f-5017-494e-9b70-95f41dc03d56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:15.163308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6c5b10f-5017-494e-9b70-95f41dc03d56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:15.164123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6c5b10f-5017-494e-9b70-95f41dc03d56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:15.164619 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6c5b10f-5017-494e-9b70-95f41dc03d56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:15.242899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1da21663-44e0-44da-9878-c306ffd3262f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:15.251104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1da21663-44e0-44da-9878-c306ffd3262f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:15.252790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1da21663-44e0-44da-9878-c306ffd3262f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:15.253965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1da21663-44e0-44da-9878-c306ffd3262f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.179129 May 12 07:16:15.254529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1140/2361] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:15 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:15.300377 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e6c5b10f-5017-494e-9b70-95f41dc03d56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:15.308145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e6c5b10f-5017-494e-9b70-95f41dc03d56 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.156573 May 12 07:16:15.308725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1222/2362] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:15 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:15.675122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e6ba20d2-ca92-4add-bc2d-00c7c9fa4b06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:15.675656 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e6ba20d2-ca92-4add-bc2d-00c7c9fa4b06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:15.681549 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6ba20d2-ca92-4add-bc2d-00c7c9fa4b06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:15.681991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6ba20d2-ca92-4add-bc2d-00c7c9fa4b06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:15.682777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6ba20d2-ca92-4add-bc2d-00c7c9fa4b06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:15.683208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6ba20d2-ca92-4add-bc2d-00c7c9fa4b06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:15.745315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e6ba20d2-ca92-4add-bc2d-00c7c9fa4b06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:15.753595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e6ba20d2-ca92-4add-bc2d-00c7c9fa4b06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082633 May 12 07:16:15.754162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1141/2363] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:15 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:16.272460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-475aa3df-b4db-48ac-b8a1-2bb02fa2f10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:16.272998 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-475aa3df-b4db-48ac-b8a1-2bb02fa2f10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:16.279300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-475aa3df-b4db-48ac-b8a1-2bb02fa2f10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:16.279776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-475aa3df-b4db-48ac-b8a1-2bb02fa2f10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:16.280545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-475aa3df-b4db-48ac-b8a1-2bb02fa2f10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:16.280983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-475aa3df-b4db-48ac-b8a1-2bb02fa2f10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:16.325675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-29f54c27-69b4-4e29-9ab1-0a542c50b041 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:16.326284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-29f54c27-69b4-4e29-9ab1-0a542c50b041 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:16.332520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29f54c27-69b4-4e29-9ab1-0a542c50b041 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:16.332994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29f54c27-69b4-4e29-9ab1-0a542c50b041 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:16.333755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29f54c27-69b4-4e29-9ab1-0a542c50b041 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:16.334189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-29f54c27-69b4-4e29-9ab1-0a542c50b041 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:16.444735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-475aa3df-b4db-48ac-b8a1-2bb02fa2f10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:16.453153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-475aa3df-b4db-48ac-b8a1-2bb02fa2f10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:16.455055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-475aa3df-b4db-48ac-b8a1-2bb02fa2f10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:16.455856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-475aa3df-b4db-48ac-b8a1-2bb02fa2f10d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.187392 May 12 07:16:16.456633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1223/2364] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:16 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:16.486488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-29f54c27-69b4-4e29-9ab1-0a542c50b041 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:16.494288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-29f54c27-69b4-4e29-9ab1-0a542c50b041 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.172477 May 12 07:16:16.494850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1142/2365] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:16 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:16.770795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ac443d51-846b-46c8-86b0-40da26d2b1a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:16.771405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ac443d51-846b-46c8-86b0-40da26d2b1a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:16.777335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac443d51-846b-46c8-86b0-40da26d2b1a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:16.777779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac443d51-846b-46c8-86b0-40da26d2b1a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:16.779030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac443d51-846b-46c8-86b0-40da26d2b1a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:16.779463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ac443d51-846b-46c8-86b0-40da26d2b1a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:16.842631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ac443d51-846b-46c8-86b0-40da26d2b1a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:16.850240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ac443d51-846b-46c8-86b0-40da26d2b1a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083242 May 12 07:16:16.850829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1224/2366] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:16 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:17.474859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e1ef669d-a996-4460-bee9-1ddb4c611292 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:17.475416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e1ef669d-a996-4460-bee9-1ddb4c611292 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:17.481732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1ef669d-a996-4460-bee9-1ddb4c611292 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:17.482185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1ef669d-a996-4460-bee9-1ddb4c611292 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:17.482954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1ef669d-a996-4460-bee9-1ddb4c611292 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:17.483395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1ef669d-a996-4460-bee9-1ddb4c611292 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:17.510846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2dab5d9f-cad8-4bef-a2d5-bb4a3d39313b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:17.511549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2dab5d9f-cad8-4bef-a2d5-bb4a3d39313b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:17.518456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2dab5d9f-cad8-4bef-a2d5-bb4a3d39313b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:17.518905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2dab5d9f-cad8-4bef-a2d5-bb4a3d39313b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:17.519674 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2dab5d9f-cad8-4bef-a2d5-bb4a3d39313b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:17.520132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2dab5d9f-cad8-4bef-a2d5-bb4a3d39313b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:17.656783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e1ef669d-a996-4460-bee9-1ddb4c611292 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:17.665082 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e1ef669d-a996-4460-bee9-1ddb4c611292 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:17.666669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e1ef669d-a996-4460-bee9-1ddb4c611292 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:17.667860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e1ef669d-a996-4460-bee9-1ddb4c611292 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.197017 May 12 07:16:17.668412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1143/2367] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:17 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:17.678961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2dab5d9f-cad8-4bef-a2d5-bb4a3d39313b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:17.687348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2dab5d9f-cad8-4bef-a2d5-bb4a3d39313b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.180359 May 12 07:16:17.687955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1225/2368] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:17 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:17.866192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-16bcb0b8-9cf0-4d02-b780-56b6c15f3b71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:17.866817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-16bcb0b8-9cf0-4d02-b780-56b6c15f3b71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:17.875588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16bcb0b8-9cf0-4d02-b780-56b6c15f3b71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:17.876094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16bcb0b8-9cf0-4d02-b780-56b6c15f3b71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:17.876856 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16bcb0b8-9cf0-4d02-b780-56b6c15f3b71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:17.877296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16bcb0b8-9cf0-4d02-b780-56b6c15f3b71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:17.941362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-16bcb0b8-9cf0-4d02-b780-56b6c15f3b71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:17.949111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-16bcb0b8-9cf0-4d02-b780-56b6c15f3b71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.086720 May 12 07:16:17.949676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1144/2369] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:17 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:18.687316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b95b81ce-780c-4138-8a7c-915eaf4c9ef8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:18.687957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b95b81ce-780c-4138-8a7c-915eaf4c9ef8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:18.694292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b95b81ce-780c-4138-8a7c-915eaf4c9ef8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:18.694745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b95b81ce-780c-4138-8a7c-915eaf4c9ef8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:18.695515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b95b81ce-780c-4138-8a7c-915eaf4c9ef8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:18.695985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b95b81ce-780c-4138-8a7c-915eaf4c9ef8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:18.705239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c01dd8e8-1b82-443c-8103-a77d6d50bee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:18.705865 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c01dd8e8-1b82-443c-8103-a77d6d50bee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:18.712146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c01dd8e8-1b82-443c-8103-a77d6d50bee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:18.712604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c01dd8e8-1b82-443c-8103-a77d6d50bee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:18.713380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c01dd8e8-1b82-443c-8103-a77d6d50bee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:18.713822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c01dd8e8-1b82-443c-8103-a77d6d50bee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:18.885043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b95b81ce-780c-4138-8a7c-915eaf4c9ef8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:18.892169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c01dd8e8-1b82-443c-8103-a77d6d50bee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:18.894410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b95b81ce-780c-4138-8a7c-915eaf4c9ef8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:18.895984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b95b81ce-780c-4138-8a7c-915eaf4c9ef8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:18.897191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b95b81ce-780c-4138-8a7c-915eaf4c9ef8 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.214262 May 12 07:16:18.897759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1226/2370] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:18 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:18.900045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c01dd8e8-1b82-443c-8103-a77d6d50bee4 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.198567 May 12 07:16:18.900738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1145/2371] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:18 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:18.966178 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-363199bf-34e9-41f6-b87c-807343f676a6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:18.966725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-363199bf-34e9-41f6-b87c-807343f676a6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:18.972701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-363199bf-34e9-41f6-b87c-807343f676a6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:18.973157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-363199bf-34e9-41f6-b87c-807343f676a6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:18.973931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-363199bf-34e9-41f6-b87c-807343f676a6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:18.974396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-363199bf-34e9-41f6-b87c-807343f676a6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:19.037069 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-363199bf-34e9-41f6-b87c-807343f676a6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:19.045301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-363199bf-34e9-41f6-b87c-807343f676a6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082943 May 12 07:16:19.045872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1227/2372] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:18 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:19.915814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b0f57d76-d757-4e8a-87b6-bbef962423b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:19.916440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b0f57d76-d757-4e8a-87b6-bbef962423b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:19.916646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f9d61052-e8dc-44d5-847f-91b0f3b08cde tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:19.917262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f9d61052-e8dc-44d5-847f-91b0f3b08cde tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:19.923052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0f57d76-d757-4e8a-87b6-bbef962423b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:19.923508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0f57d76-d757-4e8a-87b6-bbef962423b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:19.923713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9d61052-e8dc-44d5-847f-91b0f3b08cde tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:19.924169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9d61052-e8dc-44d5-847f-91b0f3b08cde tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:19.924317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0f57d76-d757-4e8a-87b6-bbef962423b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:19.924787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b0f57d76-d757-4e8a-87b6-bbef962423b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:19.924938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9d61052-e8dc-44d5-847f-91b0f3b08cde tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:19.925377 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9d61052-e8dc-44d5-847f-91b0f3b08cde tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:20.111751 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f9d61052-e8dc-44d5-847f-91b0f3b08cde tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:20.114936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b0f57d76-d757-4e8a-87b6-bbef962423b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:20.119527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f9d61052-e8dc-44d5-847f-91b0f3b08cde tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.206706 May 12 07:16:20.120138 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1228/2373] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:19 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:20.123497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b0f57d76-d757-4e8a-87b6-bbef962423b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:20.124483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2efc2124-0c20-431b-a97d-59ad298cff5e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:20.125041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b0f57d76-d757-4e8a-87b6-bbef962423b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:20.125175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2efc2124-0c20-431b-a97d-59ad298cff5e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:20.126198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b0f57d76-d757-4e8a-87b6-bbef962423b3 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.214471 May 12 07:16:20.126934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1146/2374] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:19 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:20.130897 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2efc2124-0c20-431b-a97d-59ad298cff5e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:20.131349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2efc2124-0c20-431b-a97d-59ad298cff5e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:20.132151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2efc2124-0c20-431b-a97d-59ad298cff5e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:20.132595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2efc2124-0c20-431b-a97d-59ad298cff5e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:20.193355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2efc2124-0c20-431b-a97d-59ad298cff5e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:20.201862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2efc2124-0c20-431b-a97d-59ad298cff5e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080793 May 12 07:16:20.202431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1229/2375] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:20 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:21.137029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b3077571-f355-4897-b397-17dcc62e45ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:21.137646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b3077571-f355-4897-b397-17dcc62e45ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:21.144740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8b051b4e-b6b7-46f7-8690-2661f9959d9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:21.145172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3077571-f355-4897-b397-17dcc62e45ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:21.145172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3077571-f355-4897-b397-17dcc62e45ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:21.145462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8b051b4e-b6b7-46f7-8690-2661f9959d9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:21.145948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3077571-f355-4897-b397-17dcc62e45ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:21.146385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3077571-f355-4897-b397-17dcc62e45ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:21.151567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b051b4e-b6b7-46f7-8690-2661f9959d9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:21.152074 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b051b4e-b6b7-46f7-8690-2661f9959d9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:21.152862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b051b4e-b6b7-46f7-8690-2661f9959d9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:21.153295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b051b4e-b6b7-46f7-8690-2661f9959d9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:21.332109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b3077571-f355-4897-b397-17dcc62e45ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:21.335174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8b051b4e-b6b7-46f7-8690-2661f9959d9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:21.340032 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b3077571-f355-4897-b397-17dcc62e45ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.206813 May 12 07:16:21.340776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1147/2376] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:21 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:21.343599 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8b051b4e-b6b7-46f7-8690-2661f9959d9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:21.345152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8b051b4e-b6b7-46f7-8690-2661f9959d9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:21.345282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c37c094d-29b1-46ed-be95-1b4e1a732e83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:21.345903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c37c094d-29b1-46ed-be95-1b4e1a732e83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:21.346322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8b051b4e-b6b7-46f7-8690-2661f9959d9b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.205465 May 12 07:16:21.347047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1230/2377] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:21 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:21.351813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c37c094d-29b1-46ed-be95-1b4e1a732e83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:21.352273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c37c094d-29b1-46ed-be95-1b4e1a732e83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:21.353043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c37c094d-29b1-46ed-be95-1b4e1a732e83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:21.353482 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c37c094d-29b1-46ed-be95-1b4e1a732e83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:21.413012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c37c094d-29b1-46ed-be95-1b4e1a732e83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:21.421259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c37c094d-29b1-46ed-be95-1b4e1a732e83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079564 May 12 07:16:21.421830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1148/2378] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:21 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:22.357518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d1bdfac2-7245-4f52-be0c-290f741927e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:22.358048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d1bdfac2-7245-4f52-be0c-290f741927e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:22.364432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d1bdfac2-7245-4f52-be0c-290f741927e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:22.364887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d1bdfac2-7245-4f52-be0c-290f741927e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:22.365401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8892e28a-d1db-4892-bd23-2c0debf04692 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:22.365806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d1bdfac2-7245-4f52-be0c-290f741927e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:22.366016 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8892e28a-d1db-4892-bd23-2c0debf04692 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:22.366136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d1bdfac2-7245-4f52-be0c-290f741927e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:22.372216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8892e28a-d1db-4892-bd23-2c0debf04692 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:22.373154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8892e28a-d1db-4892-bd23-2c0debf04692 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:22.373918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8892e28a-d1db-4892-bd23-2c0debf04692 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:22.374351 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8892e28a-d1db-4892-bd23-2c0debf04692 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:22.550483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d1bdfac2-7245-4f52-be0c-290f741927e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:22.553164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8892e28a-d1db-4892-bd23-2c0debf04692 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:22.558411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d1bdfac2-7245-4f52-be0c-290f741927e3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.204834 May 12 07:16:22.558990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1231/2379] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:22 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:22.562268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8892e28a-d1db-4892-bd23-2c0debf04692 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:22.563901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1df4ebb4-54f8-4ca6-9476-5cc88fc52d82 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:22.564040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8892e28a-d1db-4892-bd23-2c0debf04692 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:22.564515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1df4ebb4-54f8-4ca6-9476-5cc88fc52d82 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:22.565055 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8892e28a-d1db-4892-bd23-2c0debf04692 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.203487 May 12 07:16:22.565765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1149/2380] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:22 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:16:22.570202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1df4ebb4-54f8-4ca6-9476-5cc88fc52d82 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:22.570660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1df4ebb4-54f8-4ca6-9476-5cc88fc52d82 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:22.571435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1df4ebb4-54f8-4ca6-9476-5cc88fc52d82 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:22.571907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1df4ebb4-54f8-4ca6-9476-5cc88fc52d82 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:22.630547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1df4ebb4-54f8-4ca6-9476-5cc88fc52d82 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:22.638873 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1df4ebb4-54f8-4ca6-9476-5cc88fc52d82 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.078352 May 12 07:16:22.639435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1232/2381] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:22 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:23.576331 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-503c20b1-2b4c-4210-ac7b-73c70495cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:23.576955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-503c20b1-2b4c-4210-ac7b-73c70495cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:23.582815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-94a528b8-56c7-4b8b-81f1-820e8bcb1900 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:23.583384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-503c20b1-2b4c-4210-ac7b-73c70495cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:23.583500 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-94a528b8-56c7-4b8b-81f1-820e8bcb1900 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:23.583873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-503c20b1-2b4c-4210-ac7b-73c70495cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:23.584652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-503c20b1-2b4c-4210-ac7b-73c70495cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:23.585094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-503c20b1-2b4c-4210-ac7b-73c70495cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:23.589620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94a528b8-56c7-4b8b-81f1-820e8bcb1900 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:23.590065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94a528b8-56c7-4b8b-81f1-820e8bcb1900 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:23.590827 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94a528b8-56c7-4b8b-81f1-820e8bcb1900 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:23.591257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94a528b8-56c7-4b8b-81f1-820e8bcb1900 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:23.769269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-503c20b1-2b4c-4210-ac7b-73c70495cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:23.773122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-94a528b8-56c7-4b8b-81f1-820e8bcb1900 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:23.777107 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-503c20b1-2b4c-4210-ac7b-73c70495cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.205177 May 12 07:16:23.777930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1150/2382] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:23 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:23.782073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-94a528b8-56c7-4b8b-81f1-820e8bcb1900 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:23.782746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1a1bdbc4-0290-437a-9ebe-b2374a9d9606 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:23.783358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1a1bdbc4-0290-437a-9ebe-b2374a9d9606 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:23.783546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-94a528b8-56c7-4b8b-81f1-820e8bcb1900 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:23.784789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-94a528b8-56c7-4b8b-81f1-820e8bcb1900 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.205770 May 12 07:16:23.785442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1233/2383] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:23 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:16:23.789114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a1bdbc4-0290-437a-9ebe-b2374a9d9606 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:23.789576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a1bdbc4-0290-437a-9ebe-b2374a9d9606 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:23.790374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a1bdbc4-0290-437a-9ebe-b2374a9d9606 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:23.790817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a1bdbc4-0290-437a-9ebe-b2374a9d9606 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:23.852720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1a1bdbc4-0290-437a-9ebe-b2374a9d9606 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:23.860427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1a1bdbc4-0290-437a-9ebe-b2374a9d9606 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081777 May 12 07:16:23.861010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1151/2384] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:23 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:24.794325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5a91d421-524f-4eb5-8a3a-a89c1fbf07ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:24.795505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5a91d421-524f-4eb5-8a3a-a89c1fbf07ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:24.802144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a91d421-524f-4eb5-8a3a-a89c1fbf07ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:24.802603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a91d421-524f-4eb5-8a3a-a89c1fbf07ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:24.802884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-eed4c977-077c-43b9-9783-99c6dc2e3e24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:24.803387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a91d421-524f-4eb5-8a3a-a89c1fbf07ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:24.803496 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-eed4c977-077c-43b9-9783-99c6dc2e3e24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:24.803877 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a91d421-524f-4eb5-8a3a-a89c1fbf07ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:24.809752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eed4c977-077c-43b9-9783-99c6dc2e3e24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:24.810204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eed4c977-077c-43b9-9783-99c6dc2e3e24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:24.810972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eed4c977-077c-43b9-9783-99c6dc2e3e24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:24.811419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eed4c977-077c-43b9-9783-99c6dc2e3e24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:25.225089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5a91d421-524f-4eb5-8a3a-a89c1fbf07ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:25.228823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eed4c977-077c-43b9-9783-99c6dc2e3e24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:25.232995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5a91d421-524f-4eb5-8a3a-a89c1fbf07ac tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.442499 May 12 07:16:25.233563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1234/2385] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:24 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:25.237254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eed4c977-077c-43b9-9783-99c6dc2e3e24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:25.238071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ec2d67fc-5a74-4b6c-837b-9a0507c3cb1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:25.238726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ec2d67fc-5a74-4b6c-837b-9a0507c3cb1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:25.238861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eed4c977-077c-43b9-9783-99c6dc2e3e24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:25.239941 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-eed4c977-077c-43b9-9783-99c6dc2e3e24 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1800 microversion: 2.20 time: 0.440865 May 12 07:16:25.240751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1152/2386] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:24 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1800 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:16:25.244509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec2d67fc-5a74-4b6c-837b-9a0507c3cb1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:25.244964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec2d67fc-5a74-4b6c-837b-9a0507c3cb1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:25.245734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec2d67fc-5a74-4b6c-837b-9a0507c3cb1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:25.246175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ec2d67fc-5a74-4b6c-837b-9a0507c3cb1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:25.257837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5fd56204-6d7c-491b-9acc-e9cf10a57f6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '.version_select at 0x7f89da370160>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:25.306838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ec2d67fc-5a74-4b6c-837b-9a0507c3cb1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:25.314668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ec2d67fc-5a74-4b6c-837b-9a0507c3cb1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080177 May 12 07:16:25.315233 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1235/2387] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:25 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:25.359426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5fd56204-6d7c-491b-9acc-e9cf10a57f6e tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-791570375" status: 204 len: 0 microversion: 2.20 time: 0.105180 May 12 07:16:25.360043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1153/2388] 10.222.0.25 () {60 vars in 1258 bytes} [Thu May 12 07:16:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-791570375 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 12 07:16:26.253219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d6c99605-5b52-4083-8227-12ae7280be87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:26.253836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d6c99605-5b52-4083-8227-12ae7280be87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:26.260515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c99605-5b52-4083-8227-12ae7280be87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:26.260992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c99605-5b52-4083-8227-12ae7280be87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:26.261770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c99605-5b52-4083-8227-12ae7280be87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:26.262219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c99605-5b52-4083-8227-12ae7280be87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:26.329881 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-2c40f14d-7986-45aa-aea0-44a53ea877b9 req-03f2bf7e-3e89-495d-bdd0-be926c261fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30aa8f3-ada1-42f3-bb93-081f2552b4a3", "tag": "d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:16:26.346153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-2c40f14d-7986-45aa-aea0-44a53ea877b9 req-03f2bf7e-3e89-495d-bdd0-be926c261fde service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:26.346673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-2c40f14d-7986-45aa-aea0-44a53ea877b9 req-03f2bf7e-3e89-495d-bdd0-be926c261fde service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:26.362119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-2c40f14d-7986-45aa-aea0-44a53ea877b9 req-03f2bf7e-3e89-495d-bdd0-be926c261fde service nova] Creating event network-changed:d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36 for instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 on hv-cinder-76606 May 12 07:16:26.367641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-2c40f14d-7986-45aa-aea0-44a53ea877b9 req-03f2bf7e-3e89-495d-bdd0-be926c261fde service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042115 May 12 07:16:26.368582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1154/2389] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:16:26.374859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-109422d4-7bfc-464a-9e20-1885bf3a5c0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:26.375825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-109422d4-7bfc-464a-9e20-1885bf3a5c0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:26.388243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-109422d4-7bfc-464a-9e20-1885bf3a5c0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:26.389525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-109422d4-7bfc-464a-9e20-1885bf3a5c0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:26.391370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-109422d4-7bfc-464a-9e20-1885bf3a5c0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:26.392769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-109422d4-7bfc-464a-9e20-1885bf3a5c0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:26.460265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d6c99605-5b52-4083-8227-12ae7280be87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:26.469781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d6c99605-5b52-4083-8227-12ae7280be87 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.220394 May 12 07:16:26.470367 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1236/2390] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:26 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:26.503406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9b6e01df-61ef-4796-a80b-386ea520d4fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Action: 'create', calling method: .version_select at 0x7f89da2e3160>, body: {"keypair": {"name": "tempest-keypair-1939324226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZJy+5DmGlPX0cvUlCB3pc8JGsoBI1uF4ExYRaL3SgpUhAPizMrn5bP46dTN/Z++0u9AXyxrU+rUPcolokB9muN8fYu071snPNTHUezVXyJDQ5/iO9uRzPpvSUsiQCZ2A=="}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:16:26.512621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-109422d4-7bfc-464a-9e20-1885bf3a5c0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:26.526178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-109422d4-7bfc-464a-9e20-1885bf3a5c0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.156172 May 12 07:16:26.528292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1155/2391] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:26 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:26.529412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-9b6e01df-61ef-4796-a80b-386ea520d4fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Getting quotas for project d3c6164700aa4d2a87819ad713a5fa37. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 07:16:26.533605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-9b6e01df-61ef-4796-a80b-386ea520d4fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Getting quotas for user 4097ea09148b4093914d1c4796e05df8 and project d3c6164700aa4d2a87819ad713a5fa37. Resources: {'key_pairs'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 07:16:26.628668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9b6e01df-61ef-4796-a80b-386ea520d4fe tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.131621 May 12 07:16:26.629288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1237/2392] 10.222.0.25 () {62 vars in 1199 bytes} [Thu May 12 07:16:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 12 07:16:27.493692 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5566a11d-50ad-4be7-8ae0-7fef796ed535 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:27.494316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5566a11d-50ad-4be7-8ae0-7fef796ed535 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:27.500402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5566a11d-50ad-4be7-8ae0-7fef796ed535 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:27.500855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5566a11d-50ad-4be7-8ae0-7fef796ed535 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:27.501628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5566a11d-50ad-4be7-8ae0-7fef796ed535 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:27.502083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5566a11d-50ad-4be7-8ae0-7fef796ed535 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:27.546639 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c5e6bd17-ae20-4090-88b0-0e87a2a96d8c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:27.548045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c5e6bd17-ae20-4090-88b0-0e87a2a96d8c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:27.554099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5e6bd17-ae20-4090-88b0-0e87a2a96d8c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:27.554650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5e6bd17-ae20-4090-88b0-0e87a2a96d8c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:27.555456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5e6bd17-ae20-4090-88b0-0e87a2a96d8c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:27.556025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5e6bd17-ae20-4090-88b0-0e87a2a96d8c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:27.626593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c5e6bd17-ae20-4090-88b0-0e87a2a96d8c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:27.634430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c5e6bd17-ae20-4090-88b0-0e87a2a96d8c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.092572 May 12 07:16:27.634979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1238/2393] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:27 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:27.661118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5566a11d-50ad-4be7-8ae0-7fef796ed535 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:27.669177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5566a11d-50ad-4be7-8ae0-7fef796ed535 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.179454 May 12 07:16:27.669753 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1156/2394] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:27 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:28.617706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-ecbd89ed-ffc7-40d3-bb7e-735c0ad89ea8 req-67bc3992-b3d7-4573-8f3a-cf3781fc119e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30aa8f3-ada1-42f3-bb93-081f2552b4a3", "name": "network-vif-deleted", "tag": "d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:16:28.626171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-ecbd89ed-ffc7-40d3-bb7e-735c0ad89ea8 req-67bc3992-b3d7-4573-8f3a-cf3781fc119e service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:28.626568 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-ecbd89ed-ffc7-40d3-bb7e-735c0ad89ea8 req-67bc3992-b3d7-4573-8f3a-cf3781fc119e service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:28.637295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-ecbd89ed-ffc7-40d3-bb7e-735c0ad89ea8 req-67bc3992-b3d7-4573-8f3a-cf3781fc119e service nova] Creating event network-vif-deleted:d490ebfb-8b0d-4deb-b77d-d56f0ddd9b36 for instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 on hv-cinder-76606 May 12 07:16:28.642313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-ecbd89ed-ffc7-40d3-bb7e-735c0ad89ea8 req-67bc3992-b3d7-4573-8f3a-cf3781fc119e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028293 May 12 07:16:28.642920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1239/2395] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:16:28.651827 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bb3c0e4f-38b8-41c8-980b-26578129bd07 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:28.652455 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bb3c0e4f-38b8-41c8-980b-26578129bd07 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:28.659387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb3c0e4f-38b8-41c8-980b-26578129bd07 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:28.660708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb3c0e4f-38b8-41c8-980b-26578129bd07 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:28.660708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb3c0e4f-38b8-41c8-980b-26578129bd07 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:28.661102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb3c0e4f-38b8-41c8-980b-26578129bd07 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:28.691595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d7556a58-e6fa-426f-bac0-624867ea79ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:28.692428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d7556a58-e6fa-426f-bac0-624867ea79ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:28.700161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7556a58-e6fa-426f-bac0-624867ea79ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:28.700701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7556a58-e6fa-426f-bac0-624867ea79ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:28.701548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7556a58-e6fa-426f-bac0-624867ea79ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:28.702025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7556a58-e6fa-426f-bac0-624867ea79ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:28.745209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bb3c0e4f-38b8-41c8-980b-26578129bd07 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:28.756771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bb3c0e4f-38b8-41c8-980b-26578129bd07 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.108731 May 12 07:16:28.757601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1157/2396] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:28 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:28.845890 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d7556a58-e6fa-426f-bac0-624867ea79ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:28.856385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d7556a58-e6fa-426f-bac0-624867ea79ba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.173634 May 12 07:16:28.857133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1240/2397] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:28 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:29.433022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1963084550", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2cb2b6a-a9dd-4877-bda4-e495f18ff2a3"}], "security_groups": [{"name": "tempest-securitygroup--1970468908"}], "key_name": "tempest-keypair-1939324226", "user_data": "}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:16:29.531235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.network.neutron [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] validate_networks() for [('d2cb2b6a-a9dd-4877-bda4-e495f18ff2a3', None, None, None, None, None)] {{(pid=124024) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 07:16:29.774732 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6cea2812-f3b8-43fd-93e0-203cf1e7a1be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:29.775370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6cea2812-f3b8-43fd-93e0-203cf1e7a1be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:29.781571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cea2812-f3b8-43fd-93e0-203cf1e7a1be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:29.782016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cea2812-f3b8-43fd-93e0-203cf1e7a1be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:29.782783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cea2812-f3b8-43fd-93e0-203cf1e7a1be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:29.783209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6cea2812-f3b8-43fd-93e0-203cf1e7a1be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:29.865814 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6cea2812-f3b8-43fd-93e0-203cf1e7a1be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:29.875560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6cea2812-f3b8-43fd-93e0-203cf1e7a1be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.104878 May 12 07:16:29.876185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1241/2398] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:29 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:29.880563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cd5e4282-038c-4168-ae6b-184803abcfbf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:29.881164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cd5e4282-038c-4168-ae6b-184803abcfbf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:29.886631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd5e4282-038c-4168-ae6b-184803abcfbf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:29.887078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd5e4282-038c-4168-ae6b-184803abcfbf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:29.887870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd5e4282-038c-4168-ae6b-184803abcfbf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:29.888303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd5e4282-038c-4168-ae6b-184803abcfbf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:30.070695 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Flavor limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 07:16:30.071661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Image limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 07:16:30.072167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Flavor pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 07:16:30.072613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Image pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 07:16:30.073065 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 07:16:30.077845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cd5e4282-038c-4168-ae6b-184803abcfbf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:30.082046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:30.082500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:30.083311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:30.083777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:30.085504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cd5e4282-038c-4168-ae6b-184803abcfbf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.208409 May 12 07:16:30.086070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1242/2399] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:29 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:30.100608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Getting quotas for project d3c6164700aa4d2a87819ad713a5fa37. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 07:16:30.104494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Getting quotas for user 4097ea09148b4093914d1c4796e05df8 and project d3c6164700aa4d2a87819ad713a5fa37. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 07:16:30.116151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Going to run 1 instances... {{(pid=124024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 07:16:30.118481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 07:16:30.275176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ba80c5a0-4b00-45e7-8101-5e21de87a5ed tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.846333 May 12 07:16:30.275847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1158/2400] 10.222.0.25 () {62 vars in 1187 bytes} [Thu May 12 07:16:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 07:16:30.286566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3b159705-0286-4ce0-8d6b-8dc62664bfcb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:30.287834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3b159705-0286-4ce0-8d6b-8dc62664bfcb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:30.342235 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3b159705-0286-4ce0-8d6b-8dc62664bfcb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:30.349276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3b159705-0286-4ce0-8d6b-8dc62664bfcb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:30.350855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3b159705-0286-4ce0-8d6b-8dc62664bfcb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:30.352068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3b159705-0286-4ce0-8d6b-8dc62664bfcb tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1282 microversion: 2.20 time: 0.069469 May 12 07:16:30.352957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1243/2401] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:30 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:30.893475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8f06f039-d9dc-482c-8fa0-353490308303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:30.894096 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8f06f039-d9dc-482c-8fa0-353490308303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:30.900087 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8f06f039-d9dc-482c-8fa0-353490308303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:30.900543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8f06f039-d9dc-482c-8fa0-353490308303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:30.901331 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8f06f039-d9dc-482c-8fa0-353490308303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:30.901773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8f06f039-d9dc-482c-8fa0-353490308303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:30.966093 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8f06f039-d9dc-482c-8fa0-353490308303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:30.973925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8f06f039-d9dc-482c-8fa0-353490308303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084738 May 12 07:16:30.974494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1159/2402] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:30 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:31.102753 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aef5cdd0-cf9e-43b9-8d3c-ca0bea811ca2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:31.103449 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-aef5cdd0-cf9e-43b9-8d3c-ca0bea811ca2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:31.111174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aef5cdd0-cf9e-43b9-8d3c-ca0bea811ca2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:31.113690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aef5cdd0-cf9e-43b9-8d3c-ca0bea811ca2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:31.113690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aef5cdd0-cf9e-43b9-8d3c-ca0bea811ca2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:31.113690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aef5cdd0-cf9e-43b9-8d3c-ca0bea811ca2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:31.240511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-aef5cdd0-cf9e-43b9-8d3c-ca0bea811ca2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:31.248921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aef5cdd0-cf9e-43b9-8d3c-ca0bea811ca2 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150029 May 12 07:16:31.249496 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1244/2403] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:31 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:31.371163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-06784141-0676-45d8-b689-ea93fa7a50c1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:31.371750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-06784141-0676-45d8-b689-ea93fa7a50c1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:31.378831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-06784141-0676-45d8-b689-ea93fa7a50c1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:31.379295 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-06784141-0676-45d8-b689-ea93fa7a50c1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:31.380095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-06784141-0676-45d8-b689-ea93fa7a50c1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:31.380537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-06784141-0676-45d8-b689-ea93fa7a50c1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:31.441096 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-06784141-0676-45d8-b689-ea93fa7a50c1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:31.449086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-06784141-0676-45d8-b689-ea93fa7a50c1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:31.450591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-06784141-0676-45d8-b689-ea93fa7a50c1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:31.451715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-06784141-0676-45d8-b689-ea93fa7a50c1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1286 microversion: 2.20 time: 0.085243 May 12 07:16:31.452283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1160/2404] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:31 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:31.993180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-375d6ce8-f1c4-4619-ae9e-129b1af51555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:31.993306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-375d6ce8-f1c4-4619-ae9e-129b1af51555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:31.999037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-375d6ce8-f1c4-4619-ae9e-129b1af51555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:31.999482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-375d6ce8-f1c4-4619-ae9e-129b1af51555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:32.000304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-375d6ce8-f1c4-4619-ae9e-129b1af51555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:32.001417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-375d6ce8-f1c4-4619-ae9e-129b1af51555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:32.064102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-375d6ce8-f1c4-4619-ae9e-129b1af51555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:32.072092 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-375d6ce8-f1c4-4619-ae9e-129b1af51555 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085224 May 12 07:16:32.072658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1245/2405] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:31 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:32.265798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cdae2c87-f54a-4470-8e68-948e7f61dfd9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:32.266417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cdae2c87-f54a-4470-8e68-948e7f61dfd9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:32.272552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cdae2c87-f54a-4470-8e68-948e7f61dfd9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:32.273005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cdae2c87-f54a-4470-8e68-948e7f61dfd9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:32.273791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cdae2c87-f54a-4470-8e68-948e7f61dfd9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:32.274236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cdae2c87-f54a-4470-8e68-948e7f61dfd9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:32.407011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cdae2c87-f54a-4470-8e68-948e7f61dfd9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:32.416384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cdae2c87-f54a-4470-8e68-948e7f61dfd9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.155325 May 12 07:16:32.417523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1161/2406] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:32 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:32.469969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6155f8ae-33eb-4f49-81a8-968bdd12a710 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:32.470577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6155f8ae-33eb-4f49-81a8-968bdd12a710 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:32.476835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6155f8ae-33eb-4f49-81a8-968bdd12a710 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:32.477282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6155f8ae-33eb-4f49-81a8-968bdd12a710 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:32.478048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6155f8ae-33eb-4f49-81a8-968bdd12a710 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:32.478478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6155f8ae-33eb-4f49-81a8-968bdd12a710 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:32.539095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6155f8ae-33eb-4f49-81a8-968bdd12a710 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:32.549858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6155f8ae-33eb-4f49-81a8-968bdd12a710 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:32.551638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6155f8ae-33eb-4f49-81a8-968bdd12a710 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:32.552809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6155f8ae-33eb-4f49-81a8-968bdd12a710 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1352 microversion: 2.20 time: 0.087015 May 12 07:16:32.553559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1246/2407] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:32 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:33.089911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1777bbcf-d109-445a-bd53-95ae8f2c7928 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:33.090641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1777bbcf-d109-445a-bd53-95ae8f2c7928 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:33.101770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1777bbcf-d109-445a-bd53-95ae8f2c7928 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:33.101770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1777bbcf-d109-445a-bd53-95ae8f2c7928 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:33.101770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1777bbcf-d109-445a-bd53-95ae8f2c7928 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:33.101770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1777bbcf-d109-445a-bd53-95ae8f2c7928 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:33.162234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1777bbcf-d109-445a-bd53-95ae8f2c7928 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:33.170114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1777bbcf-d109-445a-bd53-95ae8f2c7928 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084368 May 12 07:16:33.171339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1162/2408] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:33 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:33.434206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a0ace64c-71fd-4806-b3b1-cd396dc8b51e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:33.434734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a0ace64c-71fd-4806-b3b1-cd396dc8b51e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:33.440647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0ace64c-71fd-4806-b3b1-cd396dc8b51e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:33.441104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0ace64c-71fd-4806-b3b1-cd396dc8b51e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:33.441877 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0ace64c-71fd-4806-b3b1-cd396dc8b51e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:33.442319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0ace64c-71fd-4806-b3b1-cd396dc8b51e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:33.572456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-93a3d891-e918-49d3-9a0f-351f4c6c78d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:33.573081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-93a3d891-e918-49d3-9a0f-351f4c6c78d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:33.573794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a0ace64c-71fd-4806-b3b1-cd396dc8b51e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:33.580731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93a3d891-e918-49d3-9a0f-351f4c6c78d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:33.581562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93a3d891-e918-49d3-9a0f-351f4c6c78d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:33.582755 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a0ace64c-71fd-4806-b3b1-cd396dc8b51e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.152361 May 12 07:16:33.583073 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93a3d891-e918-49d3-9a0f-351f4c6c78d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:33.583969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93a3d891-e918-49d3-9a0f-351f4c6c78d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:33.593182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1247/2409] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:33 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:33.740412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-93a3d891-e918-49d3-9a0f-351f4c6c78d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:33.749310 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-93a3d891-e918-49d3-9a0f-351f4c6c78d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:33.750974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-93a3d891-e918-49d3-9a0f-351f4c6c78d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:33.752170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-93a3d891-e918-49d3-9a0f-351f4c6c78d6 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1408 microversion: 2.20 time: 0.184458 May 12 07:16:33.752751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1163/2410] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:33 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:33.906044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-199f5351-2e9a-4ee7-ae2d-910a5501c372 req-cb174c69-f60c-4f91-8d59-2d6bb5108600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9d2e6e-f408-4987-a812-3dd0f6d0742f", "tag": "8f43fec4-b860-4fc5-9ded-48592ff90c21"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:16:33.915707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-199f5351-2e9a-4ee7-ae2d-910a5501c372 req-cb174c69-f60c-4f91-8d59-2d6bb5108600 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:33.919783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-199f5351-2e9a-4ee7-ae2d-910a5501c372 req-cb174c69-f60c-4f91-8d59-2d6bb5108600 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:33.931628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-199f5351-2e9a-4ee7-ae2d-910a5501c372 req-cb174c69-f60c-4f91-8d59-2d6bb5108600 service nova] Creating event network-changed:8f43fec4-b860-4fc5-9ded-48592ff90c21 for instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f on hv-cinder-76606 May 12 07:16:33.936603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-199f5351-2e9a-4ee7-ae2d-910a5501c372 req-cb174c69-f60c-4f91-8d59-2d6bb5108600 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034860 May 12 07:16:33.937206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1248/2411] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:16:34.188161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-933a22a1-62d8-4a83-9fe4-d5a2dd0a1e04 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:34.188837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-933a22a1-62d8-4a83-9fe4-d5a2dd0a1e04 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:34.194825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-933a22a1-62d8-4a83-9fe4-d5a2dd0a1e04 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:34.195319 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-933a22a1-62d8-4a83-9fe4-d5a2dd0a1e04 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:34.196129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-933a22a1-62d8-4a83-9fe4-d5a2dd0a1e04 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:34.196572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-933a22a1-62d8-4a83-9fe4-d5a2dd0a1e04 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:34.262148 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-933a22a1-62d8-4a83-9fe4-d5a2dd0a1e04 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:34.270779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-933a22a1-62d8-4a83-9fe4-d5a2dd0a1e04 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.086541 May 12 07:16:34.271370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1164/2412] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:34 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:34.600417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f12994f8-2c1f-4d4b-8f67-8d5b337a03d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:34.601142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f12994f8-2c1f-4d4b-8f67-8d5b337a03d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:34.607176 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f12994f8-2c1f-4d4b-8f67-8d5b337a03d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:34.607628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f12994f8-2c1f-4d4b-8f67-8d5b337a03d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:34.608424 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f12994f8-2c1f-4d4b-8f67-8d5b337a03d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:34.608861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f12994f8-2c1f-4d4b-8f67-8d5b337a03d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:34.740059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f12994f8-2c1f-4d4b-8f67-8d5b337a03d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:34.747780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f12994f8-2c1f-4d4b-8f67-8d5b337a03d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.152196 May 12 07:16:34.748344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1249/2413] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:34 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:34.770868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c6075a67-a117-483d-a3d2-c718aa5ab550 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:34.771421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c6075a67-a117-483d-a3d2-c718aa5ab550 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:34.778302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6075a67-a117-483d-a3d2-c718aa5ab550 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:34.778740 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6075a67-a117-483d-a3d2-c718aa5ab550 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:34.779574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6075a67-a117-483d-a3d2-c718aa5ab550 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:34.780001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c6075a67-a117-483d-a3d2-c718aa5ab550 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:34.907951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c6075a67-a117-483d-a3d2-c718aa5ab550 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:34.915534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c6075a67-a117-483d-a3d2-c718aa5ab550 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:34.917066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c6075a67-a117-483d-a3d2-c718aa5ab550 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:34.918168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c6075a67-a117-483d-a3d2-c718aa5ab550 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1408 microversion: 2.20 time: 0.151482 May 12 07:16:34.918731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1165/2414] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:34 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:35.288348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5aa7a4b3-588b-4ba7-96ce-6da7ee9b8ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:35.288970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5aa7a4b3-588b-4ba7-96ce-6da7ee9b8ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:35.294934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa7a4b3-588b-4ba7-96ce-6da7ee9b8ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:35.295388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa7a4b3-588b-4ba7-96ce-6da7ee9b8ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:35.296736 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa7a4b3-588b-4ba7-96ce-6da7ee9b8ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:35.297435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5aa7a4b3-588b-4ba7-96ce-6da7ee9b8ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:35.360936 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5aa7a4b3-588b-4ba7-96ce-6da7ee9b8ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:35.368649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5aa7a4b3-588b-4ba7-96ce-6da7ee9b8ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084174 May 12 07:16:35.369214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1250/2415] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:35 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:35.819663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0b138cce-c0a9-4019-89cb-e4988a8e7f0b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:35.820335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0b138cce-c0a9-4019-89cb-e4988a8e7f0b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:35.827152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b138cce-c0a9-4019-89cb-e4988a8e7f0b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:35.827621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b138cce-c0a9-4019-89cb-e4988a8e7f0b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:35.828465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b138cce-c0a9-4019-89cb-e4988a8e7f0b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:35.828896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b138cce-c0a9-4019-89cb-e4988a8e7f0b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:35.942905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8c80670b-af23-4017-a4d5-c2e31a787d5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:35.942905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8c80670b-af23-4017-a4d5-c2e31a787d5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:35.946701 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c80670b-af23-4017-a4d5-c2e31a787d5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:35.947360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c80670b-af23-4017-a4d5-c2e31a787d5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:35.948162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c80670b-af23-4017-a4d5-c2e31a787d5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:35.948797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c80670b-af23-4017-a4d5-c2e31a787d5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:35.957643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0b138cce-c0a9-4019-89cb-e4988a8e7f0b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:35.966393 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0b138cce-c0a9-4019-89cb-e4988a8e7f0b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150714 May 12 07:16:35.967106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1166/2416] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:35 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:36.086926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8c80670b-af23-4017-a4d5-c2e31a787d5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:36.094671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8c80670b-af23-4017-a4d5-c2e31a787d5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:36.096194 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8c80670b-af23-4017-a4d5-c2e31a787d5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:36.097297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8c80670b-af23-4017-a4d5-c2e31a787d5d tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1408 microversion: 2.20 time: 0.164412 May 12 07:16:36.097861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1251/2417] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:35 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:16:36.385547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a7616fc4-1bdc-46f7-9900-e7d586e11851 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:36.386168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a7616fc4-1bdc-46f7-9900-e7d586e11851 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:36.392037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7616fc4-1bdc-46f7-9900-e7d586e11851 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:36.392490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7616fc4-1bdc-46f7-9900-e7d586e11851 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:36.393260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7616fc4-1bdc-46f7-9900-e7d586e11851 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:36.393705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7616fc4-1bdc-46f7-9900-e7d586e11851 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:36.456572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a7616fc4-1bdc-46f7-9900-e7d586e11851 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:36.466207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a7616fc4-1bdc-46f7-9900-e7d586e11851 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084605 May 12 07:16:36.466774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1167/2418] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:36 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:36.984450 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e527bf59-3298-4826-b6f3-5e3976fc9893 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:36.985105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e527bf59-3298-4826-b6f3-5e3976fc9893 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:36.991600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e527bf59-3298-4826-b6f3-5e3976fc9893 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:36.992074 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e527bf59-3298-4826-b6f3-5e3976fc9893 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:36.992868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e527bf59-3298-4826-b6f3-5e3976fc9893 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:36.993301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e527bf59-3298-4826-b6f3-5e3976fc9893 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:37.114240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7c8faedf-b831-45d3-9d2b-679dba18a5ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:37.114857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7c8faedf-b831-45d3-9d2b-679dba18a5ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:37.121177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7c8faedf-b831-45d3-9d2b-679dba18a5ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:37.121632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7c8faedf-b831-45d3-9d2b-679dba18a5ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:37.122410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7c8faedf-b831-45d3-9d2b-679dba18a5ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:37.122856 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7c8faedf-b831-45d3-9d2b-679dba18a5ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:37.123257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e527bf59-3298-4826-b6f3-5e3976fc9893 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:37.131382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e527bf59-3298-4826-b6f3-5e3976fc9893 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.151417 May 12 07:16:37.132006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1252/2419] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:36 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:37.248057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7c8faedf-b831-45d3-9d2b-679dba18a5ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:37.255831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7c8faedf-b831-45d3-9d2b-679dba18a5ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:37.257361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7c8faedf-b831-45d3-9d2b-679dba18a5ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:37.258452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7c8faedf-b831-45d3-9d2b-679dba18a5ac tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1408 microversion: 2.20 time: 0.148093 May 12 07:16:37.259020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1168/2420] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:37 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:16:37.482059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b30ce8b0-0bcf-4f3f-a7a2-0a1b50b1de4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:37.482677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b30ce8b0-0bcf-4f3f-a7a2-0a1b50b1de4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:37.488720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b30ce8b0-0bcf-4f3f-a7a2-0a1b50b1de4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:37.489174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b30ce8b0-0bcf-4f3f-a7a2-0a1b50b1de4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:37.489942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b30ce8b0-0bcf-4f3f-a7a2-0a1b50b1de4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:37.490383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b30ce8b0-0bcf-4f3f-a7a2-0a1b50b1de4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:37.553170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b30ce8b0-0bcf-4f3f-a7a2-0a1b50b1de4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:37.560872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b30ce8b0-0bcf-4f3f-a7a2-0a1b50b1de4a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082695 May 12 07:16:37.561995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1253/2421] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:37 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:37.958487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-74e96fe3-6cc7-431a-83f2-b54bf3e88d1b req-39888116-f2c2-4878-bf39-490f54163611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9d2e6e-f408-4987-a812-3dd0f6d0742f", "name": "network-vif-plugged", "status": "completed", "tag": "8f43fec4-b860-4fc5-9ded-48592ff90c21"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:16:37.966558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-74e96fe3-6cc7-431a-83f2-b54bf3e88d1b req-39888116-f2c2-4878-bf39-490f54163611 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:37.967011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-74e96fe3-6cc7-431a-83f2-b54bf3e88d1b req-39888116-f2c2-4878-bf39-490f54163611 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:37.977671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-74e96fe3-6cc7-431a-83f2-b54bf3e88d1b req-39888116-f2c2-4878-bf39-490f54163611 service nova] Creating event network-vif-plugged:8f43fec4-b860-4fc5-9ded-48592ff90c21 for instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f on hv-cinder-76606 May 12 07:16:37.982596 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-74e96fe3-6cc7-431a-83f2-b54bf3e88d1b req-39888116-f2c2-4878-bf39-490f54163611 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081099 May 12 07:16:37.983898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1169/2422] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:16:38.148100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f0bbfc7d-7046-4bea-97cc-6fb8818d5811 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:38.148782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f0bbfc7d-7046-4bea-97cc-6fb8818d5811 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:38.155598 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f0bbfc7d-7046-4bea-97cc-6fb8818d5811 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:38.156064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f0bbfc7d-7046-4bea-97cc-6fb8818d5811 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:38.156822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f0bbfc7d-7046-4bea-97cc-6fb8818d5811 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:38.157262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f0bbfc7d-7046-4bea-97cc-6fb8818d5811 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:38.278634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d340cfb8-827d-4760-88d8-3c2c3e1e2b6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:38.279498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d340cfb8-827d-4760-88d8-3c2c3e1e2b6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:38.287981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f0bbfc7d-7046-4bea-97cc-6fb8818d5811 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:38.292478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d340cfb8-827d-4760-88d8-3c2c3e1e2b6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:38.292939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d340cfb8-827d-4760-88d8-3c2c3e1e2b6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:38.294031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d340cfb8-827d-4760-88d8-3c2c3e1e2b6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:38.294644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d340cfb8-827d-4760-88d8-3c2c3e1e2b6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:38.298565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f0bbfc7d-7046-4bea-97cc-6fb8818d5811 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.154257 May 12 07:16:38.299453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1254/2423] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:38 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:38.424163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d340cfb8-827d-4760-88d8-3c2c3e1e2b6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:38.431983 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d340cfb8-827d-4760-88d8-3c2c3e1e2b6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:38.434172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d340cfb8-827d-4760-88d8-3c2c3e1e2b6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:38.434594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d340cfb8-827d-4760-88d8-3c2c3e1e2b6a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1408 microversion: 2.20 time: 0.160789 May 12 07:16:38.435158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1170/2424] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:38 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:16:38.578976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d20203a8-b9de-47e0-be56-9e883f3d134d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:38.579607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d20203a8-b9de-47e0-be56-9e883f3d134d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:38.585468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d20203a8-b9de-47e0-be56-9e883f3d134d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:38.585919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d20203a8-b9de-47e0-be56-9e883f3d134d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:38.586700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d20203a8-b9de-47e0-be56-9e883f3d134d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:38.587132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d20203a8-b9de-47e0-be56-9e883f3d134d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:38.649545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d20203a8-b9de-47e0-be56-9e883f3d134d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:38.657904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d20203a8-b9de-47e0-be56-9e883f3d134d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083277 May 12 07:16:38.658412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1255/2425] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:38 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:39.315478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-874b47b9-c8ca-478b-bf49-becab6263596 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:39.316052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-874b47b9-c8ca-478b-bf49-becab6263596 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:39.322453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-874b47b9-c8ca-478b-bf49-becab6263596 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:39.322907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-874b47b9-c8ca-478b-bf49-becab6263596 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:39.323670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-874b47b9-c8ca-478b-bf49-becab6263596 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:39.324140 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-874b47b9-c8ca-478b-bf49-becab6263596 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:39.452522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e8d92406-8b0e-497d-86fc-afc218be821f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:39.453692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e8d92406-8b0e-497d-86fc-afc218be821f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:39.455236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-874b47b9-c8ca-478b-bf49-becab6263596 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:39.459794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8d92406-8b0e-497d-86fc-afc218be821f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:39.460257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8d92406-8b0e-497d-86fc-afc218be821f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:39.461037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8d92406-8b0e-497d-86fc-afc218be821f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:39.461478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8d92406-8b0e-497d-86fc-afc218be821f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:39.464303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-874b47b9-c8ca-478b-bf49-becab6263596 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.153333 May 12 07:16:39.469622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1171/2426] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:39 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:39.588069 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e8d92406-8b0e-497d-86fc-afc218be821f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:39.596258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e8d92406-8b0e-497d-86fc-afc218be821f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:39.597759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e8d92406-8b0e-497d-86fc-afc218be821f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:39.598867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e8d92406-8b0e-497d-86fc-afc218be821f tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1408 microversion: 2.20 time: 0.150451 May 12 07:16:39.599419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1256/2427] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:39 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:16:39.675224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-62dca881-5a28-45a4-8d1f-1302c4942fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:39.675876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-62dca881-5a28-45a4-8d1f-1302c4942fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:39.681802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62dca881-5a28-45a4-8d1f-1302c4942fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:39.682251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62dca881-5a28-45a4-8d1f-1302c4942fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:39.683019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62dca881-5a28-45a4-8d1f-1302c4942fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:39.683459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-62dca881-5a28-45a4-8d1f-1302c4942fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:39.747026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-62dca881-5a28-45a4-8d1f-1302c4942fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:39.755023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-62dca881-5a28-45a4-8d1f-1302c4942fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084516 May 12 07:16:39.755591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1172/2428] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:39 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:40.481449 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4f7a7ed9-3768-48ad-bf09-68e59fe5143e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:40.482063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4f7a7ed9-3768-48ad-bf09-68e59fe5143e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:40.488493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f7a7ed9-3768-48ad-bf09-68e59fe5143e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:40.488943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f7a7ed9-3768-48ad-bf09-68e59fe5143e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:40.489710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f7a7ed9-3768-48ad-bf09-68e59fe5143e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:40.490147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f7a7ed9-3768-48ad-bf09-68e59fe5143e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:40.616779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4f7a7ed9-3768-48ad-bf09-68e59fe5143e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:40.617472 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-44147e7e-a6a6-45d2-bf2d-e82ff0dbbcfd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:40.618086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-44147e7e-a6a6-45d2-bf2d-e82ff0dbbcfd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:40.624947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44147e7e-a6a6-45d2-bf2d-e82ff0dbbcfd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:40.625425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44147e7e-a6a6-45d2-bf2d-e82ff0dbbcfd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:40.626191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44147e7e-a6a6-45d2-bf2d-e82ff0dbbcfd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:40.626505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4f7a7ed9-3768-48ad-bf09-68e59fe5143e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148932 May 12 07:16:40.626633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44147e7e-a6a6-45d2-bf2d-e82ff0dbbcfd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:40.627081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1257/2429] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:40 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:40.750965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-44147e7e-a6a6-45d2-bf2d-e82ff0dbbcfd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:40.758633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-44147e7e-a6a6-45d2-bf2d-e82ff0dbbcfd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:40.760159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-44147e7e-a6a6-45d2-bf2d-e82ff0dbbcfd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:40.761313 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-44147e7e-a6a6-45d2-bf2d-e82ff0dbbcfd tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1601 microversion: 2.20 time: 0.147651 May 12 07:16:40.761874 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1173/2430] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:16:40 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:16:40.771655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2098a813-1576-476d-8867-6ffeadceed85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:40.772319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2098a813-1576-476d-8867-6ffeadceed85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:40.777911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7d759dce-036d-48d2-b90f-d55fe411b859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:40.778144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2098a813-1576-476d-8867-6ffeadceed85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:40.778403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7d759dce-036d-48d2-b90f-d55fe411b859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:40.778591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2098a813-1576-476d-8867-6ffeadceed85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:40.779351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2098a813-1576-476d-8867-6ffeadceed85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:40.779879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2098a813-1576-476d-8867-6ffeadceed85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:40.784309 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d759dce-036d-48d2-b90f-d55fe411b859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:40.784761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d759dce-036d-48d2-b90f-d55fe411b859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:40.785527 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d759dce-036d-48d2-b90f-d55fe411b859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:40.785959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7d759dce-036d-48d2-b90f-d55fe411b859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:40.851862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2098a813-1576-476d-8867-6ffeadceed85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:40.860359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2098a813-1576-476d-8867-6ffeadceed85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.092519 May 12 07:16:40.860941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1258/2431] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:40 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:40.885989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7d759dce-036d-48d2-b90f-d55fe411b859 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.111693 May 12 07:16:40.886602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1174/2432] 10.222.0.25 () {60 vars in 1315 bytes} [Thu May 12 07:16:40 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 07:16:41.040379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:16:41.044641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:16:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:16:41.643441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-36f231bf-e2bb-402d-bee1-43260c0dcf1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:41.644116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-36f231bf-e2bb-402d-bee1-43260c0dcf1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:41.650341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-36f231bf-e2bb-402d-bee1-43260c0dcf1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:41.650780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-36f231bf-e2bb-402d-bee1-43260c0dcf1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:41.651542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-36f231bf-e2bb-402d-bee1-43260c0dcf1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:41.652002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-36f231bf-e2bb-402d-bee1-43260c0dcf1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:41.868287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-36f231bf-e2bb-402d-bee1-43260c0dcf1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:41.878054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-44dd7892-ce24-4999-86ff-928586fb07a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:41.878694 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-36f231bf-e2bb-402d-bee1-43260c0dcf1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.239516 May 12 07:16:41.879291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-44dd7892-ce24-4999-86ff-928586fb07a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:41.879473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1259/2433] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:41 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:41.885537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44dd7892-ce24-4999-86ff-928586fb07a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:41.885997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44dd7892-ce24-4999-86ff-928586fb07a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:41.886782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44dd7892-ce24-4999-86ff-928586fb07a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:41.887446 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-44dd7892-ce24-4999-86ff-928586fb07a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:41.953304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-44dd7892-ce24-4999-86ff-928586fb07a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:41.962407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-44dd7892-ce24-4999-86ff-928586fb07a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.088998 May 12 07:16:41.963197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1175/2434] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:41 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:42.061725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-40f81c86-3ff7-4d1e-9c61-7124c71467ee req-90835ce7-a431-4094-a032-8795949f837d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9d2e6e-f408-4987-a812-3dd0f6d0742f", "tag": "8f43fec4-b860-4fc5-9ded-48592ff90c21"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:16:42.069572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-40f81c86-3ff7-4d1e-9c61-7124c71467ee req-90835ce7-a431-4094-a032-8795949f837d service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:42.070019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-40f81c86-3ff7-4d1e-9c61-7124c71467ee req-90835ce7-a431-4094-a032-8795949f837d service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:42.081192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-40f81c86-3ff7-4d1e-9c61-7124c71467ee req-90835ce7-a431-4094-a032-8795949f837d service nova] Creating event network-changed:8f43fec4-b860-4fc5-9ded-48592ff90c21 for instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f on hv-cinder-76606 May 12 07:16:42.086354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-40f81c86-3ff7-4d1e-9c61-7124c71467ee req-90835ce7-a431-4094-a032-8795949f837d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086000 May 12 07:16:42.086947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1260/2435] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:16:42.895763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a355f544-fcd5-4473-9490-5829dcd27b0c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:42.896427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a355f544-fcd5-4473-9490-5829dcd27b0c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:42.903449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a355f544-fcd5-4473-9490-5829dcd27b0c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:42.903964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a355f544-fcd5-4473-9490-5829dcd27b0c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:42.905249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a355f544-fcd5-4473-9490-5829dcd27b0c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:42.905691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a355f544-fcd5-4473-9490-5829dcd27b0c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:42.980480 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-48499567-2e38-4269-9176-9aa8289522a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:42.981453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-48499567-2e38-4269-9176-9aa8289522a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:42.988787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48499567-2e38-4269-9176-9aa8289522a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:42.989243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48499567-2e38-4269-9176-9aa8289522a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:42.990026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48499567-2e38-4269-9176-9aa8289522a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:42.990463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48499567-2e38-4269-9176-9aa8289522a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:43.063798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-48499567-2e38-4269-9176-9aa8289522a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:43.067111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a355f544-fcd5-4473-9490-5829dcd27b0c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:43.072250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-48499567-2e38-4269-9176-9aa8289522a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.096443 May 12 07:16:43.073024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1261/2436] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:42 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:43.082517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a355f544-fcd5-4473-9490-5829dcd27b0c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.190648 May 12 07:16:43.083091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1176/2437] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:42 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:44.089530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c0126730-9af5-4b51-aadb-a391e76bc65c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:44.090149 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c0126730-9af5-4b51-aadb-a391e76bc65c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:44.097315 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0126730-9af5-4b51-aadb-a391e76bc65c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:44.097778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0126730-9af5-4b51-aadb-a391e76bc65c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:44.098490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e50e3afe-2a06-458b-9724-2e9e28cb5ef7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:44.098928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0126730-9af5-4b51-aadb-a391e76bc65c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:44.099030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0126730-9af5-4b51-aadb-a391e76bc65c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:44.099135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e50e3afe-2a06-458b-9724-2e9e28cb5ef7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:44.105328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e50e3afe-2a06-458b-9724-2e9e28cb5ef7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:44.105771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e50e3afe-2a06-458b-9724-2e9e28cb5ef7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:44.106530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e50e3afe-2a06-458b-9724-2e9e28cb5ef7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:44.106959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e50e3afe-2a06-458b-9724-2e9e28cb5ef7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:44.186629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c0126730-9af5-4b51-aadb-a391e76bc65c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:44.194340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c0126730-9af5-4b51-aadb-a391e76bc65c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.108674 May 12 07:16:44.194923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1262/2438] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:44 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:44.252218 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e50e3afe-2a06-458b-9724-2e9e28cb5ef7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:44.259896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e50e3afe-2a06-458b-9724-2e9e28cb5ef7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.165093 May 12 07:16:44.260462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1177/2439] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:44 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:45.210962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cbbf2409-f3bb-43b4-b154-16229e8eecaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:45.211618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cbbf2409-f3bb-43b4-b154-16229e8eecaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:45.218351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbbf2409-f3bb-43b4-b154-16229e8eecaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:45.218795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbbf2409-f3bb-43b4-b154-16229e8eecaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:45.219555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbbf2409-f3bb-43b4-b154-16229e8eecaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:45.220050 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbbf2409-f3bb-43b4-b154-16229e8eecaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:45.277012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-569dce36-19ed-464c-bf0e-dcdc9fbe0210 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:45.277556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-569dce36-19ed-464c-bf0e-dcdc9fbe0210 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:45.280983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cbbf2409-f3bb-43b4-b154-16229e8eecaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:45.284470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-569dce36-19ed-464c-bf0e-dcdc9fbe0210 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:45.284915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-569dce36-19ed-464c-bf0e-dcdc9fbe0210 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:45.285676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-569dce36-19ed-464c-bf0e-dcdc9fbe0210 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:45.286106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-569dce36-19ed-464c-bf0e-dcdc9fbe0210 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:45.288829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cbbf2409-f3bb-43b4-b154-16229e8eecaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081730 May 12 07:16:45.289405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1263/2440] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:45 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:45.415452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-569dce36-19ed-464c-bf0e-dcdc9fbe0210 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:45.423420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-569dce36-19ed-464c-bf0e-dcdc9fbe0210 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150299 May 12 07:16:45.424025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1178/2441] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:45 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:46.306098 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-be49d700-9b5e-4b11-b7e0-2055c28ed19f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:46.306637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-be49d700-9b5e-4b11-b7e0-2055c28ed19f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:46.313530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be49d700-9b5e-4b11-b7e0-2055c28ed19f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:46.313974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be49d700-9b5e-4b11-b7e0-2055c28ed19f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:46.314746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be49d700-9b5e-4b11-b7e0-2055c28ed19f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:46.315177 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-be49d700-9b5e-4b11-b7e0-2055c28ed19f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:46.375259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-be49d700-9b5e-4b11-b7e0-2055c28ed19f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:46.382971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-be49d700-9b5e-4b11-b7e0-2055c28ed19f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080794 May 12 07:16:46.383540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1264/2442] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:46 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:46.440077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d099a694-c6d3-4b2c-8d33-b8b8a1a14500 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:46.440686 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d099a694-c6d3-4b2c-8d33-b8b8a1a14500 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:46.446894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d099a694-c6d3-4b2c-8d33-b8b8a1a14500 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:46.447341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d099a694-c6d3-4b2c-8d33-b8b8a1a14500 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:46.448129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d099a694-c6d3-4b2c-8d33-b8b8a1a14500 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:46.448565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d099a694-c6d3-4b2c-8d33-b8b8a1a14500 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:46.570713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d099a694-c6d3-4b2c-8d33-b8b8a1a14500 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:46.578370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d099a694-c6d3-4b2c-8d33-b8b8a1a14500 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.142082 May 12 07:16:46.578936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1179/2443] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:46 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:47.399653 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-773ebba1-9c45-4581-b3cc-3257c857188f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:47.400224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-773ebba1-9c45-4581-b3cc-3257c857188f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:47.406567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-773ebba1-9c45-4581-b3cc-3257c857188f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:47.407018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-773ebba1-9c45-4581-b3cc-3257c857188f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:47.407810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-773ebba1-9c45-4581-b3cc-3257c857188f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:47.408249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-773ebba1-9c45-4581-b3cc-3257c857188f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:47.470340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-773ebba1-9c45-4581-b3cc-3257c857188f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:47.478081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-773ebba1-9c45-4581-b3cc-3257c857188f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082326 May 12 07:16:47.478663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1265/2444] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:47 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:47.595013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a58b80cb-cb6f-45ea-b804-ab82dbb95093 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:47.595662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a58b80cb-cb6f-45ea-b804-ab82dbb95093 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:47.601944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a58b80cb-cb6f-45ea-b804-ab82dbb95093 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:47.602394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a58b80cb-cb6f-45ea-b804-ab82dbb95093 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:47.603159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a58b80cb-cb6f-45ea-b804-ab82dbb95093 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:47.603597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a58b80cb-cb6f-45ea-b804-ab82dbb95093 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:47.730504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a58b80cb-cb6f-45ea-b804-ab82dbb95093 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:47.738737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a58b80cb-cb6f-45ea-b804-ab82dbb95093 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147623 May 12 07:16:47.739309 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1180/2445] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:47 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:48.495319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2edd46d7-7ebe-4d8b-ab4f-5ff582b550b4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:48.495968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2edd46d7-7ebe-4d8b-ab4f-5ff582b550b4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:48.502460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2edd46d7-7ebe-4d8b-ab4f-5ff582b550b4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:48.502914 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2edd46d7-7ebe-4d8b-ab4f-5ff582b550b4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:48.503705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2edd46d7-7ebe-4d8b-ab4f-5ff582b550b4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:48.504155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2edd46d7-7ebe-4d8b-ab4f-5ff582b550b4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:48.565601 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2edd46d7-7ebe-4d8b-ab4f-5ff582b550b4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:48.573535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2edd46d7-7ebe-4d8b-ab4f-5ff582b550b4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082066 May 12 07:16:48.574106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1266/2446] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:48 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:48.756095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3629ad85-cc38-44c2-8ad9-589080211e2b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:48.756647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3629ad85-cc38-44c2-8ad9-589080211e2b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:48.762947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3629ad85-cc38-44c2-8ad9-589080211e2b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:48.763396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3629ad85-cc38-44c2-8ad9-589080211e2b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:48.764184 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3629ad85-cc38-44c2-8ad9-589080211e2b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:48.764623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3629ad85-cc38-44c2-8ad9-589080211e2b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:48.893220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3629ad85-cc38-44c2-8ad9-589080211e2b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:48.901005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3629ad85-cc38-44c2-8ad9-589080211e2b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148853 May 12 07:16:48.901576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1181/2447] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:48 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:49.590850 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f5537f4f-abd9-4a12-bb12-9be52f743199 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:49.591472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f5537f4f-abd9-4a12-bb12-9be52f743199 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:49.598288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5537f4f-abd9-4a12-bb12-9be52f743199 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:49.598741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5537f4f-abd9-4a12-bb12-9be52f743199 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:49.599511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5537f4f-abd9-4a12-bb12-9be52f743199 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:49.599982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f5537f4f-abd9-4a12-bb12-9be52f743199 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:49.659545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f5537f4f-abd9-4a12-bb12-9be52f743199 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:49.667223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f5537f4f-abd9-4a12-bb12-9be52f743199 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080210 May 12 07:16:49.667819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1267/2448] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:49 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:49.917675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f5153338-3ba6-4ccf-9d96-4b636df53ced tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:49.918220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f5153338-3ba6-4ccf-9d96-4b636df53ced tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:49.924847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5153338-3ba6-4ccf-9d96-4b636df53ced tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:49.925301 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5153338-3ba6-4ccf-9d96-4b636df53ced tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:49.926070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5153338-3ba6-4ccf-9d96-4b636df53ced tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:49.926512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5153338-3ba6-4ccf-9d96-4b636df53ced tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:50.053480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f5153338-3ba6-4ccf-9d96-4b636df53ced tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:50.061108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f5153338-3ba6-4ccf-9d96-4b636df53ced tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147425 May 12 07:16:50.062165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1182/2449] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:49 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:50.684540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-abac350c-33b5-4991-b859-7b4d9c2182fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:50.685151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-abac350c-33b5-4991-b859-7b4d9c2182fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:50.691987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abac350c-33b5-4991-b859-7b4d9c2182fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:50.692441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abac350c-33b5-4991-b859-7b4d9c2182fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:50.693212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abac350c-33b5-4991-b859-7b4d9c2182fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:50.693650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abac350c-33b5-4991-b859-7b4d9c2182fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:50.752865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-abac350c-33b5-4991-b859-7b4d9c2182fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:50.760535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-abac350c-33b5-4991-b859-7b4d9c2182fc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079907 May 12 07:16:50.761100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1268/2450] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:50 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:51.078471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-93f00f6a-27f1-4507-8478-66a9b5434c64 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:51.079080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-93f00f6a-27f1-4507-8478-66a9b5434c64 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:51.085398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93f00f6a-27f1-4507-8478-66a9b5434c64 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:51.085841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93f00f6a-27f1-4507-8478-66a9b5434c64 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:51.086597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93f00f6a-27f1-4507-8478-66a9b5434c64 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:51.087029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93f00f6a-27f1-4507-8478-66a9b5434c64 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:51.214293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-93f00f6a-27f1-4507-8478-66a9b5434c64 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:51.222822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-93f00f6a-27f1-4507-8478-66a9b5434c64 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148170 May 12 07:16:51.223389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1183/2451] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:51 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:51.776610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-712c060e-7dbf-4e35-b23d-baaaa356b3cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:51.777220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-712c060e-7dbf-4e35-b23d-baaaa356b3cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:51.783183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-712c060e-7dbf-4e35-b23d-baaaa356b3cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:51.783635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-712c060e-7dbf-4e35-b23d-baaaa356b3cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:51.784425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-712c060e-7dbf-4e35-b23d-baaaa356b3cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:51.784862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-712c060e-7dbf-4e35-b23d-baaaa356b3cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:51.844457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-712c060e-7dbf-4e35-b23d-baaaa356b3cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:51.852260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-712c060e-7dbf-4e35-b23d-baaaa356b3cb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079768 May 12 07:16:51.852820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1269/2452] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:51 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:52.240175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0867bf71-1386-488e-b548-2a82c03e7b1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:52.240790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0867bf71-1386-488e-b548-2a82c03e7b1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:52.247117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0867bf71-1386-488e-b548-2a82c03e7b1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:52.247576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0867bf71-1386-488e-b548-2a82c03e7b1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:52.248370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0867bf71-1386-488e-b548-2a82c03e7b1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:52.248809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0867bf71-1386-488e-b548-2a82c03e7b1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:52.375655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0867bf71-1386-488e-b548-2a82c03e7b1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:52.383475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0867bf71-1386-488e-b548-2a82c03e7b1c tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147145 May 12 07:16:52.384004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1184/2453] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:52 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:52.868791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1d164335-e6d4-4012-a545-db89b3eca03e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:52.869403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1d164335-e6d4-4012-a545-db89b3eca03e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:52.876266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d164335-e6d4-4012-a545-db89b3eca03e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:52.876719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d164335-e6d4-4012-a545-db89b3eca03e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:52.877477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d164335-e6d4-4012-a545-db89b3eca03e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:52.877909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d164335-e6d4-4012-a545-db89b3eca03e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:52.937884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1d164335-e6d4-4012-a545-db89b3eca03e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:52.946137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1d164335-e6d4-4012-a545-db89b3eca03e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081063 May 12 07:16:52.946709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1270/2454] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:52 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:53.399892 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bd5ecb57-f39d-4c32-b773-04da370319e5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:53.400508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bd5ecb57-f39d-4c32-b773-04da370319e5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:53.407253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd5ecb57-f39d-4c32-b773-04da370319e5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:53.407785 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd5ecb57-f39d-4c32-b773-04da370319e5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:53.408501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd5ecb57-f39d-4c32-b773-04da370319e5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:53.408938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bd5ecb57-f39d-4c32-b773-04da370319e5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:53.535146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bd5ecb57-f39d-4c32-b773-04da370319e5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:53.542835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bd5ecb57-f39d-4c32-b773-04da370319e5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146814 May 12 07:16:53.543415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1185/2455] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:53 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:53.962889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bd6dfd0f-d9e5-40ad-8bfb-ac8d9bcb97e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:53.963516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bd6dfd0f-d9e5-40ad-8bfb-ac8d9bcb97e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:53.969865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd6dfd0f-d9e5-40ad-8bfb-ac8d9bcb97e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:53.970321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd6dfd0f-d9e5-40ad-8bfb-ac8d9bcb97e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:53.971099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd6dfd0f-d9e5-40ad-8bfb-ac8d9bcb97e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:53.971543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd6dfd0f-d9e5-40ad-8bfb-ac8d9bcb97e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:54.031300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bd6dfd0f-d9e5-40ad-8bfb-ac8d9bcb97e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:54.039084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bd6dfd0f-d9e5-40ad-8bfb-ac8d9bcb97e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080089 May 12 07:16:54.039649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1271/2456] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:53 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:54.559355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-314b1f7d-4990-4f09-b417-a2a7428d247f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:54.559999 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-314b1f7d-4990-4f09-b417-a2a7428d247f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:54.566945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-314b1f7d-4990-4f09-b417-a2a7428d247f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:54.567397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-314b1f7d-4990-4f09-b417-a2a7428d247f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:54.568199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-314b1f7d-4990-4f09-b417-a2a7428d247f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:54.568642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-314b1f7d-4990-4f09-b417-a2a7428d247f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:54.696136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-314b1f7d-4990-4f09-b417-a2a7428d247f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:54.704057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-314b1f7d-4990-4f09-b417-a2a7428d247f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148537 May 12 07:16:54.704635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1186/2457] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:54 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:55.056032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f111f278-4d39-4cd2-bef2-25e65f76da3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:55.056647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f111f278-4d39-4cd2-bef2-25e65f76da3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:55.062916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f111f278-4d39-4cd2-bef2-25e65f76da3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:55.063368 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f111f278-4d39-4cd2-bef2-25e65f76da3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:55.064165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f111f278-4d39-4cd2-bef2-25e65f76da3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:55.064608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f111f278-4d39-4cd2-bef2-25e65f76da3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:55.126510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f111f278-4d39-4cd2-bef2-25e65f76da3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:55.134242 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f111f278-4d39-4cd2-bef2-25e65f76da3a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082120 May 12 07:16:55.134803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1272/2458] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:55 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:55.720009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-68c5e2ac-0724-466c-b343-503bf46065ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:55.720614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-68c5e2ac-0724-466c-b343-503bf46065ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:55.726898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68c5e2ac-0724-466c-b343-503bf46065ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:55.727365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68c5e2ac-0724-466c-b343-503bf46065ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:55.728150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68c5e2ac-0724-466c-b343-503bf46065ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:55.728583 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-68c5e2ac-0724-466c-b343-503bf46065ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:55.854617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-68c5e2ac-0724-466c-b343-503bf46065ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:55.862769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-68c5e2ac-0724-466c-b343-503bf46065ef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146595 May 12 07:16:55.863333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1187/2459] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:55 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:56.151316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fcf675fd-d431-4b8d-a57e-cda40c5dc2f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:56.151967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fcf675fd-d431-4b8d-a57e-cda40c5dc2f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:56.158768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcf675fd-d431-4b8d-a57e-cda40c5dc2f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:56.159221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcf675fd-d431-4b8d-a57e-cda40c5dc2f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:56.160016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcf675fd-d431-4b8d-a57e-cda40c5dc2f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:56.160473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcf675fd-d431-4b8d-a57e-cda40c5dc2f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:56.221321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fcf675fd-d431-4b8d-a57e-cda40c5dc2f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:56.230831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fcf675fd-d431-4b8d-a57e-cda40c5dc2f2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083370 May 12 07:16:56.231401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1273/2460] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:56 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:56.879477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2620f947-0818-4d4f-bd32-b94f27120205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:56.880129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2620f947-0818-4d4f-bd32-b94f27120205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:56.886713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2620f947-0818-4d4f-bd32-b94f27120205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:56.887165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2620f947-0818-4d4f-bd32-b94f27120205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:56.887965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2620f947-0818-4d4f-bd32-b94f27120205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:56.888410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2620f947-0818-4d4f-bd32-b94f27120205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:57.011951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2620f947-0818-4d4f-bd32-b94f27120205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:57.019668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2620f947-0818-4d4f-bd32-b94f27120205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144033 May 12 07:16:57.020254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1188/2461] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:56 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:57.248031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b3bfd835-ce2a-47f4-88ad-64f1f84f7847 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:57.248643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b3bfd835-ce2a-47f4-88ad-64f1f84f7847 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:57.254884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b3bfd835-ce2a-47f4-88ad-64f1f84f7847 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:57.255330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b3bfd835-ce2a-47f4-88ad-64f1f84f7847 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:57.256120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b3bfd835-ce2a-47f4-88ad-64f1f84f7847 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:57.256561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b3bfd835-ce2a-47f4-88ad-64f1f84f7847 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:57.315907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b3bfd835-ce2a-47f4-88ad-64f1f84f7847 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:57.323768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b3bfd835-ce2a-47f4-88ad-64f1f84f7847 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079523 May 12 07:16:57.324330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1274/2462] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:57 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:58.037080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2b86ba0e-7c73-42f8-bd6b-8442e65b4233 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:58.037702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2b86ba0e-7c73-42f8-bd6b-8442e65b4233 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:58.044204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b86ba0e-7c73-42f8-bd6b-8442e65b4233 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:58.044659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b86ba0e-7c73-42f8-bd6b-8442e65b4233 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:58.045428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b86ba0e-7c73-42f8-bd6b-8442e65b4233 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:58.045867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b86ba0e-7c73-42f8-bd6b-8442e65b4233 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:58.171863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2b86ba0e-7c73-42f8-bd6b-8442e65b4233 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:58.179886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2b86ba0e-7c73-42f8-bd6b-8442e65b4233 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146613 May 12 07:16:58.180462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1189/2463] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:58 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:58.341127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5a376969-a2f5-4d26-886d-a80bf18376a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:58.341793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5a376969-a2f5-4d26-886d-a80bf18376a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:58.348581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a376969-a2f5-4d26-886d-a80bf18376a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:58.349066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a376969-a2f5-4d26-886d-a80bf18376a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:58.350077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a376969-a2f5-4d26-886d-a80bf18376a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:58.350512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5a376969-a2f5-4d26-886d-a80bf18376a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:58.415433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5a376969-a2f5-4d26-886d-a80bf18376a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:58.418807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5a376969-a2f5-4d26-886d-a80bf18376a1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081527 May 12 07:16:58.419369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1275/2464] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:58 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:16:59.196806 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-34b8a8fc-2f3d-43bd-afa2-9b3e1f68ae08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:59.197415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-34b8a8fc-2f3d-43bd-afa2-9b3e1f68ae08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:59.203804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34b8a8fc-2f3d-43bd-afa2-9b3e1f68ae08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:59.204256 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34b8a8fc-2f3d-43bd-afa2-9b3e1f68ae08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:59.205010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34b8a8fc-2f3d-43bd-afa2-9b3e1f68ae08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:59.205443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-34b8a8fc-2f3d-43bd-afa2-9b3e1f68ae08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:59.332065 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-34b8a8fc-2f3d-43bd-afa2-9b3e1f68ae08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:59.339758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-34b8a8fc-2f3d-43bd-afa2-9b3e1f68ae08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146851 May 12 07:16:59.340326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1190/2465] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:59 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:16:59.436079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-021d3ed8-3de3-4bbe-ba50-9ffc9a37eb20 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:16:59.436698 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-021d3ed8-3de3-4bbe-ba50-9ffc9a37eb20 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:16:59.443254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-021d3ed8-3de3-4bbe-ba50-9ffc9a37eb20 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:59.443727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-021d3ed8-3de3-4bbe-ba50-9ffc9a37eb20 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:59.444509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-021d3ed8-3de3-4bbe-ba50-9ffc9a37eb20 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:16:59.444952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-021d3ed8-3de3-4bbe-ba50-9ffc9a37eb20 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:16:59.505074 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-021d3ed8-3de3-4bbe-ba50-9ffc9a37eb20 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:16:59.512969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-021d3ed8-3de3-4bbe-ba50-9ffc9a37eb20 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080898 May 12 07:16:59.513533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1276/2466] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:16:59 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:00.357605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4a9561bd-1502-4853-8b14-28da68f894b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:00.358129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4a9561bd-1502-4853-8b14-28da68f894b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:00.364580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a9561bd-1502-4853-8b14-28da68f894b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:00.365024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a9561bd-1502-4853-8b14-28da68f894b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:00.365792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a9561bd-1502-4853-8b14-28da68f894b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:00.366231 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a9561bd-1502-4853-8b14-28da68f894b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:00.493292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4a9561bd-1502-4853-8b14-28da68f894b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:00.501163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4a9561bd-1502-4853-8b14-28da68f894b5 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147499 May 12 07:17:00.501735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1191/2467] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:00 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:00.529848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0c949a95-ffee-4254-a38c-df35aec3cba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:00.530473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0c949a95-ffee-4254-a38c-df35aec3cba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:00.537520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c949a95-ffee-4254-a38c-df35aec3cba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:00.537973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c949a95-ffee-4254-a38c-df35aec3cba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:00.538745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c949a95-ffee-4254-a38c-df35aec3cba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:00.539181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c949a95-ffee-4254-a38c-df35aec3cba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:00.598757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0c949a95-ffee-4254-a38c-df35aec3cba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:00.606420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0c949a95-ffee-4254-a38c-df35aec3cba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080371 May 12 07:17:00.606986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1277/2468] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:00 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:01.517209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-471e28ae-f81b-45c1-8fb3-a62b201fb32f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:01.517828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-471e28ae-f81b-45c1-8fb3-a62b201fb32f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:01.523850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-471e28ae-f81b-45c1-8fb3-a62b201fb32f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:01.524306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-471e28ae-f81b-45c1-8fb3-a62b201fb32f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:01.525064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-471e28ae-f81b-45c1-8fb3-a62b201fb32f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:01.525500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-471e28ae-f81b-45c1-8fb3-a62b201fb32f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:01.622228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d3875c38-d6d5-488c-86c6-0f236ed4ee11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:01.622972 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d3875c38-d6d5-488c-86c6-0f236ed4ee11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:01.629575 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3875c38-d6d5-488c-86c6-0f236ed4ee11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:01.630034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3875c38-d6d5-488c-86c6-0f236ed4ee11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:01.630807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3875c38-d6d5-488c-86c6-0f236ed4ee11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:01.631253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d3875c38-d6d5-488c-86c6-0f236ed4ee11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:01.652453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-471e28ae-f81b-45c1-8fb3-a62b201fb32f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:01.660870 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-471e28ae-f81b-45c1-8fb3-a62b201fb32f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147497 May 12 07:17:01.661382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1192/2469] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:01 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:01.694137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d3875c38-d6d5-488c-86c6-0f236ed4ee11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:01.701964 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d3875c38-d6d5-488c-86c6-0f236ed4ee11 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083585 May 12 07:17:01.703342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1278/2470] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:01 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:02.678577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e4a79ba4-a993-4839-9f8e-1ec142c08c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:02.679195 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e4a79ba4-a993-4839-9f8e-1ec142c08c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:02.685690 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4a79ba4-a993-4839-9f8e-1ec142c08c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:02.686148 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4a79ba4-a993-4839-9f8e-1ec142c08c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:02.687523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4a79ba4-a993-4839-9f8e-1ec142c08c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:02.688017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4a79ba4-a993-4839-9f8e-1ec142c08c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:02.718982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9bdba049-b0cd-429b-874c-9bfbe64b909e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:02.719730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9bdba049-b0cd-429b-874c-9bfbe64b909e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:02.726066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9bdba049-b0cd-429b-874c-9bfbe64b909e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:02.726510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9bdba049-b0cd-429b-874c-9bfbe64b909e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:02.727281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9bdba049-b0cd-429b-874c-9bfbe64b909e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:02.727739 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9bdba049-b0cd-429b-874c-9bfbe64b909e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:02.806967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9bdba049-b0cd-429b-874c-9bfbe64b909e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:02.814713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9bdba049-b0cd-429b-874c-9bfbe64b909e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.099571 May 12 07:17:02.815292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1279/2471] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:02 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:02.835553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e4a79ba4-a993-4839-9f8e-1ec142c08c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:02.843995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e4a79ba4-a993-4839-9f8e-1ec142c08c8d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.168782 May 12 07:17:02.847091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1193/2472] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:02 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:03.832591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0a0cd1be-1d32-4983-bc91-7c4e721a95f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:03.833116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0a0cd1be-1d32-4983-bc91-7c4e721a95f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:03.839854 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0cd1be-1d32-4983-bc91-7c4e721a95f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:03.840513 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0cd1be-1d32-4983-bc91-7c4e721a95f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:03.841176 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0cd1be-1d32-4983-bc91-7c4e721a95f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:03.841609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0a0cd1be-1d32-4983-bc91-7c4e721a95f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:03.861093 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cab61f17-cf25-4b20-ac7a-012a7047b702 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:03.861695 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cab61f17-cf25-4b20-ac7a-012a7047b702 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:03.867918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cab61f17-cf25-4b20-ac7a-012a7047b702 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:03.868369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cab61f17-cf25-4b20-ac7a-012a7047b702 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:03.869128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cab61f17-cf25-4b20-ac7a-012a7047b702 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:03.869559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cab61f17-cf25-4b20-ac7a-012a7047b702 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:03.903270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0a0cd1be-1d32-4983-bc91-7c4e721a95f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:03.911324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0a0cd1be-1d32-4983-bc91-7c4e721a95f8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083595 May 12 07:17:03.911947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1280/2473] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:03 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:03.998117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cab61f17-cf25-4b20-ac7a-012a7047b702 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:04.006563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cab61f17-cf25-4b20-ac7a-012a7047b702 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149352 May 12 07:17:04.007130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1194/2474] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:03 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:04.928812 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0e64ac36-a397-4b49-8af8-80d6ffb87c4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:04.929402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0e64ac36-a397-4b49-8af8-80d6ffb87c4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:04.935665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e64ac36-a397-4b49-8af8-80d6ffb87c4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:04.936139 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e64ac36-a397-4b49-8af8-80d6ffb87c4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:04.936898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e64ac36-a397-4b49-8af8-80d6ffb87c4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:04.937330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0e64ac36-a397-4b49-8af8-80d6ffb87c4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:05.000344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0e64ac36-a397-4b49-8af8-80d6ffb87c4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:05.008195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0e64ac36-a397-4b49-8af8-80d6ffb87c4c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083238 May 12 07:17:05.008759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1281/2475] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:04 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:05.023457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c7108ccb-755a-4102-86fa-4831679fea34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:05.024166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c7108ccb-755a-4102-86fa-4831679fea34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:05.030456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7108ccb-755a-4102-86fa-4831679fea34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:05.031481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7108ccb-755a-4102-86fa-4831679fea34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:05.032292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7108ccb-755a-4102-86fa-4831679fea34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:05.032738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7108ccb-755a-4102-86fa-4831679fea34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:05.157190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c7108ccb-755a-4102-86fa-4831679fea34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:05.164886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c7108ccb-755a-4102-86fa-4831679fea34 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145307 May 12 07:17:05.165457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1195/2476] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:05 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:06.026148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-92ae6aba-dfc2-41ee-887c-01ec1b88fa05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:06.026793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-92ae6aba-dfc2-41ee-887c-01ec1b88fa05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:06.033696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92ae6aba-dfc2-41ee-887c-01ec1b88fa05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:06.034145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92ae6aba-dfc2-41ee-887c-01ec1b88fa05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:06.034911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92ae6aba-dfc2-41ee-887c-01ec1b88fa05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:06.035397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-92ae6aba-dfc2-41ee-887c-01ec1b88fa05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:06.098032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-92ae6aba-dfc2-41ee-887c-01ec1b88fa05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:06.106242 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-92ae6aba-dfc2-41ee-887c-01ec1b88fa05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084517 May 12 07:17:06.106825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1282/2477] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:06 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:06.181883 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-32035d1a-8d7f-44a2-9d67-3ff636cb5ef0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:06.182503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-32035d1a-8d7f-44a2-9d67-3ff636cb5ef0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:06.188866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32035d1a-8d7f-44a2-9d67-3ff636cb5ef0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:06.189295 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32035d1a-8d7f-44a2-9d67-3ff636cb5ef0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:06.190063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32035d1a-8d7f-44a2-9d67-3ff636cb5ef0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:06.190504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-32035d1a-8d7f-44a2-9d67-3ff636cb5ef0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:06.316280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-32035d1a-8d7f-44a2-9d67-3ff636cb5ef0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:06.324009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-32035d1a-8d7f-44a2-9d67-3ff636cb5ef0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145960 May 12 07:17:06.324577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1196/2478] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:06 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:07.122896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cf3821cd-8e1d-4ee6-be68-e7e0772e6fe6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:07.123522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cf3821cd-8e1d-4ee6-be68-e7e0772e6fe6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:07.129873 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf3821cd-8e1d-4ee6-be68-e7e0772e6fe6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:07.130328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf3821cd-8e1d-4ee6-be68-e7e0772e6fe6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:07.131102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf3821cd-8e1d-4ee6-be68-e7e0772e6fe6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:07.131546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cf3821cd-8e1d-4ee6-be68-e7e0772e6fe6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:07.191396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cf3821cd-8e1d-4ee6-be68-e7e0772e6fe6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:07.199126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cf3821cd-8e1d-4ee6-be68-e7e0772e6fe6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080134 May 12 07:17:07.199744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1283/2479] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:07 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:07.341328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-aea060d0-cc60-43cf-833e-39f210288c0d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:07.341908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-aea060d0-cc60-43cf-833e-39f210288c0d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:07.348285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aea060d0-cc60-43cf-833e-39f210288c0d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:07.348735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aea060d0-cc60-43cf-833e-39f210288c0d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:07.349528 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aea060d0-cc60-43cf-833e-39f210288c0d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:07.349961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-aea060d0-cc60-43cf-833e-39f210288c0d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:07.478217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-aea060d0-cc60-43cf-833e-39f210288c0d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:07.486024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-aea060d0-cc60-43cf-833e-39f210288c0d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148631 May 12 07:17:07.486597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1197/2480] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:07 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:08.216452 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b6cccc5e-fb7c-4ca7-a1f5-7be41fc39c59 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:08.217076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b6cccc5e-fb7c-4ca7-a1f5-7be41fc39c59 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:08.223888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6cccc5e-fb7c-4ca7-a1f5-7be41fc39c59 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:08.224344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6cccc5e-fb7c-4ca7-a1f5-7be41fc39c59 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:08.225114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6cccc5e-fb7c-4ca7-a1f5-7be41fc39c59 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:08.225554 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b6cccc5e-fb7c-4ca7-a1f5-7be41fc39c59 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:08.288871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b6cccc5e-fb7c-4ca7-a1f5-7be41fc39c59 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:08.297647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b6cccc5e-fb7c-4ca7-a1f5-7be41fc39c59 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084841 May 12 07:17:08.298543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1284/2481] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:08 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:08.503017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9fe72def-321e-4169-be56-c723aba28205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:08.507434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9fe72def-321e-4169-be56-c723aba28205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:08.510080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9fe72def-321e-4169-be56-c723aba28205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:08.510535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9fe72def-321e-4169-be56-c723aba28205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:08.511307 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9fe72def-321e-4169-be56-c723aba28205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:08.511771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9fe72def-321e-4169-be56-c723aba28205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:08.877911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9fe72def-321e-4169-be56-c723aba28205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:08.885532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9fe72def-321e-4169-be56-c723aba28205 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.386437 May 12 07:17:08.886104 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1198/2482] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:08 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:09.314363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a05eb8bf-8ee2-48c3-b6b8-c47066c07875 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:09.315086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a05eb8bf-8ee2-48c3-b6b8-c47066c07875 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:09.321413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a05eb8bf-8ee2-48c3-b6b8-c47066c07875 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:09.321864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a05eb8bf-8ee2-48c3-b6b8-c47066c07875 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:09.322635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a05eb8bf-8ee2-48c3-b6b8-c47066c07875 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:09.323072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a05eb8bf-8ee2-48c3-b6b8-c47066c07875 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:09.385141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a05eb8bf-8ee2-48c3-b6b8-c47066c07875 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:09.393663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a05eb8bf-8ee2-48c3-b6b8-c47066c07875 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083709 May 12 07:17:09.394280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1285/2483] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:09 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:09.902302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f859c5d2-b992-4a4c-8d97-396467188e62 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:09.902925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f859c5d2-b992-4a4c-8d97-396467188e62 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:09.909944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f859c5d2-b992-4a4c-8d97-396467188e62 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:09.910394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f859c5d2-b992-4a4c-8d97-396467188e62 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:09.911162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f859c5d2-b992-4a4c-8d97-396467188e62 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:09.911602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f859c5d2-b992-4a4c-8d97-396467188e62 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:10.039712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f859c5d2-b992-4a4c-8d97-396467188e62 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:10.047993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f859c5d2-b992-4a4c-8d97-396467188e62 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149510 May 12 07:17:10.048566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1199/2484] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:09 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:10.411108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ef6906c9-612d-4bd8-9620-51cd4dec4a17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:10.411722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ef6906c9-612d-4bd8-9620-51cd4dec4a17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:10.418214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef6906c9-612d-4bd8-9620-51cd4dec4a17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:10.418666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef6906c9-612d-4bd8-9620-51cd4dec4a17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:10.419425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef6906c9-612d-4bd8-9620-51cd4dec4a17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:10.419900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ef6906c9-612d-4bd8-9620-51cd4dec4a17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:10.480096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ef6906c9-612d-4bd8-9620-51cd4dec4a17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:10.487710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ef6906c9-612d-4bd8-9620-51cd4dec4a17 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081238 May 12 07:17:10.488276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1286/2485] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:10 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:11.064309 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ad2d32a2-46b4-4b6e-ba79-47f452980d26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:11.064933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ad2d32a2-46b4-4b6e-ba79-47f452980d26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:11.071280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad2d32a2-46b4-4b6e-ba79-47f452980d26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:11.071765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad2d32a2-46b4-4b6e-ba79-47f452980d26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:11.072535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad2d32a2-46b4-4b6e-ba79-47f452980d26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:11.072975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ad2d32a2-46b4-4b6e-ba79-47f452980d26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:11.196268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ad2d32a2-46b4-4b6e-ba79-47f452980d26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:11.204043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ad2d32a2-46b4-4b6e-ba79-47f452980d26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143512 May 12 07:17:11.204617 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1200/2486] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:11 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:11.504404 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0661556a-aa1f-4105-bb89-b9b7618d97e8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:11.505021 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0661556a-aa1f-4105-bb89-b9b7618d97e8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:11.511270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0661556a-aa1f-4105-bb89-b9b7618d97e8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:11.511752 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0661556a-aa1f-4105-bb89-b9b7618d97e8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:11.512529 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0661556a-aa1f-4105-bb89-b9b7618d97e8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:11.512969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0661556a-aa1f-4105-bb89-b9b7618d97e8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:11.575810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0661556a-aa1f-4105-bb89-b9b7618d97e8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:11.584084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0661556a-aa1f-4105-bb89-b9b7618d97e8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083565 May 12 07:17:11.584652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1287/2487] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:11 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:12.220923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ff961b35-7e79-4bc8-b70a-e9b9c8bfdc5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:12.221537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ff961b35-7e79-4bc8-b70a-e9b9c8bfdc5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:12.227839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff961b35-7e79-4bc8-b70a-e9b9c8bfdc5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:12.228293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff961b35-7e79-4bc8-b70a-e9b9c8bfdc5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:12.229058 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff961b35-7e79-4bc8-b70a-e9b9c8bfdc5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:12.229495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff961b35-7e79-4bc8-b70a-e9b9c8bfdc5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:12.351871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ff961b35-7e79-4bc8-b70a-e9b9c8bfdc5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:12.360861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ff961b35-7e79-4bc8-b70a-e9b9c8bfdc5d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143774 May 12 07:17:12.361464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1201/2488] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:12 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:12.600899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b8053ef6-bf2b-46dd-a711-33aa18ca5770 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:12.601413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b8053ef6-bf2b-46dd-a711-33aa18ca5770 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:12.607833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8053ef6-bf2b-46dd-a711-33aa18ca5770 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:12.608277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8053ef6-bf2b-46dd-a711-33aa18ca5770 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:12.609037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8053ef6-bf2b-46dd-a711-33aa18ca5770 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:12.609474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8053ef6-bf2b-46dd-a711-33aa18ca5770 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:12.668999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b8053ef6-bf2b-46dd-a711-33aa18ca5770 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:12.677410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b8053ef6-bf2b-46dd-a711-33aa18ca5770 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080432 May 12 07:17:12.677982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1288/2489] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:12 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:13.377799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1626f9ee-d529-4558-953b-12c75dd178bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:13.378358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1626f9ee-d529-4558-953b-12c75dd178bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:13.384747 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1626f9ee-d529-4558-953b-12c75dd178bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:13.385198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1626f9ee-d529-4558-953b-12c75dd178bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:13.385971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1626f9ee-d529-4558-953b-12c75dd178bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:13.386411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1626f9ee-d529-4558-953b-12c75dd178bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:13.512084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1626f9ee-d529-4558-953b-12c75dd178bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:13.520448 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1626f9ee-d529-4558-953b-12c75dd178bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147135 May 12 07:17:13.521017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1202/2490] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:13 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:13.693933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ab7843ab-962e-40e5-8ec1-78c71f2d5f55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:13.694482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ab7843ab-962e-40e5-8ec1-78c71f2d5f55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:13.700832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab7843ab-962e-40e5-8ec1-78c71f2d5f55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:13.701282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab7843ab-962e-40e5-8ec1-78c71f2d5f55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:13.702048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab7843ab-962e-40e5-8ec1-78c71f2d5f55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:13.702485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ab7843ab-962e-40e5-8ec1-78c71f2d5f55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:13.763857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ab7843ab-962e-40e5-8ec1-78c71f2d5f55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:13.771608 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ab7843ab-962e-40e5-8ec1-78c71f2d5f55 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081534 May 12 07:17:13.772208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1289/2491] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:13 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:14.538123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3587a9a7-463a-4642-be75-0adf36da6dd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:14.538777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3587a9a7-463a-4642-be75-0adf36da6dd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:14.545125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3587a9a7-463a-4642-be75-0adf36da6dd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:14.545585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3587a9a7-463a-4642-be75-0adf36da6dd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:14.546349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3587a9a7-463a-4642-be75-0adf36da6dd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:14.546786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3587a9a7-463a-4642-be75-0adf36da6dd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:14.672146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3587a9a7-463a-4642-be75-0adf36da6dd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:14.680173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3587a9a7-463a-4642-be75-0adf36da6dd8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145964 May 12 07:17:14.680749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1203/2492] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:14 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:14.788435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-836f5ff2-ca34-40d2-8bf6-56bf6d0ade06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:14.788991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-836f5ff2-ca34-40d2-8bf6-56bf6d0ade06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:14.795247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-836f5ff2-ca34-40d2-8bf6-56bf6d0ade06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:14.795715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-836f5ff2-ca34-40d2-8bf6-56bf6d0ade06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:14.796481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-836f5ff2-ca34-40d2-8bf6-56bf6d0ade06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:14.797159 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-836f5ff2-ca34-40d2-8bf6-56bf6d0ade06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:14.860418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-836f5ff2-ca34-40d2-8bf6-56bf6d0ade06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:14.868238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-836f5ff2-ca34-40d2-8bf6-56bf6d0ade06 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083796 May 12 07:17:14.868802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1290/2493] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:14 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:15.697095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-16e76ec7-f6a0-46c7-8869-b56e49b248fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:15.697711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-16e76ec7-f6a0-46c7-8869-b56e49b248fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:15.704040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16e76ec7-f6a0-46c7-8869-b56e49b248fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:15.704519 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16e76ec7-f6a0-46c7-8869-b56e49b248fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:15.705278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16e76ec7-f6a0-46c7-8869-b56e49b248fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:15.705711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16e76ec7-f6a0-46c7-8869-b56e49b248fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:15.831651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-16e76ec7-f6a0-46c7-8869-b56e49b248fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:15.839364 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-16e76ec7-f6a0-46c7-8869-b56e49b248fc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146107 May 12 07:17:15.839960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1204/2494] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:15 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:15.885267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dc5eafd5-5f18-43cd-b27c-4b297ebfc32f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:15.885901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dc5eafd5-5f18-43cd-b27c-4b297ebfc32f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:15.892921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc5eafd5-5f18-43cd-b27c-4b297ebfc32f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:15.893366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc5eafd5-5f18-43cd-b27c-4b297ebfc32f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:15.894131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc5eafd5-5f18-43cd-b27c-4b297ebfc32f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:15.894568 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc5eafd5-5f18-43cd-b27c-4b297ebfc32f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:15.898973 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a2b3a572-e409-4b52-b1f8-c05ce6d2d40a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:15.899469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a2b3a572-e409-4b52-b1f8-c05ce6d2d40a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:15.905270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2b3a572-e409-4b52-b1f8-c05ce6d2d40a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:15.906334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2b3a572-e409-4b52-b1f8-c05ce6d2d40a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:15.907102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2b3a572-e409-4b52-b1f8-c05ce6d2d40a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:15.908180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2b3a572-e409-4b52-b1f8-c05ce6d2d40a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:15.930783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a2b3a572-e409-4b52-b1f8-c05ce6d2d40a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f/ips" status: 200 len: 153 microversion: 2.20 time: 0.035603 May 12 07:17:15.931365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1205/2495] 10.222.0.25 () {60 vars in 1288 bytes} [Thu May 12 07:17:15 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 07:17:15.957491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dc5eafd5-5f18-43cd-b27c-4b297ebfc32f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:15.965351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dc5eafd5-5f18-43cd-b27c-4b297ebfc32f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083914 May 12 07:17:15.965911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1291/2496] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:15 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:16.856781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9e0cb4e4-557a-4980-9f6e-dbdb73cae3b8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:16.857422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9e0cb4e4-557a-4980-9f6e-dbdb73cae3b8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:16.864284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e0cb4e4-557a-4980-9f6e-dbdb73cae3b8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:16.864758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e0cb4e4-557a-4980-9f6e-dbdb73cae3b8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:16.865538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e0cb4e4-557a-4980-9f6e-dbdb73cae3b8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:16.865972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e0cb4e4-557a-4980-9f6e-dbdb73cae3b8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:16.982918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9a32fc30-503f-48ac-922f-f07d8f26150a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:16.983530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9a32fc30-503f-48ac-922f-f07d8f26150a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:16.990894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a32fc30-503f-48ac-922f-f07d8f26150a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:16.991340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a32fc30-503f-48ac-922f-f07d8f26150a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:16.993157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a32fc30-503f-48ac-922f-f07d8f26150a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:16.993335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a32fc30-503f-48ac-922f-f07d8f26150a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:16.994533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9e0cb4e4-557a-4980-9f6e-dbdb73cae3b8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:17.002365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9e0cb4e4-557a-4980-9f6e-dbdb73cae3b8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149412 May 12 07:17:17.002960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1206/2497] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:16 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:17.053896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9a32fc30-503f-48ac-922f-f07d8f26150a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:17.061605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9a32fc30-503f-48ac-922f-f07d8f26150a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082930 May 12 07:17:17.062164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1292/2498] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:16 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:18.020297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b02da381-376d-4e29-8325-4ed19a6bc34a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:18.020909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b02da381-376d-4e29-8325-4ed19a6bc34a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:18.027144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b02da381-376d-4e29-8325-4ed19a6bc34a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:18.027594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b02da381-376d-4e29-8325-4ed19a6bc34a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:18.028383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b02da381-376d-4e29-8325-4ed19a6bc34a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:18.028815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b02da381-376d-4e29-8325-4ed19a6bc34a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:18.077847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-674e4a7c-ce0e-4ad2-acb5-873df9c69c4f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:18.078457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-674e4a7c-ce0e-4ad2-acb5-873df9c69c4f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:18.085213 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-674e4a7c-ce0e-4ad2-acb5-873df9c69c4f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:18.085658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-674e4a7c-ce0e-4ad2-acb5-873df9c69c4f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:18.086437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-674e4a7c-ce0e-4ad2-acb5-873df9c69c4f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:18.086865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-674e4a7c-ce0e-4ad2-acb5-873df9c69c4f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:18.152696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-674e4a7c-ce0e-4ad2-acb5-873df9c69c4f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:18.160370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-674e4a7c-ce0e-4ad2-acb5-873df9c69c4f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.086374 May 12 07:17:18.160941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1293/2499] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:18 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:18.182637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b02da381-376d-4e29-8325-4ed19a6bc34a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:18.191000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b02da381-376d-4e29-8325-4ed19a6bc34a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.175154 May 12 07:17:18.191572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1207/2500] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:18 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:19.177999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f6ac2c67-df30-4336-9f53-a27f74e415a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:19.178615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f6ac2c67-df30-4336-9f53-a27f74e415a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:19.184954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6ac2c67-df30-4336-9f53-a27f74e415a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:19.185490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6ac2c67-df30-4336-9f53-a27f74e415a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:19.186261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6ac2c67-df30-4336-9f53-a27f74e415a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:19.186702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f6ac2c67-df30-4336-9f53-a27f74e415a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:19.207760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c00d409e-815c-4f44-91e3-4a158a500d22 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:19.208374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c00d409e-815c-4f44-91e3-4a158a500d22 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:19.214683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d409e-815c-4f44-91e3-4a158a500d22 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:19.215131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d409e-815c-4f44-91e3-4a158a500d22 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:19.215920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d409e-815c-4f44-91e3-4a158a500d22 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:19.217839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d409e-815c-4f44-91e3-4a158a500d22 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:19.248383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f6ac2c67-df30-4336-9f53-a27f74e415a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:19.256229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f6ac2c67-df30-4336-9f53-a27f74e415a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082084 May 12 07:17:19.256808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1294/2501] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:19 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:19.342474 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c00d409e-815c-4f44-91e3-4a158a500d22 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:19.350724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c00d409e-815c-4f44-91e3-4a158a500d22 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146856 May 12 07:17:19.351294 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1208/2502] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:19 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:20.273274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9179d166-a002-4cbc-8e5c-1e3acdb090fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:20.273929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9179d166-a002-4cbc-8e5c-1e3acdb090fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:20.280126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9179d166-a002-4cbc-8e5c-1e3acdb090fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:20.280584 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9179d166-a002-4cbc-8e5c-1e3acdb090fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:20.281358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9179d166-a002-4cbc-8e5c-1e3acdb090fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:20.281796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9179d166-a002-4cbc-8e5c-1e3acdb090fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:20.341658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9179d166-a002-4cbc-8e5c-1e3acdb090fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:20.349320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9179d166-a002-4cbc-8e5c-1e3acdb090fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079987 May 12 07:17:20.349888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1295/2503] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:20 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:20.367782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-993f2664-facb-4027-8b14-a7b220d3d570 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:20.368547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-993f2664-facb-4027-8b14-a7b220d3d570 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:20.375730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-993f2664-facb-4027-8b14-a7b220d3d570 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:20.376743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-993f2664-facb-4027-8b14-a7b220d3d570 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:20.377513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-993f2664-facb-4027-8b14-a7b220d3d570 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:20.377947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-993f2664-facb-4027-8b14-a7b220d3d570 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:20.505667 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-993f2664-facb-4027-8b14-a7b220d3d570 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:20.513414 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-993f2664-facb-4027-8b14-a7b220d3d570 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149826 May 12 07:17:20.513991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1209/2504] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:20 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:21.366231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2ab791f0-d47d-495a-a66f-1e4ab1ce459a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:21.366792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2ab791f0-d47d-495a-a66f-1e4ab1ce459a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:21.372798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ab791f0-d47d-495a-a66f-1e4ab1ce459a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:21.373253 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ab791f0-d47d-495a-a66f-1e4ab1ce459a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:21.374027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ab791f0-d47d-495a-a66f-1e4ab1ce459a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:21.374471 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ab791f0-d47d-495a-a66f-1e4ab1ce459a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:21.498800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2ab791f0-d47d-495a-a66f-1e4ab1ce459a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:21.506581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2ab791f0-d47d-495a-a66f-1e4ab1ce459a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.144464 May 12 07:17:21.507153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1296/2505] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:21 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:21.530632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-93d401dd-75a9-479a-937e-a4b41ef703a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:21.531247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-93d401dd-75a9-479a-937e-a4b41ef703a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:21.537908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93d401dd-75a9-479a-937e-a4b41ef703a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:21.538354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93d401dd-75a9-479a-937e-a4b41ef703a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:21.539112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93d401dd-75a9-479a-937e-a4b41ef703a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:21.539545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-93d401dd-75a9-479a-937e-a4b41ef703a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:21.668317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-93d401dd-75a9-479a-937e-a4b41ef703a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:21.677046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-93d401dd-75a9-479a-937e-a4b41ef703a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150706 May 12 07:17:21.677610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1210/2506] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:21 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:22.523599 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bf07520c-db42-43a6-93e8-ea79db7640f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:22.524270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bf07520c-db42-43a6-93e8-ea79db7640f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:22.530610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf07520c-db42-43a6-93e8-ea79db7640f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:22.531062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf07520c-db42-43a6-93e8-ea79db7640f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:22.531881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf07520c-db42-43a6-93e8-ea79db7640f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:22.532306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bf07520c-db42-43a6-93e8-ea79db7640f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:22.592171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bf07520c-db42-43a6-93e8-ea79db7640f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:22.599837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bf07520c-db42-43a6-93e8-ea79db7640f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080023 May 12 07:17:22.600401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1297/2507] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:22 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:22.694475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-09cbf567-29b3-4964-9f9d-d4a9135c3bce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:22.695196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-09cbf567-29b3-4964-9f9d-d4a9135c3bce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:22.701433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09cbf567-29b3-4964-9f9d-d4a9135c3bce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:22.701876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09cbf567-29b3-4964-9f9d-d4a9135c3bce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:22.702631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09cbf567-29b3-4964-9f9d-d4a9135c3bce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:22.703062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09cbf567-29b3-4964-9f9d-d4a9135c3bce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:22.828308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-09cbf567-29b3-4964-9f9d-d4a9135c3bce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:22.836002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-09cbf567-29b3-4964-9f9d-d4a9135c3bce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145380 May 12 07:17:22.836567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1211/2508] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:22 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:23.616508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-88d6d8ea-2294-4592-9ae0-73f8116c0a0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:23.617125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-88d6d8ea-2294-4592-9ae0-73f8116c0a0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:23.623165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88d6d8ea-2294-4592-9ae0-73f8116c0a0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:23.623607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88d6d8ea-2294-4592-9ae0-73f8116c0a0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:23.624391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88d6d8ea-2294-4592-9ae0-73f8116c0a0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:23.624826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-88d6d8ea-2294-4592-9ae0-73f8116c0a0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:23.686282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-88d6d8ea-2294-4592-9ae0-73f8116c0a0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:23.694119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-88d6d8ea-2294-4592-9ae0-73f8116c0a0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081477 May 12 07:17:23.694684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1298/2509] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:23 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:23.852290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f900fc8f-53cb-4ef3-98fc-600231071008 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:23.852904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f900fc8f-53cb-4ef3-98fc-600231071008 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:23.859484 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f900fc8f-53cb-4ef3-98fc-600231071008 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:23.859957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f900fc8f-53cb-4ef3-98fc-600231071008 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:23.860711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f900fc8f-53cb-4ef3-98fc-600231071008 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:23.861145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f900fc8f-53cb-4ef3-98fc-600231071008 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:23.988192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f900fc8f-53cb-4ef3-98fc-600231071008 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:23.996047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f900fc8f-53cb-4ef3-98fc-600231071008 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147528 May 12 07:17:23.996607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1212/2510] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:23 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:24.710457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d2631d9e-053b-4ab8-8385-2faca630592d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:24.711099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d2631d9e-053b-4ab8-8385-2faca630592d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:24.717683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2631d9e-053b-4ab8-8385-2faca630592d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:24.718161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2631d9e-053b-4ab8-8385-2faca630592d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:24.718934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2631d9e-053b-4ab8-8385-2faca630592d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:24.719376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2631d9e-053b-4ab8-8385-2faca630592d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:24.780133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d2631d9e-053b-4ab8-8385-2faca630592d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:24.788529 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d2631d9e-053b-4ab8-8385-2faca630592d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082087 May 12 07:17:24.789088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1299/2511] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:24 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:25.013518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-377151eb-30bf-46a9-b3c6-9851fa811574 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:25.014128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-377151eb-30bf-46a9-b3c6-9851fa811574 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:25.020879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-377151eb-30bf-46a9-b3c6-9851fa811574 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:25.021329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-377151eb-30bf-46a9-b3c6-9851fa811574 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:25.022088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-377151eb-30bf-46a9-b3c6-9851fa811574 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:25.022520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-377151eb-30bf-46a9-b3c6-9851fa811574 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:25.228216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-377151eb-30bf-46a9-b3c6-9851fa811574 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:25.236047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-377151eb-30bf-46a9-b3c6-9851fa811574 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.226319 May 12 07:17:25.236607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1213/2512] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:25 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:25.908907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b82ecfec-0f24-46f2-a2cf-6e74a160b198 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:25.909521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b82ecfec-0f24-46f2-a2cf-6e74a160b198 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:25.915354 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b82ecfec-0f24-46f2-a2cf-6e74a160b198 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:25.915839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b82ecfec-0f24-46f2-a2cf-6e74a160b198 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:25.916606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b82ecfec-0f24-46f2-a2cf-6e74a160b198 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:25.917036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b82ecfec-0f24-46f2-a2cf-6e74a160b198 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:25.977887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b82ecfec-0f24-46f2-a2cf-6e74a160b198 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:25.986294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b82ecfec-0f24-46f2-a2cf-6e74a160b198 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.184821 May 12 07:17:25.986892 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1300/2513] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:25 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:26.364346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0570e148-a160-4d06-ad7e-92803d299e5f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:26.364961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0570e148-a160-4d06-ad7e-92803d299e5f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:26.370768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0570e148-a160-4d06-ad7e-92803d299e5f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:26.371216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0570e148-a160-4d06-ad7e-92803d299e5f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:26.372011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0570e148-a160-4d06-ad7e-92803d299e5f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:26.372443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0570e148-a160-4d06-ad7e-92803d299e5f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:26.496778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0570e148-a160-4d06-ad7e-92803d299e5f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:26.504450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0570e148-a160-4d06-ad7e-92803d299e5f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.255368 May 12 07:17:26.505103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1214/2514] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:26 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:27.002781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9cc470a3-34c2-4c3a-ad6c-2e98b2650646 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:27.003399 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9cc470a3-34c2-4c3a-ad6c-2e98b2650646 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:27.009720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9cc470a3-34c2-4c3a-ad6c-2e98b2650646 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:27.010175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9cc470a3-34c2-4c3a-ad6c-2e98b2650646 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:27.010975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9cc470a3-34c2-4c3a-ad6c-2e98b2650646 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:27.011439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9cc470a3-34c2-4c3a-ad6c-2e98b2650646 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:27.075670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9cc470a3-34c2-4c3a-ad6c-2e98b2650646 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:27.084017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9cc470a3-34c2-4c3a-ad6c-2e98b2650646 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085544 May 12 07:17:27.084587 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1301/2515] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:26 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:27.520497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d6d98084-28b9-4f6b-b734-4bea16be1aec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:27.521115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d6d98084-28b9-4f6b-b734-4bea16be1aec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:27.527477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6d98084-28b9-4f6b-b734-4bea16be1aec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:27.527960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6d98084-28b9-4f6b-b734-4bea16be1aec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:27.528726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6d98084-28b9-4f6b-b734-4bea16be1aec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:27.529166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6d98084-28b9-4f6b-b734-4bea16be1aec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:27.656173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d6d98084-28b9-4f6b-b734-4bea16be1aec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:27.664469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d6d98084-28b9-4f6b-b734-4bea16be1aec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147865 May 12 07:17:27.665046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1215/2516] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:27 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:28.101415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4ef0dc0d-0d61-440a-9501-144e84e386db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:28.102022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4ef0dc0d-0d61-440a-9501-144e84e386db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:28.108418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ef0dc0d-0d61-440a-9501-144e84e386db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:28.108861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ef0dc0d-0d61-440a-9501-144e84e386db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:28.109620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ef0dc0d-0d61-440a-9501-144e84e386db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:28.110083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4ef0dc0d-0d61-440a-9501-144e84e386db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:28.169996 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4ef0dc0d-0d61-440a-9501-144e84e386db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:28.177855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4ef0dc0d-0d61-440a-9501-144e84e386db tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080270 May 12 07:17:28.178425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1302/2517] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:28 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:28.682265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ff6a77b0-7c5f-4128-8a1f-d3b6c0513bf3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:28.682883 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ff6a77b0-7c5f-4128-8a1f-d3b6c0513bf3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:28.689733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff6a77b0-7c5f-4128-8a1f-d3b6c0513bf3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:28.690182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff6a77b0-7c5f-4128-8a1f-d3b6c0513bf3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:28.690942 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff6a77b0-7c5f-4128-8a1f-d3b6c0513bf3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:28.691378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff6a77b0-7c5f-4128-8a1f-d3b6c0513bf3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:28.818792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ff6a77b0-7c5f-4128-8a1f-d3b6c0513bf3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:28.826469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ff6a77b0-7c5f-4128-8a1f-d3b6c0513bf3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148081 May 12 07:17:28.827035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1216/2518] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:28 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:29.194363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2acc41b4-1e02-4c67-8ffa-eac2be327ad6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:29.194975 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2acc41b4-1e02-4c67-8ffa-eac2be327ad6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:29.201259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2acc41b4-1e02-4c67-8ffa-eac2be327ad6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:29.201716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2acc41b4-1e02-4c67-8ffa-eac2be327ad6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:29.202489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2acc41b4-1e02-4c67-8ffa-eac2be327ad6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:29.202929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2acc41b4-1e02-4c67-8ffa-eac2be327ad6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:29.263017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2acc41b4-1e02-4c67-8ffa-eac2be327ad6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:29.270739 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2acc41b4-1e02-4c67-8ffa-eac2be327ad6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080271 May 12 07:17:29.271302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1303/2519] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:29 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:29.842989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-312bf5a5-b343-4003-bf57-123c1c529e61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:29.843606 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-312bf5a5-b343-4003-bf57-123c1c529e61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:29.849938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-312bf5a5-b343-4003-bf57-123c1c529e61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:29.850387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-312bf5a5-b343-4003-bf57-123c1c529e61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:29.851152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-312bf5a5-b343-4003-bf57-123c1c529e61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:29.851591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-312bf5a5-b343-4003-bf57-123c1c529e61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:29.977454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-312bf5a5-b343-4003-bf57-123c1c529e61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:29.985236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-312bf5a5-b343-4003-bf57-123c1c529e61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146092 May 12 07:17:29.985799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1217/2520] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:29 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:30.287606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5dc99647-51de-47d8-916a-4b795c6f054b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:30.288248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5dc99647-51de-47d8-916a-4b795c6f054b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:30.294716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dc99647-51de-47d8-916a-4b795c6f054b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:30.295194 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dc99647-51de-47d8-916a-4b795c6f054b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:30.296000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dc99647-51de-47d8-916a-4b795c6f054b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:30.296473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5dc99647-51de-47d8-916a-4b795c6f054b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:30.356809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5dc99647-51de-47d8-916a-4b795c6f054b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:30.364852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5dc99647-51de-47d8-916a-4b795c6f054b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081221 May 12 07:17:30.365417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1304/2521] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:30 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:31.002247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2f104948-a5cd-4486-9b82-df8298d939dc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:31.002915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2f104948-a5cd-4486-9b82-df8298d939dc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:31.008835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f104948-a5cd-4486-9b82-df8298d939dc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:31.009274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f104948-a5cd-4486-9b82-df8298d939dc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:31.010034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f104948-a5cd-4486-9b82-df8298d939dc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:31.010471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f104948-a5cd-4486-9b82-df8298d939dc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:31.136999 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2f104948-a5cd-4486-9b82-df8298d939dc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:31.145186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2f104948-a5cd-4486-9b82-df8298d939dc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147048 May 12 07:17:31.145748 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1218/2522] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:30 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:31.382029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2ea892f6-f486-4c24-8468-ece8806c2561 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:31.382578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2ea892f6-f486-4c24-8468-ece8806c2561 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:31.388866 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ea892f6-f486-4c24-8468-ece8806c2561 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:31.389315 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ea892f6-f486-4c24-8468-ece8806c2561 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:31.390075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ea892f6-f486-4c24-8468-ece8806c2561 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:31.390507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ea892f6-f486-4c24-8468-ece8806c2561 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:31.452211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2ea892f6-f486-4c24-8468-ece8806c2561 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:31.460510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2ea892f6-f486-4c24-8468-ece8806c2561 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082363 May 12 07:17:31.461076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1305/2523] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:31 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:32.162553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f2f11226-f608-412e-a45c-51dbd90d39bf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:32.163068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f2f11226-f608-412e-a45c-51dbd90d39bf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:32.169482 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2f11226-f608-412e-a45c-51dbd90d39bf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:32.169927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2f11226-f608-412e-a45c-51dbd90d39bf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:32.170681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2f11226-f608-412e-a45c-51dbd90d39bf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:32.171110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2f11226-f608-412e-a45c-51dbd90d39bf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:32.299858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f2f11226-f608-412e-a45c-51dbd90d39bf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:32.307764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f2f11226-f608-412e-a45c-51dbd90d39bf tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149126 May 12 07:17:32.308341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1219/2524] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:32 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:32.477072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8fefc50f-62aa-4232-8997-97a95cd96b2c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:32.477611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8fefc50f-62aa-4232-8997-97a95cd96b2c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:32.483902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fefc50f-62aa-4232-8997-97a95cd96b2c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:32.484348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fefc50f-62aa-4232-8997-97a95cd96b2c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:32.485108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fefc50f-62aa-4232-8997-97a95cd96b2c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:32.485539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fefc50f-62aa-4232-8997-97a95cd96b2c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:32.544885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8fefc50f-62aa-4232-8997-97a95cd96b2c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:32.552652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8fefc50f-62aa-4232-8997-97a95cd96b2c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079437 May 12 07:17:32.553213 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1306/2525] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:32 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:33.324976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fcd8c2ef-e1de-46f8-8604-4a52a70e36d0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:33.325530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fcd8c2ef-e1de-46f8-8604-4a52a70e36d0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:33.331873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fcd8c2ef-e1de-46f8-8604-4a52a70e36d0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:33.332323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fcd8c2ef-e1de-46f8-8604-4a52a70e36d0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:33.333077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fcd8c2ef-e1de-46f8-8604-4a52a70e36d0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:33.333511 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fcd8c2ef-e1de-46f8-8604-4a52a70e36d0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:33.457206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fcd8c2ef-e1de-46f8-8604-4a52a70e36d0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:33.464980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fcd8c2ef-e1de-46f8-8604-4a52a70e36d0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143962 May 12 07:17:33.465555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1220/2526] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:33 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:33.569209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5b48a651-65c1-42a1-8989-a214ca35d54d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:33.569835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5b48a651-65c1-42a1-8989-a214ca35d54d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:33.576128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b48a651-65c1-42a1-8989-a214ca35d54d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:33.576528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b48a651-65c1-42a1-8989-a214ca35d54d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:33.577295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b48a651-65c1-42a1-8989-a214ca35d54d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:33.577734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5b48a651-65c1-42a1-8989-a214ca35d54d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:33.636900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5b48a651-65c1-42a1-8989-a214ca35d54d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:33.644736 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5b48a651-65c1-42a1-8989-a214ca35d54d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079356 May 12 07:17:33.645306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1307/2527] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:33 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:34.482312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e1056fab-0320-4724-adc3-1d28047073ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:34.482838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e1056fab-0320-4724-adc3-1d28047073ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:34.489154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1056fab-0320-4724-adc3-1d28047073ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:34.489600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1056fab-0320-4724-adc3-1d28047073ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:34.490359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1056fab-0320-4724-adc3-1d28047073ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:34.490790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e1056fab-0320-4724-adc3-1d28047073ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:34.618652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e1056fab-0320-4724-adc3-1d28047073ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:34.626945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e1056fab-0320-4724-adc3-1d28047073ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148536 May 12 07:17:34.627507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1221/2528] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:34 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:34.662017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-54fcee18-ab93-41cf-8ffc-55ac339ba7d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:34.662664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-54fcee18-ab93-41cf-8ffc-55ac339ba7d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:34.668943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54fcee18-ab93-41cf-8ffc-55ac339ba7d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:34.673664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54fcee18-ab93-41cf-8ffc-55ac339ba7d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:34.673664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54fcee18-ab93-41cf-8ffc-55ac339ba7d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:34.673664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-54fcee18-ab93-41cf-8ffc-55ac339ba7d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:34.731525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-54fcee18-ab93-41cf-8ffc-55ac339ba7d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:34.740721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-54fcee18-ab93-41cf-8ffc-55ac339ba7d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082287 May 12 07:17:34.741483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1308/2529] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:34 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:35.644724 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0bdffd36-0133-49da-b8d4-e0f72e57d66d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:35.645348 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0bdffd36-0133-49da-b8d4-e0f72e57d66d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:35.651621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0bdffd36-0133-49da-b8d4-e0f72e57d66d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:35.652095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0bdffd36-0133-49da-b8d4-e0f72e57d66d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:35.652850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0bdffd36-0133-49da-b8d4-e0f72e57d66d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:35.653281 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0bdffd36-0133-49da-b8d4-e0f72e57d66d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:35.757793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8549c5d8-0a0e-4903-8eb1-634e03858915 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:35.758456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8549c5d8-0a0e-4903-8eb1-634e03858915 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:35.764730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8549c5d8-0a0e-4903-8eb1-634e03858915 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:35.765181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8549c5d8-0a0e-4903-8eb1-634e03858915 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:35.766549 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8549c5d8-0a0e-4903-8eb1-634e03858915 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:35.766999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8549c5d8-0a0e-4903-8eb1-634e03858915 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:35.780914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0bdffd36-0133-49da-b8d4-e0f72e57d66d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:35.789937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0bdffd36-0133-49da-b8d4-e0f72e57d66d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149576 May 12 07:17:35.790502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1222/2530] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:35 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:35.827101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8549c5d8-0a0e-4903-8eb1-634e03858915 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:35.835488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8549c5d8-0a0e-4903-8eb1-634e03858915 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081612 May 12 07:17:35.836089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1309/2531] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:35 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:36.807250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5439b9bb-bde3-4660-acf2-e01afef72beb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:36.807891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5439b9bb-bde3-4660-acf2-e01afef72beb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:36.814263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5439b9bb-bde3-4660-acf2-e01afef72beb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:36.814708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5439b9bb-bde3-4660-acf2-e01afef72beb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:36.815464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5439b9bb-bde3-4660-acf2-e01afef72beb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:36.815933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5439b9bb-bde3-4660-acf2-e01afef72beb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:36.851921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e5aee116-30ce-497d-9558-5cb78981d1f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:36.852536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e5aee116-30ce-497d-9558-5cb78981d1f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:36.859001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5aee116-30ce-497d-9558-5cb78981d1f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:36.859445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5aee116-30ce-497d-9558-5cb78981d1f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:36.860245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5aee116-30ce-497d-9558-5cb78981d1f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:36.860676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e5aee116-30ce-497d-9558-5cb78981d1f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:36.930655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e5aee116-30ce-497d-9558-5cb78981d1f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:36.938512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e5aee116-30ce-497d-9558-5cb78981d1f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.090241 May 12 07:17:36.939090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1310/2532] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:36 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:36.959750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5439b9bb-bde3-4660-acf2-e01afef72beb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:36.967839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5439b9bb-bde3-4660-acf2-e01afef72beb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.164476 May 12 07:17:36.968404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1223/2533] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:36 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:37.955431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c502c3c7-949f-4c8d-97d8-882b8f3dcbaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:37.956059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c502c3c7-949f-4c8d-97d8-882b8f3dcbaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:37.962454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c502c3c7-949f-4c8d-97d8-882b8f3dcbaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:37.962902 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c502c3c7-949f-4c8d-97d8-882b8f3dcbaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:37.963676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c502c3c7-949f-4c8d-97d8-882b8f3dcbaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:37.964134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c502c3c7-949f-4c8d-97d8-882b8f3dcbaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:37.985927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c925e94c-38fa-4354-853f-c9926c1fa741 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:37.986550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c925e94c-38fa-4354-853f-c9926c1fa741 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:37.993058 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c925e94c-38fa-4354-853f-c9926c1fa741 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:37.993447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c925e94c-38fa-4354-853f-c9926c1fa741 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:37.994228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c925e94c-38fa-4354-853f-c9926c1fa741 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:37.994670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c925e94c-38fa-4354-853f-c9926c1fa741 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:38.032932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c502c3c7-949f-4c8d-97d8-882b8f3dcbaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:38.040815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c502c3c7-949f-4c8d-97d8-882b8f3dcbaf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.089222 May 12 07:17:38.041605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1311/2534] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:37 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:38.123663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c925e94c-38fa-4354-853f-c9926c1fa741 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:38.131377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c925e94c-38fa-4354-853f-c9926c1fa741 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149905 May 12 07:17:38.131982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1224/2535] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:37 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:39.058505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-022339b0-5201-44cf-8684-6118ca3dabcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:39.059121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-022339b0-5201-44cf-8684-6118ca3dabcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:39.065447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-022339b0-5201-44cf-8684-6118ca3dabcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:39.065900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-022339b0-5201-44cf-8684-6118ca3dabcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:39.066671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-022339b0-5201-44cf-8684-6118ca3dabcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:39.067110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-022339b0-5201-44cf-8684-6118ca3dabcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:39.127214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-022339b0-5201-44cf-8684-6118ca3dabcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:39.134907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-022339b0-5201-44cf-8684-6118ca3dabcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080297 May 12 07:17:39.135471 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1312/2536] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:39 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:39.148178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3d5330a2-f6be-4169-a415-e001c2f424e0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:39.148829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3d5330a2-f6be-4169-a415-e001c2f424e0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:39.155034 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d5330a2-f6be-4169-a415-e001c2f424e0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:39.155486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d5330a2-f6be-4169-a415-e001c2f424e0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:39.156281 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d5330a2-f6be-4169-a415-e001c2f424e0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:39.156720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d5330a2-f6be-4169-a415-e001c2f424e0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:39.285387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3d5330a2-f6be-4169-a415-e001c2f424e0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:39.293185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3d5330a2-f6be-4169-a415-e001c2f424e0 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148770 May 12 07:17:39.293757 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1225/2537] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:39 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:40.151361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-11f4a348-2963-44fb-b0eb-3491808c035a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:40.151992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-11f4a348-2963-44fb-b0eb-3491808c035a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:40.158320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11f4a348-2963-44fb-b0eb-3491808c035a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:40.158775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11f4a348-2963-44fb-b0eb-3491808c035a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:40.159547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11f4a348-2963-44fb-b0eb-3491808c035a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:40.160017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-11f4a348-2963-44fb-b0eb-3491808c035a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:40.221543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-11f4a348-2963-44fb-b0eb-3491808c035a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:40.229315 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-11f4a348-2963-44fb-b0eb-3491808c035a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081874 May 12 07:17:40.229894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1313/2538] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:40 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:40.310067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fdb29ad5-f07c-4dea-91c5-e633313117df tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:40.310680 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fdb29ad5-f07c-4dea-91c5-e633313117df tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:40.316987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdb29ad5-f07c-4dea-91c5-e633313117df tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:40.317443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdb29ad5-f07c-4dea-91c5-e633313117df tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:40.318208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdb29ad5-f07c-4dea-91c5-e633313117df tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:40.318646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdb29ad5-f07c-4dea-91c5-e633313117df tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:40.442779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fdb29ad5-f07c-4dea-91c5-e633313117df tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:40.450450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fdb29ad5-f07c-4dea-91c5-e633313117df tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144277 May 12 07:17:40.451013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1226/2539] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:40 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:41.246426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b24df2eb-4631-4102-864a-5538c7d830b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:41.246985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b24df2eb-4631-4102-864a-5538c7d830b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:41.254053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b24df2eb-4631-4102-864a-5538c7d830b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:41.254501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b24df2eb-4631-4102-864a-5538c7d830b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:41.255272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b24df2eb-4631-4102-864a-5538c7d830b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:41.255733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b24df2eb-4631-4102-864a-5538c7d830b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:41.318991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b24df2eb-4631-4102-864a-5538c7d830b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:41.326826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b24df2eb-4631-4102-864a-5538c7d830b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084366 May 12 07:17:41.327394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1314/2540] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:41 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:41.466381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6e2c3847-6412-4948-beee-ad14997b77f6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:41.467021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6e2c3847-6412-4948-beee-ad14997b77f6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:41.473278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e2c3847-6412-4948-beee-ad14997b77f6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:41.473722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e2c3847-6412-4948-beee-ad14997b77f6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:41.474475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e2c3847-6412-4948-beee-ad14997b77f6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:41.474906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e2c3847-6412-4948-beee-ad14997b77f6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:41.598467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6e2c3847-6412-4948-beee-ad14997b77f6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:41.606319 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6e2c3847-6412-4948-beee-ad14997b77f6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143785 May 12 07:17:41.606889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1227/2541] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:41 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:42.345133 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-572ccbb6-0fc2-4515-94ff-842fc2772721 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:42.345669 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-572ccbb6-0fc2-4515-94ff-842fc2772721 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:42.351986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-572ccbb6-0fc2-4515-94ff-842fc2772721 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:42.352446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-572ccbb6-0fc2-4515-94ff-842fc2772721 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:42.353212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-572ccbb6-0fc2-4515-94ff-842fc2772721 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:42.353650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-572ccbb6-0fc2-4515-94ff-842fc2772721 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:42.414614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-572ccbb6-0fc2-4515-94ff-842fc2772721 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:42.424338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-572ccbb6-0fc2-4515-94ff-842fc2772721 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083578 May 12 07:17:42.425100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1315/2542] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:42 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:42.623705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5a19e9b5-7564-4af4-a99f-928a1f647968 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:42.624278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5a19e9b5-7564-4af4-a99f-928a1f647968 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:42.631341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5a19e9b5-7564-4af4-a99f-928a1f647968 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:42.631832 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5a19e9b5-7564-4af4-a99f-928a1f647968 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:42.632604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5a19e9b5-7564-4af4-a99f-928a1f647968 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:42.633048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5a19e9b5-7564-4af4-a99f-928a1f647968 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:42.760109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5a19e9b5-7564-4af4-a99f-928a1f647968 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:42.768423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5a19e9b5-7564-4af4-a99f-928a1f647968 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148612 May 12 07:17:42.768988 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1228/2543] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:42 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:43.444153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0bd1dbcf-babd-4d80-bf41-32f214ccaa3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:43.444690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0bd1dbcf-babd-4d80-bf41-32f214ccaa3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:43.450952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bd1dbcf-babd-4d80-bf41-32f214ccaa3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:43.451402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bd1dbcf-babd-4d80-bf41-32f214ccaa3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:43.452194 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bd1dbcf-babd-4d80-bf41-32f214ccaa3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:43.452634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0bd1dbcf-babd-4d80-bf41-32f214ccaa3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:43.512314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0bd1dbcf-babd-4d80-bf41-32f214ccaa3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:43.520681 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0bd1dbcf-babd-4d80-bf41-32f214ccaa3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080496 May 12 07:17:43.521251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1316/2544] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:43 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:43.785219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3c6c5957-4fcc-4227-afb1-feea5228f91a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:43.785837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3c6c5957-4fcc-4227-afb1-feea5228f91a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:43.792184 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c6c5957-4fcc-4227-afb1-feea5228f91a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:43.792637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c6c5957-4fcc-4227-afb1-feea5228f91a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:43.793399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c6c5957-4fcc-4227-afb1-feea5228f91a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:43.793836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c6c5957-4fcc-4227-afb1-feea5228f91a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:43.917781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3c6c5957-4fcc-4227-afb1-feea5228f91a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:43.926310 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3c6c5957-4fcc-4227-afb1-feea5228f91a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145012 May 12 07:17:43.926888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1229/2545] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:43 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:44.538077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-85a4b530-66e3-4e8d-87e8-360110b32dd2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:44.538690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-85a4b530-66e3-4e8d-87e8-360110b32dd2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:44.544965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85a4b530-66e3-4e8d-87e8-360110b32dd2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:44.545426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85a4b530-66e3-4e8d-87e8-360110b32dd2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:44.546185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85a4b530-66e3-4e8d-87e8-360110b32dd2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:44.546623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85a4b530-66e3-4e8d-87e8-360110b32dd2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:44.609839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-85a4b530-66e3-4e8d-87e8-360110b32dd2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:44.618862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-85a4b530-66e3-4e8d-87e8-360110b32dd2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084605 May 12 07:17:44.619443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1317/2546] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:44 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:44.943750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2a2b8d84-66d4-4032-86e2-d59c65463f3e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:44.944296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2a2b8d84-66d4-4032-86e2-d59c65463f3e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:44.950667 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a2b8d84-66d4-4032-86e2-d59c65463f3e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:44.951115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a2b8d84-66d4-4032-86e2-d59c65463f3e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:44.951915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a2b8d84-66d4-4032-86e2-d59c65463f3e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:44.952355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2a2b8d84-66d4-4032-86e2-d59c65463f3e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:45.083934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2a2b8d84-66d4-4032-86e2-d59c65463f3e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:45.091668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2a2b8d84-66d4-4032-86e2-d59c65463f3e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.151939 May 12 07:17:45.092262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1230/2547] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:44 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:45.635633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4aa48852-ab9a-4c5c-b1ee-b4138f0f4f42 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:45.636278 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4aa48852-ab9a-4c5c-b1ee-b4138f0f4f42 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:45.643242 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4aa48852-ab9a-4c5c-b1ee-b4138f0f4f42 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:45.643729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4aa48852-ab9a-4c5c-b1ee-b4138f0f4f42 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:45.644524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4aa48852-ab9a-4c5c-b1ee-b4138f0f4f42 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:45.644973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4aa48852-ab9a-4c5c-b1ee-b4138f0f4f42 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:45.707106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4aa48852-ab9a-4c5c-b1ee-b4138f0f4f42 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:45.714779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4aa48852-ab9a-4c5c-b1ee-b4138f0f4f42 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083044 May 12 07:17:45.715342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1318/2548] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:45 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:46.107647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9c5abc70-3120-4d2a-9778-ad57efa15f61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:46.108327 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9c5abc70-3120-4d2a-9778-ad57efa15f61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:46.114765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c5abc70-3120-4d2a-9778-ad57efa15f61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:46.115217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c5abc70-3120-4d2a-9778-ad57efa15f61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:46.116011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c5abc70-3120-4d2a-9778-ad57efa15f61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:46.116444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c5abc70-3120-4d2a-9778-ad57efa15f61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:46.241666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c5abc70-3120-4d2a-9778-ad57efa15f61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:46.249395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9c5abc70-3120-4d2a-9778-ad57efa15f61 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145535 May 12 07:17:46.249898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1231/2549] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:46 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:46.732311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1c759114-ac88-4b0a-bac9-b0f17a063cfb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:46.733530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1c759114-ac88-4b0a-bac9-b0f17a063cfb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:46.740650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c759114-ac88-4b0a-bac9-b0f17a063cfb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:46.741109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c759114-ac88-4b0a-bac9-b0f17a063cfb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:46.741887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c759114-ac88-4b0a-bac9-b0f17a063cfb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:46.742329 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c759114-ac88-4b0a-bac9-b0f17a063cfb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:46.803425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1c759114-ac88-4b0a-bac9-b0f17a063cfb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:46.811116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1c759114-ac88-4b0a-bac9-b0f17a063cfb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082747 May 12 07:17:46.811703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1319/2550] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:46 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:47.266324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e8fa66e2-6fea-440a-8098-a3460b58e9ce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:47.266940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e8fa66e2-6fea-440a-8098-a3460b58e9ce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:47.273296 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8fa66e2-6fea-440a-8098-a3460b58e9ce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:47.273751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8fa66e2-6fea-440a-8098-a3460b58e9ce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:47.274516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8fa66e2-6fea-440a-8098-a3460b58e9ce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:47.274955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8fa66e2-6fea-440a-8098-a3460b58e9ce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:47.399345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e8fa66e2-6fea-440a-8098-a3460b58e9ce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:47.407757 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e8fa66e2-6fea-440a-8098-a3460b58e9ce tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145268 May 12 07:17:47.408333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1232/2551] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:47 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:47.828221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ee1fabb5-4cbc-473a-ba23-6b4a0cc4b277 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:47.829596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ee1fabb5-4cbc-473a-ba23-6b4a0cc4b277 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:47.835887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee1fabb5-4cbc-473a-ba23-6b4a0cc4b277 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:47.836345 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee1fabb5-4cbc-473a-ba23-6b4a0cc4b277 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:47.837137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee1fabb5-4cbc-473a-ba23-6b4a0cc4b277 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:47.837560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee1fabb5-4cbc-473a-ba23-6b4a0cc4b277 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:47.900171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ee1fabb5-4cbc-473a-ba23-6b4a0cc4b277 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:47.907998 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ee1fabb5-4cbc-473a-ba23-6b4a0cc4b277 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083635 May 12 07:17:47.908566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1320/2552] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:47 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:48.425090 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2cc3d5e5-d5cd-42d9-aa95-71f920f8b1d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:48.425711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2cc3d5e5-d5cd-42d9-aa95-71f920f8b1d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:48.431964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2cc3d5e5-d5cd-42d9-aa95-71f920f8b1d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:48.432411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2cc3d5e5-d5cd-42d9-aa95-71f920f8b1d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:48.433166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2cc3d5e5-d5cd-42d9-aa95-71f920f8b1d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:48.433599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2cc3d5e5-d5cd-42d9-aa95-71f920f8b1d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:48.557678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2cc3d5e5-d5cd-42d9-aa95-71f920f8b1d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:48.565932 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2cc3d5e5-d5cd-42d9-aa95-71f920f8b1d9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145046 May 12 07:17:48.566498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1233/2553] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:48 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:48.925360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d7355b40-009d-4814-a668-ee683fafee44 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:48.925968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d7355b40-009d-4814-a668-ee683fafee44 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:48.932315 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7355b40-009d-4814-a668-ee683fafee44 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:48.932759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7355b40-009d-4814-a668-ee683fafee44 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:48.933519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7355b40-009d-4814-a668-ee683fafee44 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:48.933953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d7355b40-009d-4814-a668-ee683fafee44 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:48.994144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d7355b40-009d-4814-a668-ee683fafee44 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:49.002646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d7355b40-009d-4814-a668-ee683fafee44 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081819 May 12 07:17:49.003225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1321/2554] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:48 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:49.583028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b7f5e70c-9487-4da1-aafb-fee2ecc34982 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:49.583660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b7f5e70c-9487-4da1-aafb-fee2ecc34982 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:49.589944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7f5e70c-9487-4da1-aafb-fee2ecc34982 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:49.590390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7f5e70c-9487-4da1-aafb-fee2ecc34982 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:49.591146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7f5e70c-9487-4da1-aafb-fee2ecc34982 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:49.591580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b7f5e70c-9487-4da1-aafb-fee2ecc34982 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:49.717144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b7f5e70c-9487-4da1-aafb-fee2ecc34982 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:49.725433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b7f5e70c-9487-4da1-aafb-fee2ecc34982 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146204 May 12 07:17:49.725990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1234/2555] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:49 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:50.020079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a69e23b0-49f2-4bc7-9fcd-a63da66ba077 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:50.020703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a69e23b0-49f2-4bc7-9fcd-a63da66ba077 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:50.027184 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a69e23b0-49f2-4bc7-9fcd-a63da66ba077 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:50.027632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a69e23b0-49f2-4bc7-9fcd-a63da66ba077 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:50.028426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a69e23b0-49f2-4bc7-9fcd-a63da66ba077 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:50.028859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a69e23b0-49f2-4bc7-9fcd-a63da66ba077 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:50.088779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a69e23b0-49f2-4bc7-9fcd-a63da66ba077 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:50.096499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a69e23b0-49f2-4bc7-9fcd-a63da66ba077 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080958 May 12 07:17:50.097058 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1322/2556] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:50 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:50.742277 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-35c0089c-9b06-4458-9e88-36a100063397 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:50.742887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-35c0089c-9b06-4458-9e88-36a100063397 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:50.749197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35c0089c-9b06-4458-9e88-36a100063397 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:50.749647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35c0089c-9b06-4458-9e88-36a100063397 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:50.750405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35c0089c-9b06-4458-9e88-36a100063397 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:50.750838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35c0089c-9b06-4458-9e88-36a100063397 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:50.873671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-35c0089c-9b06-4458-9e88-36a100063397 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:50.881398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-35c0089c-9b06-4458-9e88-36a100063397 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.142969 May 12 07:17:50.881975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1235/2557] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:50 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:51.113462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a0755896-d37b-4cf8-8bbc-e3971ecd8269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:51.114041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a0755896-d37b-4cf8-8bbc-e3971ecd8269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:51.120460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0755896-d37b-4cf8-8bbc-e3971ecd8269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:51.120913 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0755896-d37b-4cf8-8bbc-e3971ecd8269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:51.121679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0755896-d37b-4cf8-8bbc-e3971ecd8269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:51.122119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a0755896-d37b-4cf8-8bbc-e3971ecd8269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:51.184843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a0755896-d37b-4cf8-8bbc-e3971ecd8269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:51.192493 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a0755896-d37b-4cf8-8bbc-e3971ecd8269 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082928 May 12 07:17:51.193061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1323/2558] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:51 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:51.897840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3694479f-6b96-47a8-96ef-53c7c542e9bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:51.898460 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3694479f-6b96-47a8-96ef-53c7c542e9bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:51.904881 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3694479f-6b96-47a8-96ef-53c7c542e9bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:51.905342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3694479f-6b96-47a8-96ef-53c7c542e9bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:51.906143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3694479f-6b96-47a8-96ef-53c7c542e9bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:51.906587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3694479f-6b96-47a8-96ef-53c7c542e9bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:52.033154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3694479f-6b96-47a8-96ef-53c7c542e9bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:52.040996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3694479f-6b96-47a8-96ef-53c7c542e9bc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147141 May 12 07:17:52.041604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1236/2559] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:51 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:52.209488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6e510db6-5006-488b-a0f6-8d1a5408c441 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:52.210028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6e510db6-5006-488b-a0f6-8d1a5408c441 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:52.215955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e510db6-5006-488b-a0f6-8d1a5408c441 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:52.216406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e510db6-5006-488b-a0f6-8d1a5408c441 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:52.217178 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e510db6-5006-488b-a0f6-8d1a5408c441 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:52.217640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6e510db6-5006-488b-a0f6-8d1a5408c441 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:52.279156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6e510db6-5006-488b-a0f6-8d1a5408c441 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:52.287406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6e510db6-5006-488b-a0f6-8d1a5408c441 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081990 May 12 07:17:52.288011 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1324/2560] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:52 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:53.058808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5affb4d0-d83f-4d0c-be7c-55af8f17ee51 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:53.059447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5affb4d0-d83f-4d0c-be7c-55af8f17ee51 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:53.065734 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5affb4d0-d83f-4d0c-be7c-55af8f17ee51 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:53.066194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5affb4d0-d83f-4d0c-be7c-55af8f17ee51 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:53.066987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5affb4d0-d83f-4d0c-be7c-55af8f17ee51 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:53.067427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5affb4d0-d83f-4d0c-be7c-55af8f17ee51 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:53.194189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5affb4d0-d83f-4d0c-be7c-55af8f17ee51 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:53.201985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5affb4d0-d83f-4d0c-be7c-55af8f17ee51 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147088 May 12 07:17:53.202550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1237/2561] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:53 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:53.305319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-21dcf123-b3ff-42f6-b7bc-80d4b47b9400 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:53.305939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-21dcf123-b3ff-42f6-b7bc-80d4b47b9400 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:53.312223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21dcf123-b3ff-42f6-b7bc-80d4b47b9400 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:53.312672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21dcf123-b3ff-42f6-b7bc-80d4b47b9400 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:53.313436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21dcf123-b3ff-42f6-b7bc-80d4b47b9400 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:53.313878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-21dcf123-b3ff-42f6-b7bc-80d4b47b9400 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:53.372918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-21dcf123-b3ff-42f6-b7bc-80d4b47b9400 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:53.380588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-21dcf123-b3ff-42f6-b7bc-80d4b47b9400 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079051 May 12 07:17:53.381152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1325/2562] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:53 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:54.219315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-975bffe9-6adb-4713-abe9-8f6201ff13b7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:54.219955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-975bffe9-6adb-4713-abe9-8f6201ff13b7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:54.226276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-975bffe9-6adb-4713-abe9-8f6201ff13b7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:54.226726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-975bffe9-6adb-4713-abe9-8f6201ff13b7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:54.227497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-975bffe9-6adb-4713-abe9-8f6201ff13b7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:54.227956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-975bffe9-6adb-4713-abe9-8f6201ff13b7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:54.351004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-975bffe9-6adb-4713-abe9-8f6201ff13b7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:54.360190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-975bffe9-6adb-4713-abe9-8f6201ff13b7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143844 May 12 07:17:54.360764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1238/2563] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:54 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:54.396980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a8c86582-6446-450f-9159-7125ac9a78d4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:54.397700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a8c86582-6446-450f-9159-7125ac9a78d4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:54.404900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8c86582-6446-450f-9159-7125ac9a78d4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:54.405352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8c86582-6446-450f-9159-7125ac9a78d4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:54.406120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8c86582-6446-450f-9159-7125ac9a78d4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:54.406560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a8c86582-6446-450f-9159-7125ac9a78d4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:54.469857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a8c86582-6446-450f-9159-7125ac9a78d4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:54.477632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a8c86582-6446-450f-9159-7125ac9a78d4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084462 May 12 07:17:54.478193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1326/2564] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:54 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:55.377707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b502089a-97a9-48e8-a039-558edd8dfac6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:55.378324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b502089a-97a9-48e8-a039-558edd8dfac6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:55.384631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b502089a-97a9-48e8-a039-558edd8dfac6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:55.385077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b502089a-97a9-48e8-a039-558edd8dfac6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:55.385833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b502089a-97a9-48e8-a039-558edd8dfac6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:55.386270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b502089a-97a9-48e8-a039-558edd8dfac6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:55.494392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c5cfd894-5b6f-43c5-8f9f-b22fd31b63eb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:55.495078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c5cfd894-5b6f-43c5-8f9f-b22fd31b63eb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:55.501869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5cfd894-5b6f-43c5-8f9f-b22fd31b63eb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:55.502333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5cfd894-5b6f-43c5-8f9f-b22fd31b63eb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:55.503110 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5cfd894-5b6f-43c5-8f9f-b22fd31b63eb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:55.503556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5cfd894-5b6f-43c5-8f9f-b22fd31b63eb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:55.510526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b502089a-97a9-48e8-a039-558edd8dfac6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:55.518902 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b502089a-97a9-48e8-a039-558edd8dfac6 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145632 May 12 07:17:55.519483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1239/2565] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:55 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:55.564083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c5cfd894-5b6f-43c5-8f9f-b22fd31b63eb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:55.571720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c5cfd894-5b6f-43c5-8f9f-b22fd31b63eb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081285 May 12 07:17:55.572297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1327/2566] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:55 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:56.535855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-13eb0ca5-82c3-4f08-a7c4-14ee38dfb1de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:56.536470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-13eb0ca5-82c3-4f08-a7c4-14ee38dfb1de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:56.542767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13eb0ca5-82c3-4f08-a7c4-14ee38dfb1de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:56.543237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13eb0ca5-82c3-4f08-a7c4-14ee38dfb1de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:56.544027 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13eb0ca5-82c3-4f08-a7c4-14ee38dfb1de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:56.544463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13eb0ca5-82c3-4f08-a7c4-14ee38dfb1de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:56.588941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-634c353a-63d2-4039-bd04-bb8d324e059c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:56.589556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-634c353a-63d2-4039-bd04-bb8d324e059c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:56.596071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-634c353a-63d2-4039-bd04-bb8d324e059c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:56.596526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-634c353a-63d2-4039-bd04-bb8d324e059c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:56.597332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-634c353a-63d2-4039-bd04-bb8d324e059c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:56.597887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-634c353a-63d2-4039-bd04-bb8d324e059c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:56.674289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-634c353a-63d2-4039-bd04-bb8d324e059c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:56.681907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-634c353a-63d2-4039-bd04-bb8d324e059c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.096747 May 12 07:17:56.682474 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1328/2567] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:56 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:56.695282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-13eb0ca5-82c3-4f08-a7c4-14ee38dfb1de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:56.703071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-13eb0ca5-82c3-4f08-a7c4-14ee38dfb1de tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.171088 May 12 07:17:56.703636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1240/2568] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:56 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:57.698378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-41b74c1b-05f6-4c85-a0d4-5d6349b6509c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:57.698935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-41b74c1b-05f6-4c85-a0d4-5d6349b6509c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:57.706016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41b74c1b-05f6-4c85-a0d4-5d6349b6509c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:57.706463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41b74c1b-05f6-4c85-a0d4-5d6349b6509c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:57.707222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41b74c1b-05f6-4c85-a0d4-5d6349b6509c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:57.707658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-41b74c1b-05f6-4c85-a0d4-5d6349b6509c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:57.721502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-581bfc84-7256-4972-9a6c-9bb94db39da3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:57.722122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-581bfc84-7256-4972-9a6c-9bb94db39da3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:57.728542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-581bfc84-7256-4972-9a6c-9bb94db39da3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:57.728990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-581bfc84-7256-4972-9a6c-9bb94db39da3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:57.729755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-581bfc84-7256-4972-9a6c-9bb94db39da3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:57.730196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-581bfc84-7256-4972-9a6c-9bb94db39da3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:57.770446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-41b74c1b-05f6-4c85-a0d4-5d6349b6509c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:57.778357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-41b74c1b-05f6-4c85-a0d4-5d6349b6509c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083859 May 12 07:17:57.778933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1329/2569] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:57 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:57.861324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-581bfc84-7256-4972-9a6c-9bb94db39da3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:57.869106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-581bfc84-7256-4972-9a6c-9bb94db39da3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.151865 May 12 07:17:57.869669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1241/2570] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:57 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:17:58.794932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2789842b-cafa-490d-b8e8-99a0c61c7d73 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:58.795543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2789842b-cafa-490d-b8e8-99a0c61c7d73 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:58.802036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2789842b-cafa-490d-b8e8-99a0c61c7d73 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:58.802486 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2789842b-cafa-490d-b8e8-99a0c61c7d73 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:58.803245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2789842b-cafa-490d-b8e8-99a0c61c7d73 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:58.803699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2789842b-cafa-490d-b8e8-99a0c61c7d73 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:58.865717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2789842b-cafa-490d-b8e8-99a0c61c7d73 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:58.873542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2789842b-cafa-490d-b8e8-99a0c61c7d73 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082446 May 12 07:17:58.874123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1330/2571] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:58 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:58.886098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7a98a1b4-d96e-4d1c-9bfc-322024c90056 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:58.886782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7a98a1b4-d96e-4d1c-9bfc-322024c90056 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:58.898033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a98a1b4-d96e-4d1c-9bfc-322024c90056 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:58.898486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a98a1b4-d96e-4d1c-9bfc-322024c90056 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:58.899265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a98a1b4-d96e-4d1c-9bfc-322024c90056 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:58.899723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7a98a1b4-d96e-4d1c-9bfc-322024c90056 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:59.025181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7a98a1b4-d96e-4d1c-9bfc-322024c90056 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:59.033013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7a98a1b4-d96e-4d1c-9bfc-322024c90056 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150700 May 12 07:17:59.033578 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1242/2572] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:58 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:17:59.890258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-02de8678-4cb7-47ce-8352-579bc74b760c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:17:59.890871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-02de8678-4cb7-47ce-8352-579bc74b760c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:17:59.897209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-02de8678-4cb7-47ce-8352-579bc74b760c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:59.897654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-02de8678-4cb7-47ce-8352-579bc74b760c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:59.898418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-02de8678-4cb7-47ce-8352-579bc74b760c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:17:59.898848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-02de8678-4cb7-47ce-8352-579bc74b760c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:17:59.962845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-02de8678-4cb7-47ce-8352-579bc74b760c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:17:59.971251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-02de8678-4cb7-47ce-8352-579bc74b760c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084873 May 12 07:17:59.971836 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1331/2573] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:17:59 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:00.050774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-709854d8-2463-45d7-a352-f4b6a19c9c08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:00.051399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-709854d8-2463-45d7-a352-f4b6a19c9c08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:00.057697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-709854d8-2463-45d7-a352-f4b6a19c9c08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:00.058157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-709854d8-2463-45d7-a352-f4b6a19c9c08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:00.058930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-709854d8-2463-45d7-a352-f4b6a19c9c08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:00.059371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-709854d8-2463-45d7-a352-f4b6a19c9c08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:00.188344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-709854d8-2463-45d7-a352-f4b6a19c9c08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:00.196187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-709854d8-2463-45d7-a352-f4b6a19c9c08 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150165 May 12 07:18:00.196782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1243/2574] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:00 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:00.988592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dc6f5141-0702-4c9e-b424-894ecba4e0a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:00.989216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dc6f5141-0702-4c9e-b424-894ecba4e0a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:00.995297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc6f5141-0702-4c9e-b424-894ecba4e0a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:00.995777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc6f5141-0702-4c9e-b424-894ecba4e0a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:00.996561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc6f5141-0702-4c9e-b424-894ecba4e0a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:00.997031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc6f5141-0702-4c9e-b424-894ecba4e0a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:01.058221 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dc6f5141-0702-4c9e-b424-894ecba4e0a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:01.066637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dc6f5141-0702-4c9e-b424-894ecba4e0a0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082485 May 12 07:18:01.067206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1332/2575] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:00 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:01.213324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8c7f0355-ff1b-4134-8773-c09f9958628a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:01.213939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8c7f0355-ff1b-4134-8773-c09f9958628a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:01.220435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c7f0355-ff1b-4134-8773-c09f9958628a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:01.220879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c7f0355-ff1b-4134-8773-c09f9958628a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:01.221642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c7f0355-ff1b-4134-8773-c09f9958628a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:01.222077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c7f0355-ff1b-4134-8773-c09f9958628a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:01.343411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8c7f0355-ff1b-4134-8773-c09f9958628a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:01.351772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8c7f0355-ff1b-4134-8773-c09f9958628a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.142190 May 12 07:18:01.352273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1244/2576] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:01 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:02.084004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6b31132d-1d13-47e7-bd22-e3540eb5f4da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:02.084625 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6b31132d-1d13-47e7-bd22-e3540eb5f4da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:02.091002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b31132d-1d13-47e7-bd22-e3540eb5f4da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:02.091453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b31132d-1d13-47e7-bd22-e3540eb5f4da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:02.092248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b31132d-1d13-47e7-bd22-e3540eb5f4da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:02.092690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6b31132d-1d13-47e7-bd22-e3540eb5f4da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:02.156333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6b31132d-1d13-47e7-bd22-e3540eb5f4da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:02.164147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6b31132d-1d13-47e7-bd22-e3540eb5f4da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084063 May 12 07:18:02.164710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1333/2577] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:02 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:02.369103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f9f5969b-968e-4cb3-8d0e-068aaf2cf7bd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:02.369644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f9f5969b-968e-4cb3-8d0e-068aaf2cf7bd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:02.376685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9f5969b-968e-4cb3-8d0e-068aaf2cf7bd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:02.377133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9f5969b-968e-4cb3-8d0e-068aaf2cf7bd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:02.377888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9f5969b-968e-4cb3-8d0e-068aaf2cf7bd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:02.378321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9f5969b-968e-4cb3-8d0e-068aaf2cf7bd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:02.501674 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f9f5969b-968e-4cb3-8d0e-068aaf2cf7bd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:02.509565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f9f5969b-968e-4cb3-8d0e-068aaf2cf7bd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144312 May 12 07:18:02.510141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1245/2578] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:02 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:03.180989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fb6f14b5-c66f-492c-a630-e51d8b50ad37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:03.181594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fb6f14b5-c66f-492c-a630-e51d8b50ad37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:03.187843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb6f14b5-c66f-492c-a630-e51d8b50ad37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:03.188292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb6f14b5-c66f-492c-a630-e51d8b50ad37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:03.189056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb6f14b5-c66f-492c-a630-e51d8b50ad37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:03.189489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb6f14b5-c66f-492c-a630-e51d8b50ad37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:03.248842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fb6f14b5-c66f-492c-a630-e51d8b50ad37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:03.256492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fb6f14b5-c66f-492c-a630-e51d8b50ad37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079376 May 12 07:18:03.257056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1334/2579] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:03 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:03.526270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3ec15012-495c-45e8-8121-2587496c98ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:03.526791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3ec15012-495c-45e8-8121-2587496c98ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:03.533088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ec15012-495c-45e8-8121-2587496c98ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:03.533529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ec15012-495c-45e8-8121-2587496c98ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:03.534283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ec15012-495c-45e8-8121-2587496c98ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:03.534714 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ec15012-495c-45e8-8121-2587496c98ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:03.665554 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3ec15012-495c-45e8-8121-2587496c98ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:03.674145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3ec15012-495c-45e8-8121-2587496c98ec tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.151617 May 12 07:18:03.674744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1246/2580] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:03 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:04.273165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b627ac31-8e1f-42d1-bed3-d799a05615ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:04.273777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b627ac31-8e1f-42d1-bed3-d799a05615ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:04.280149 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b627ac31-8e1f-42d1-bed3-d799a05615ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:04.280590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b627ac31-8e1f-42d1-bed3-d799a05615ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:04.281351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b627ac31-8e1f-42d1-bed3-d799a05615ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:04.281782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b627ac31-8e1f-42d1-bed3-d799a05615ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:04.341530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b627ac31-8e1f-42d1-bed3-d799a05615ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:04.349522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b627ac31-8e1f-42d1-bed3-d799a05615ec tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080180 May 12 07:18:04.350286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1335/2581] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:04 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:04.692259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a41c0845-ca95-4862-8fdc-5d2a55ce845d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:04.692876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a41c0845-ca95-4862-8fdc-5d2a55ce845d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:04.699225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a41c0845-ca95-4862-8fdc-5d2a55ce845d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:04.699673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a41c0845-ca95-4862-8fdc-5d2a55ce845d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:04.700467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a41c0845-ca95-4862-8fdc-5d2a55ce845d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:04.700897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a41c0845-ca95-4862-8fdc-5d2a55ce845d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:04.827064 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a41c0845-ca95-4862-8fdc-5d2a55ce845d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:04.834923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a41c0845-ca95-4862-8fdc-5d2a55ce845d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148521 May 12 07:18:04.835486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1247/2582] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:04 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:05.366015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c0c07ab1-b703-4bc3-8fb7-3d6189c69ba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:05.366630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c0c07ab1-b703-4bc3-8fb7-3d6189c69ba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:05.372911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0c07ab1-b703-4bc3-8fb7-3d6189c69ba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:05.373356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0c07ab1-b703-4bc3-8fb7-3d6189c69ba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:05.374119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0c07ab1-b703-4bc3-8fb7-3d6189c69ba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:05.374552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c0c07ab1-b703-4bc3-8fb7-3d6189c69ba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:05.437543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c0c07ab1-b703-4bc3-8fb7-3d6189c69ba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:05.445252 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c0c07ab1-b703-4bc3-8fb7-3d6189c69ba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083102 May 12 07:18:05.445815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1336/2583] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:05 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:05.851789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9077f6e4-7fad-42f8-86e4-1230ea3c1175 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:05.852402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9077f6e4-7fad-42f8-86e4-1230ea3c1175 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:05.858641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9077f6e4-7fad-42f8-86e4-1230ea3c1175 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:05.859094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9077f6e4-7fad-42f8-86e4-1230ea3c1175 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:05.859903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9077f6e4-7fad-42f8-86e4-1230ea3c1175 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:05.860336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9077f6e4-7fad-42f8-86e4-1230ea3c1175 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:05.984035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9077f6e4-7fad-42f8-86e4-1230ea3c1175 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:05.992371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9077f6e4-7fad-42f8-86e4-1230ea3c1175 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144389 May 12 07:18:05.993114 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1248/2584] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:05 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:06.461953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2eb8b7f1-14c6-44fc-956a-6a3d27619eff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:06.462574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2eb8b7f1-14c6-44fc-956a-6a3d27619eff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:06.469446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2eb8b7f1-14c6-44fc-956a-6a3d27619eff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:06.469899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2eb8b7f1-14c6-44fc-956a-6a3d27619eff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:06.470672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2eb8b7f1-14c6-44fc-956a-6a3d27619eff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:06.471115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2eb8b7f1-14c6-44fc-956a-6a3d27619eff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:06.533031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2eb8b7f1-14c6-44fc-956a-6a3d27619eff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:06.540804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2eb8b7f1-14c6-44fc-956a-6a3d27619eff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082767 May 12 07:18:06.541369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1337/2585] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:06 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:07.009447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ca3e0395-7481-4938-8614-f8d5a1164485 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:07.010099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ca3e0395-7481-4938-8614-f8d5a1164485 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:07.017095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca3e0395-7481-4938-8614-f8d5a1164485 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:07.017550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca3e0395-7481-4938-8614-f8d5a1164485 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:07.018314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca3e0395-7481-4938-8614-f8d5a1164485 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:07.018773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ca3e0395-7481-4938-8614-f8d5a1164485 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:07.148526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ca3e0395-7481-4938-8614-f8d5a1164485 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:07.156838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ca3e0395-7481-4938-8614-f8d5a1164485 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150635 May 12 07:18:07.157404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1249/2586] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:07 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:07.558909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d252fb6e-ebc7-46a9-9cc3-4e42b22c18a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:07.559457 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d252fb6e-ebc7-46a9-9cc3-4e42b22c18a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:07.566310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d252fb6e-ebc7-46a9-9cc3-4e42b22c18a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:07.566759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d252fb6e-ebc7-46a9-9cc3-4e42b22c18a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:07.567525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d252fb6e-ebc7-46a9-9cc3-4e42b22c18a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:07.567990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d252fb6e-ebc7-46a9-9cc3-4e42b22c18a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:07.626314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d252fb6e-ebc7-46a9-9cc3-4e42b22c18a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:07.634661 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d252fb6e-ebc7-46a9-9cc3-4e42b22c18a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079686 May 12 07:18:07.635227 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1338/2587] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:07 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:08.173759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8016180b-f6d0-4a42-b323-57718f151099 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:08.174395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8016180b-f6d0-4a42-b323-57718f151099 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:08.180817 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8016180b-f6d0-4a42-b323-57718f151099 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:08.181264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8016180b-f6d0-4a42-b323-57718f151099 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:08.182018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8016180b-f6d0-4a42-b323-57718f151099 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:08.182453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8016180b-f6d0-4a42-b323-57718f151099 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:08.305475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8016180b-f6d0-4a42-b323-57718f151099 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:08.313528 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8016180b-f6d0-4a42-b323-57718f151099 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144464 May 12 07:18:08.314105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1250/2588] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:08 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:08.651306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e41573ce-e890-4a3c-b7ff-66c263f6bc68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:08.651963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e41573ce-e890-4a3c-b7ff-66c263f6bc68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:08.658824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e41573ce-e890-4a3c-b7ff-66c263f6bc68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:08.659282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e41573ce-e890-4a3c-b7ff-66c263f6bc68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:08.660081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e41573ce-e890-4a3c-b7ff-66c263f6bc68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:08.660526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e41573ce-e890-4a3c-b7ff-66c263f6bc68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:08.724892 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e41573ce-e890-4a3c-b7ff-66c263f6bc68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:08.733499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e41573ce-e890-4a3c-b7ff-66c263f6bc68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085963 May 12 07:18:08.734091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1339/2589] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:08 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:09.330381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5107ef6a-cf18-4002-8492-2b3dc2ee6d37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:09.331009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5107ef6a-cf18-4002-8492-2b3dc2ee6d37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:09.337324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5107ef6a-cf18-4002-8492-2b3dc2ee6d37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:09.337806 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5107ef6a-cf18-4002-8492-2b3dc2ee6d37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:09.338574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5107ef6a-cf18-4002-8492-2b3dc2ee6d37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:09.339026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5107ef6a-cf18-4002-8492-2b3dc2ee6d37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:09.462286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5107ef6a-cf18-4002-8492-2b3dc2ee6d37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:09.470470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5107ef6a-cf18-4002-8492-2b3dc2ee6d37 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144032 May 12 07:18:09.471036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1251/2590] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:09 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:09.750117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3211604b-880b-41f4-933d-ac637e60f2f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:09.750730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3211604b-880b-41f4-933d-ac637e60f2f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:09.757000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3211604b-880b-41f4-933d-ac637e60f2f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:09.757447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3211604b-880b-41f4-933d-ac637e60f2f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:09.758240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3211604b-880b-41f4-933d-ac637e60f2f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:09.758675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3211604b-880b-41f4-933d-ac637e60f2f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:09.818054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3211604b-880b-41f4-933d-ac637e60f2f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:09.825665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3211604b-880b-41f4-933d-ac637e60f2f5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079379 May 12 07:18:09.826233 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1340/2591] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:09 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:10.487160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-61cb940f-275b-47cd-aa9c-8c29ef3cdf49 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:10.487794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-61cb940f-275b-47cd-aa9c-8c29ef3cdf49 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:10.494009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61cb940f-275b-47cd-aa9c-8c29ef3cdf49 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:10.494454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61cb940f-275b-47cd-aa9c-8c29ef3cdf49 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:10.495209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61cb940f-275b-47cd-aa9c-8c29ef3cdf49 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:10.495645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61cb940f-275b-47cd-aa9c-8c29ef3cdf49 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:10.622288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-61cb940f-275b-47cd-aa9c-8c29ef3cdf49 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:10.630612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-61cb940f-275b-47cd-aa9c-8c29ef3cdf49 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147300 May 12 07:18:10.631173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1252/2592] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:10 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:10.842197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-60e5609d-6488-4212-92dc-1aa432414595 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:10.842810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-60e5609d-6488-4212-92dc-1aa432414595 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:10.849490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60e5609d-6488-4212-92dc-1aa432414595 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:10.849935 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60e5609d-6488-4212-92dc-1aa432414595 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:10.850696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60e5609d-6488-4212-92dc-1aa432414595 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:10.851128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-60e5609d-6488-4212-92dc-1aa432414595 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:10.910580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-60e5609d-6488-4212-92dc-1aa432414595 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:10.918265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-60e5609d-6488-4212-92dc-1aa432414595 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079865 May 12 07:18:10.918860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1341/2593] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:10 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:11.647938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-63c4ad6a-edb3-43b2-8e12-d4cbd352241f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:11.648484 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-63c4ad6a-edb3-43b2-8e12-d4cbd352241f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:11.654773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63c4ad6a-edb3-43b2-8e12-d4cbd352241f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:11.655225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63c4ad6a-edb3-43b2-8e12-d4cbd352241f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:11.656625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63c4ad6a-edb3-43b2-8e12-d4cbd352241f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:11.657066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-63c4ad6a-edb3-43b2-8e12-d4cbd352241f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:11.781917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-63c4ad6a-edb3-43b2-8e12-d4cbd352241f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:11.789858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-63c4ad6a-edb3-43b2-8e12-d4cbd352241f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146101 May 12 07:18:11.790431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1253/2594] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:11 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:11.935894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9fbfb1e8-3e79-4202-80d8-e324a032602e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:11.936431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9fbfb1e8-3e79-4202-80d8-e324a032602e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:11.943160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9fbfb1e8-3e79-4202-80d8-e324a032602e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:11.943603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9fbfb1e8-3e79-4202-80d8-e324a032602e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:11.944660 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9fbfb1e8-3e79-4202-80d8-e324a032602e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:11.945100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9fbfb1e8-3e79-4202-80d8-e324a032602e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:12.008291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9fbfb1e8-3e79-4202-80d8-e324a032602e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:12.016643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9fbfb1e8-3e79-4202-80d8-e324a032602e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084658 May 12 07:18:12.017206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1342/2595] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:11 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:12.807450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-08fff447-6b3d-4fb0-b3cb-e2d8a43060eb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:12.808085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-08fff447-6b3d-4fb0-b3cb-e2d8a43060eb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:12.814382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08fff447-6b3d-4fb0-b3cb-e2d8a43060eb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:12.814829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08fff447-6b3d-4fb0-b3cb-e2d8a43060eb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:12.815582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08fff447-6b3d-4fb0-b3cb-e2d8a43060eb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:12.816038 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08fff447-6b3d-4fb0-b3cb-e2d8a43060eb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:12.939808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-08fff447-6b3d-4fb0-b3cb-e2d8a43060eb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:12.947763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-08fff447-6b3d-4fb0-b3cb-e2d8a43060eb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144145 May 12 07:18:12.948353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1254/2596] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:12 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:13.033844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d6c15ca9-c758-4683-ba0a-df17f467abe2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:13.034454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d6c15ca9-c758-4683-ba0a-df17f467abe2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:13.040741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c15ca9-c758-4683-ba0a-df17f467abe2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:13.041192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c15ca9-c758-4683-ba0a-df17f467abe2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:13.041955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c15ca9-c758-4683-ba0a-df17f467abe2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:13.042392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d6c15ca9-c758-4683-ba0a-df17f467abe2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:13.102392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d6c15ca9-c758-4683-ba0a-df17f467abe2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:13.110211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d6c15ca9-c758-4683-ba0a-df17f467abe2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080839 May 12 07:18:13.110778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1343/2597] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:13 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:13.965047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4cba7d03-cbb6-4ab6-b49c-8f36f4017fea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:13.965662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4cba7d03-cbb6-4ab6-b49c-8f36f4017fea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:13.972540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4cba7d03-cbb6-4ab6-b49c-8f36f4017fea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:13.972996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4cba7d03-cbb6-4ab6-b49c-8f36f4017fea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:13.973821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4cba7d03-cbb6-4ab6-b49c-8f36f4017fea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:13.974259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4cba7d03-cbb6-4ab6-b49c-8f36f4017fea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:14.106261 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4cba7d03-cbb6-4ab6-b49c-8f36f4017fea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:14.114705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4cba7d03-cbb6-4ab6-b49c-8f36f4017fea tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.153584 May 12 07:18:14.115284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1255/2598] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:13 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:14.126150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7747c57a-b4fb-4758-9e36-126a994deebe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:14.126769 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7747c57a-b4fb-4758-9e36-126a994deebe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:14.132989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7747c57a-b4fb-4758-9e36-126a994deebe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:14.133440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7747c57a-b4fb-4758-9e36-126a994deebe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:14.134213 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7747c57a-b4fb-4758-9e36-126a994deebe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:14.134651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7747c57a-b4fb-4758-9e36-126a994deebe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:14.196825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7747c57a-b4fb-4758-9e36-126a994deebe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:14.204548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7747c57a-b4fb-4758-9e36-126a994deebe tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082226 May 12 07:18:14.205126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1344/2599] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:14 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:15.131745 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c76600a1-5f6d-47dd-95f3-d5516437ea02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:15.132370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c76600a1-5f6d-47dd-95f3-d5516437ea02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:15.138711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c76600a1-5f6d-47dd-95f3-d5516437ea02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:15.139163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c76600a1-5f6d-47dd-95f3-d5516437ea02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:15.139965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c76600a1-5f6d-47dd-95f3-d5516437ea02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:15.140406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c76600a1-5f6d-47dd-95f3-d5516437ea02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:15.221170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e193e16e-23ab-421b-ac4a-7e53affd4454 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:15.221791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e193e16e-23ab-421b-ac4a-7e53affd4454 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:15.228136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e193e16e-23ab-421b-ac4a-7e53affd4454 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:15.228592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e193e16e-23ab-421b-ac4a-7e53affd4454 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:15.229368 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e193e16e-23ab-421b-ac4a-7e53affd4454 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:15.229807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e193e16e-23ab-421b-ac4a-7e53affd4454 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:15.268046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c76600a1-5f6d-47dd-95f3-d5516437ea02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:15.275969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c76600a1-5f6d-47dd-95f3-d5516437ea02 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148074 May 12 07:18:15.276638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1256/2600] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:15 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:15.296239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e193e16e-23ab-421b-ac4a-7e53affd4454 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:15.304744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e193e16e-23ab-421b-ac4a-7e53affd4454 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.087482 May 12 07:18:15.305310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1345/2601] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:15 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:16.003736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-edb3f8a9-a397-4e88-9152-a10825528228 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:16.004906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-edb3f8a9-a397-4e88-9152-a10825528228 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:16.009983 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edb3f8a9-a397-4e88-9152-a10825528228 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:16.010415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edb3f8a9-a397-4e88-9152-a10825528228 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:16.011168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edb3f8a9-a397-4e88-9152-a10825528228 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:16.011601 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-edb3f8a9-a397-4e88-9152-a10825528228 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:16.036632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-edb3f8a9-a397-4e88-9152-a10825528228 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Going to try to terminate instance {{(pid=124024) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:18:16.292955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-27b27145-bf69-41ee-bba1-a70c80f81793 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:16.293560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-27b27145-bf69-41ee-bba1-a70c80f81793 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:16.300005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27b27145-bf69-41ee-bba1-a70c80f81793 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:16.300455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27b27145-bf69-41ee-bba1-a70c80f81793 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:16.301243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27b27145-bf69-41ee-bba1-a70c80f81793 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:16.301679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27b27145-bf69-41ee-bba1-a70c80f81793 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:16.303641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-edb3f8a9-a397-4e88-9152-a10825528228 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 204 len: 0 microversion: 2.20 time: 0.303596 May 12 07:18:16.304313 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1257/2602] 10.222.0.25 () {60 vars in 1279 bytes} [Thu May 12 07:18:15 2022] DELETE /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 07:18:16.313387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e5987a64-bf5d-41d0-a03e-60f6bab2a34b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:16.315019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e5987a64-bf5d-41d0-a03e-60f6bab2a34b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:16.320172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5987a64-bf5d-41d0-a03e-60f6bab2a34b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:16.320618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5987a64-bf5d-41d0-a03e-60f6bab2a34b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:16.321386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5987a64-bf5d-41d0-a03e-60f6bab2a34b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:16.321850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5987a64-bf5d-41d0-a03e-60f6bab2a34b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:16.498875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-27b27145-bf69-41ee-bba1-a70c80f81793 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:16.502286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e5987a64-bf5d-41d0-a03e-60f6bab2a34b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:16.507454 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-27b27145-bf69-41ee-bba1-a70c80f81793 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.218461 May 12 07:18:16.508074 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1346/2603] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:16 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:16.510762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e5987a64-bf5d-41d0-a03e-60f6bab2a34b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:16.512303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e5987a64-bf5d-41d0-a03e-60f6bab2a34b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:16.512971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-15b5dc1a-c237-4b14-beac-4aa9c508fef1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:16.513465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e5987a64-bf5d-41d0-a03e-60f6bab2a34b tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1726 microversion: 2.20 time: 0.204933 May 12 07:18:16.513590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-15b5dc1a-c237-4b14-beac-4aa9c508fef1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:16.514144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1258/2604] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:18:16 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1726 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:18:16.520096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15b5dc1a-c237-4b14-beac-4aa9c508fef1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:16.520550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15b5dc1a-c237-4b14-beac-4aa9c508fef1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:16.521352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15b5dc1a-c237-4b14-beac-4aa9c508fef1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:16.521788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15b5dc1a-c237-4b14-beac-4aa9c508fef1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:16.581097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-15b5dc1a-c237-4b14-beac-4aa9c508fef1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:16.588734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-15b5dc1a-c237-4b14-beac-4aa9c508fef1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079739 May 12 07:18:16.589309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1347/2605] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:16 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:17.525357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ef84f325-b906-441e-98dc-4d264b3a8550 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:17.525904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ef84f325-b906-441e-98dc-4d264b3a8550 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:17.531833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b115592c-922a-406d-971a-1c02f8985d32 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:17.532485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b115592c-922a-406d-971a-1c02f8985d32 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:17.532812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef84f325-b906-441e-98dc-4d264b3a8550 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:17.533262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef84f325-b906-441e-98dc-4d264b3a8550 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:17.534025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef84f325-b906-441e-98dc-4d264b3a8550 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:17.534461 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ef84f325-b906-441e-98dc-4d264b3a8550 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:17.538892 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b115592c-922a-406d-971a-1c02f8985d32 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:17.539421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b115592c-922a-406d-971a-1c02f8985d32 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:17.540272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b115592c-922a-406d-971a-1c02f8985d32 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:17.540711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b115592c-922a-406d-971a-1c02f8985d32 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:17.719776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ef84f325-b906-441e-98dc-4d264b3a8550 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:17.723750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b115592c-922a-406d-971a-1c02f8985d32 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:17.727533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ef84f325-b906-441e-98dc-4d264b3a8550 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.206078 May 12 07:18:17.728133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1259/2606] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:17 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:17.731678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b115592c-922a-406d-971a-1c02f8985d32 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:17.733198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b115592c-922a-406d-971a-1c02f8985d32 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:17.734396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b115592c-922a-406d-971a-1c02f8985d32 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1726 microversion: 2.20 time: 0.207021 May 12 07:18:17.734953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1348/2607] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:18:17 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1726 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:18:17.738719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a48e7cc6-c1dd-4b07-bc44-6a15bb770f85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:17.739328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a48e7cc6-c1dd-4b07-bc44-6a15bb770f85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:17.745098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a48e7cc6-c1dd-4b07-bc44-6a15bb770f85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:17.745557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a48e7cc6-c1dd-4b07-bc44-6a15bb770f85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:17.746326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a48e7cc6-c1dd-4b07-bc44-6a15bb770f85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:17.746762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a48e7cc6-c1dd-4b07-bc44-6a15bb770f85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:17.808263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a48e7cc6-c1dd-4b07-bc44-6a15bb770f85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:17.816588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a48e7cc6-c1dd-4b07-bc44-6a15bb770f85 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.087488 May 12 07:18:17.817159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1260/2608] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:17 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:18.637405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-cb8f6d20-e28a-4424-8adc-37b4a8474a98 req-91e293be-9d3d-4f01-a870-9c452a2f8a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9d2e6e-f408-4987-a812-3dd0f6d0742f", "name": "network-vif-deleted", "tag": "8f43fec4-b860-4fc5-9ded-48592ff90c21"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:18:18.645870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-cb8f6d20-e28a-4424-8adc-37b4a8474a98 req-91e293be-9d3d-4f01-a870-9c452a2f8a4a service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:18.647283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-cb8f6d20-e28a-4424-8adc-37b4a8474a98 req-91e293be-9d3d-4f01-a870-9c452a2f8a4a service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:18.658300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-cb8f6d20-e28a-4424-8adc-37b4a8474a98 req-91e293be-9d3d-4f01-a870-9c452a2f8a4a service nova] Creating event network-vif-deleted:8f43fec4-b860-4fc5-9ded-48592ff90c21 for instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f on hv-cinder-76606 May 12 07:18:18.663882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-cb8f6d20-e28a-4424-8adc-37b4a8474a98 req-91e293be-9d3d-4f01-a870-9c452a2f8a4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030597 May 12 07:18:18.664863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1349/2609] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:18:18.745209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e270e7b6-7e94-4b9c-a07f-b492d97c1434 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:18.745859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e270e7b6-7e94-4b9c-a07f-b492d97c1434 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:18.753106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e270e7b6-7e94-4b9c-a07f-b492d97c1434 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:18.753715 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e270e7b6-7e94-4b9c-a07f-b492d97c1434 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:18.754559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e270e7b6-7e94-4b9c-a07f-b492d97c1434 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:18.754990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e270e7b6-7e94-4b9c-a07f-b492d97c1434 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:18.755635 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-97f64a25-d980-4361-94f9-8b4efcea8875 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:18.762381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-97f64a25-d980-4361-94f9-8b4efcea8875 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:18.767300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97f64a25-d980-4361-94f9-8b4efcea8875 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:18.767797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97f64a25-d980-4361-94f9-8b4efcea8875 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:18.768593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97f64a25-d980-4361-94f9-8b4efcea8875 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:18.769031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-97f64a25-d980-4361-94f9-8b4efcea8875 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:18.874435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97f64a25-d980-4361-94f9-8b4efcea8875 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:18.883211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97f64a25-d980-4361-94f9-8b4efcea8875 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:18.885052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-97f64a25-d980-4361-94f9-8b4efcea8875 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:18.886532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-97f64a25-d980-4361-94f9-8b4efcea8875 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 200 len: 1367 microversion: 2.20 time: 0.137685 May 12 07:18:18.897405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1350/2610] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:18:18 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 1367 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 07:18:18.897405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-eaa75c0f-87b5-4a2d-bd25-0f38b21bd89c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:18.897405 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-eaa75c0f-87b5-4a2d-bd25-0f38b21bd89c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:18.900520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eaa75c0f-87b5-4a2d-bd25-0f38b21bd89c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:18.901114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eaa75c0f-87b5-4a2d-bd25-0f38b21bd89c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:18.902123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eaa75c0f-87b5-4a2d-bd25-0f38b21bd89c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:18.905403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-eaa75c0f-87b5-4a2d-bd25-0f38b21bd89c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:18.941795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e270e7b6-7e94-4b9c-a07f-b492d97c1434 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:18.950336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e270e7b6-7e94-4b9c-a07f-b492d97c1434 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.209711 May 12 07:18:18.951103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1261/2611] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:18 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:18.976668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-eaa75c0f-87b5-4a2d-bd25-0f38b21bd89c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:18.984999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-eaa75c0f-87b5-4a2d-bd25-0f38b21bd89c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.096431 May 12 07:18:18.986181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1351/2612] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:18 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:19.904547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8f711bce-a6a3-4b12-8789-686af2556095 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:19.905164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8f711bce-a6a3-4b12-8789-686af2556095 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:19.911539 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8f711bce-a6a3-4b12-8789-686af2556095 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:19.912023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8f711bce-a6a3-4b12-8789-686af2556095 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:19.912790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8f711bce-a6a3-4b12-8789-686af2556095 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:19.913229 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8f711bce-a6a3-4b12-8789-686af2556095 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:19.926861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-8f711bce-a6a3-4b12-8789-686af2556095 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] HTTP exception thrown: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8f711bce-a6a3-4b12-8789-686af2556095 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Request method failure captured: May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f HTTP/1.1 May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK7OQOivTsMgpZyHOVOCIuxXplIEposnic7rKRniAYsa4O8Tyt166YY_PtYOUieQ64ALZ8C8Zy0szDT3TMaFyy3zTnnaxhvUYGVx6d2mtBo2ZOyzKwxkrb6JAwxhGOn6Rp_58GIaPe3Y6A8ELjt9cQvSFKaK1YtHGil4-rSs1RnIKDQ May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Openstack-Nova-Api-Version: 2.20 May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: d3c6164700aa4d2a87819ad713a5fa37 May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:18:19.928509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3c6164700aa4d2a87819ad713a5fa37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3c6164700aa4d2a87819ad713a5fa37", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3c6164700aa4d2a87819ad713a5fa37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3c6164700aa4d2a87819ad713a5fa37"}]}] May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: d3c6164700aa4d2a87819ad713a5fa37 May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeShelveTestJSON-507767302-project May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 4097ea09148b4093914d1c4796e05df8 May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeShelveTestJSON-507767302-project May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:19.930390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '8f9d2e6e-f408-4987-a812-3dd0f6d0742f'} May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:18:19.931538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:19.933156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:18:19.934696 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8f711bce-a6a3-4b12-8789-686af2556095 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Returning 404 to user: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:18:19.934696 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8f711bce-a6a3-4b12-8789-686af2556095 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 404 len: 111 microversion: 2.20 time: 0.029233 May 12 07:18:19.934696 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1262/2613] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:18:19 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 07:18:19.939052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a24db6dd-e80d-4dbd-9d1f-47f51b1d55e4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '.version_select at 0x7f89df4b7c10>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:19.968603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-14049d44-05bd-4e49-b061-041a6db74a26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:19.969346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-14049d44-05bd-4e49-b061-041a6db74a26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:19.975310 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14049d44-05bd-4e49-b061-041a6db74a26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:19.975794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14049d44-05bd-4e49-b061-041a6db74a26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:19.976572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14049d44-05bd-4e49-b061-041a6db74a26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:19.977014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-14049d44-05bd-4e49-b061-041a6db74a26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:20.019307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a24db6dd-e80d-4dbd-9d1f-47f51b1d55e4 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939324226" status: 204 len: 0 microversion: 2.20 time: 0.084587 May 12 07:18:20.023335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1352/2614] 10.222.0.25 () {60 vars in 1261 bytes} [Thu May 12 07:18:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939324226 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 12 07:18:20.028817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ee1bc90d-dd92-444e-ab5e-ad75ead39425 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:20.028817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ee1bc90d-dd92-444e-ab5e-ad75ead39425 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:20.032674 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee1bc90d-dd92-444e-ab5e-ad75ead39425 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:20.033127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee1bc90d-dd92-444e-ab5e-ad75ead39425 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:20.033939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee1bc90d-dd92-444e-ab5e-ad75ead39425 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:20.034382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ee1bc90d-dd92-444e-ab5e-ad75ead39425 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:20.118788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ee1bc90d-dd92-444e-ab5e-ad75ead39425 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:20.126889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ee1bc90d-dd92-444e-ab5e-ad75ead39425 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.105847 May 12 07:18:20.132990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1353/2615] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:20 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:20.133255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-14049d44-05bd-4e49-b061-041a6db74a26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:20.141042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-14049d44-05bd-4e49-b061-041a6db74a26 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.176644 May 12 07:18:20.141691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1263/2616] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:19 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:20.758820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8783c05d-aab3-4f78-8f0d-1e89388ed719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:20.759314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8783c05d-aab3-4f78-8f0d-1e89388ed719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:20.765881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8783c05d-aab3-4f78-8f0d-1e89388ed719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:20.766325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8783c05d-aab3-4f78-8f0d-1e89388ed719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:20.767084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8783c05d-aab3-4f78-8f0d-1e89388ed719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:20.767515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8783c05d-aab3-4f78-8f0d-1e89388ed719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:20.780384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-8783c05d-aab3-4f78-8f0d-1e89388ed719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] HTTP exception thrown: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8783c05d-aab3-4f78-8f0d-1e89388ed719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Request method failure captured: May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: DELETE /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f HTTP/1.1 May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK7OQOivTsMgpZyHOVOCIuxXplIEposnic7rKRniAYsa4O8Tyt166YY_PtYOUieQ64ALZ8C8Zy0szDT3TMaFyy3zTnnaxhvUYGVx6d2mtBo2ZOyzKwxkrb6JAwxhGOn6Rp_58GIaPe3Y6A8ELjt9cQvSFKaK1YtHGil4-rSs1RnIKDQ May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Openstack-Nova-Api-Version: 2.20 May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: d3c6164700aa4d2a87819ad713a5fa37 May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:18:20.782059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3c6164700aa4d2a87819ad713a5fa37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3c6164700aa4d2a87819ad713a5fa37", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3c6164700aa4d2a87819ad713a5fa37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3c6164700aa4d2a87819ad713a5fa37"}]}] May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: d3c6164700aa4d2a87819ad713a5fa37 May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-AttachVolumeShelveTestJSON-507767302-project May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 4097ea09148b4093914d1c4796e05df8 May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-AttachVolumeShelveTestJSON-507767302-project May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:20.783805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': '8f9d2e6e-f408-4987-a812-3dd0f6d0742f'} May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:18:20.784785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:20.786305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:18:20.787880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8783c05d-aab3-4f78-8f0d-1e89388ed719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Returning 404 to user: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:18:20.787880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8783c05d-aab3-4f78-8f0d-1e89388ed719 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 404 len: 111 microversion: 2.20 time: 0.028563 May 12 07:18:20.787880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1354/2617] 10.222.0.25 () {60 vars in 1279 bytes} [Thu May 12 07:18:20 2022] DELETE /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 07:18:20.791867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-31cbff2e-8baa-4a72-b11d-8adb64c01a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:20.792486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-31cbff2e-8baa-4a72-b11d-8adb64c01a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: 8f9d2e6e-f408-4987-a812-3dd0f6d0742f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:20.798745 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31cbff2e-8baa-4a72-b11d-8adb64c01a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:20.799193 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31cbff2e-8baa-4a72-b11d-8adb64c01a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:20.800047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31cbff2e-8baa-4a72-b11d-8adb64c01a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:20.800489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31cbff2e-8baa-4a72-b11d-8adb64c01a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:20.813905 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-31cbff2e-8baa-4a72-b11d-8adb64c01a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] HTTP exception thrown: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-31cbff2e-8baa-4a72-b11d-8adb64c01a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Request method failure captured: May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f HTTP/1.1 May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK7OQOivTsMgpZyHOVOCIuxXplIEposnic7rKRniAYsa4O8Tyt166YY_PtYOUieQ64ALZ8C8Zy0szDT3TMaFyy3zTnnaxhvUYGVx6d2mtBo2ZOyzKwxkrb6JAwxhGOn6Rp_58GIaPe3Y6A8ELjt9cQvSFKaK1YtHGil4-rSs1RnIKDQ May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Openstack-Nova-Api-Version: 2.20 May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: d3c6164700aa4d2a87819ad713a5fa37 May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:18:20.815412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3c6164700aa4d2a87819ad713a5fa37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3c6164700aa4d2a87819ad713a5fa37", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3c6164700aa4d2a87819ad713a5fa37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3c6164700aa4d2a87819ad713a5fa37"}]}] May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: d3c6164700aa4d2a87819ad713a5fa37 May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeShelveTestJSON-507767302-project May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 4097ea09148b4093914d1c4796e05df8 May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeShelveTestJSON-507767302-project May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:20.817077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '8f9d2e6e-f408-4987-a812-3dd0f6d0742f'} May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:18:20.818205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. May 12 07:18:20.819712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:18:20.821390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-31cbff2e-8baa-4a72-b11d-8adb64c01a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Returning 404 to user: Instance 8f9d2e6e-f408-4987-a812-3dd0f6d0742f could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:18:20.821390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-31cbff2e-8baa-4a72-b11d-8adb64c01a68 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f" status: 404 len: 111 microversion: 2.20 time: 0.028900 May 12 07:18:20.821390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1264/2618] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:18:20 2022] GET /compute/v2.1/servers/8f9d2e6e-f408-4987-a812-3dd0f6d0742f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 12 07:18:21.143826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-482fe671-bedf-4e47-99a0-7353b2759ec2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:21.144447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-482fe671-bedf-4e47-99a0-7353b2759ec2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:21.150697 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-482fe671-bedf-4e47-99a0-7353b2759ec2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:21.151147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-482fe671-bedf-4e47-99a0-7353b2759ec2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:21.151946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-482fe671-bedf-4e47-99a0-7353b2759ec2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:21.152394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-482fe671-bedf-4e47-99a0-7353b2759ec2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:21.157654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3bbacea3-9f87-44bc-a9c3-ea157fd6c16b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:21.158279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3bbacea3-9f87-44bc-a9c3-ea157fd6c16b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:21.164443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3bbacea3-9f87-44bc-a9c3-ea157fd6c16b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:21.164903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3bbacea3-9f87-44bc-a9c3-ea157fd6c16b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:21.165681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3bbacea3-9f87-44bc-a9c3-ea157fd6c16b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:21.166125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3bbacea3-9f87-44bc-a9c3-ea157fd6c16b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:21.216383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-482fe671-bedf-4e47-99a0-7353b2759ec2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:21.224209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-482fe671-bedf-4e47-99a0-7353b2759ec2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084185 May 12 07:18:21.224781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1355/2619] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:21 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:21.305652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3bbacea3-9f87-44bc-a9c3-ea157fd6c16b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:21.314063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3bbacea3-9f87-44bc-a9c3-ea157fd6c16b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.160177 May 12 07:18:21.314632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1265/2620] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:21 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:22.240663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a27e51ea-69c6-4b65-9007-9b688cb8dccd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:22.241281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a27e51ea-69c6-4b65-9007-9b688cb8dccd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:22.247173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a27e51ea-69c6-4b65-9007-9b688cb8dccd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:22.247629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a27e51ea-69c6-4b65-9007-9b688cb8dccd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:22.248434 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a27e51ea-69c6-4b65-9007-9b688cb8dccd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:22.248875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a27e51ea-69c6-4b65-9007-9b688cb8dccd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:22.308189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a27e51ea-69c6-4b65-9007-9b688cb8dccd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:22.316390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a27e51ea-69c6-4b65-9007-9b688cb8dccd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079739 May 12 07:18:22.316961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1356/2621] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:22 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:22.330745 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-348346e0-d109-4e47-8126-ce197eb4adf1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:22.331291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-348346e0-d109-4e47-8126-ce197eb4adf1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:22.337772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-348346e0-d109-4e47-8126-ce197eb4adf1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:22.338233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-348346e0-d109-4e47-8126-ce197eb4adf1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:22.339006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-348346e0-d109-4e47-8126-ce197eb4adf1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:22.339448 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-348346e0-d109-4e47-8126-ce197eb4adf1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:22.466031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-348346e0-d109-4e47-8126-ce197eb4adf1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:22.473814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-348346e0-d109-4e47-8126-ce197eb4adf1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147554 May 12 07:18:22.474377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1266/2622] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:22 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:23.332705 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-909c5c37-2a56-4503-8903-1ee7c43ee490 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:23.333320 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-909c5c37-2a56-4503-8903-1ee7c43ee490 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:23.339641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-909c5c37-2a56-4503-8903-1ee7c43ee490 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:23.340121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-909c5c37-2a56-4503-8903-1ee7c43ee490 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:23.340894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-909c5c37-2a56-4503-8903-1ee7c43ee490 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:23.341332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-909c5c37-2a56-4503-8903-1ee7c43ee490 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:23.401352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-909c5c37-2a56-4503-8903-1ee7c43ee490 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:23.409618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-909c5c37-2a56-4503-8903-1ee7c43ee490 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080760 May 12 07:18:23.410187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1357/2623] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:23 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:23.490193 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-966b92ef-3f7d-40b6-b513-eb375930e9c8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:23.490834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-966b92ef-3f7d-40b6-b513-eb375930e9c8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:23.497130 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-966b92ef-3f7d-40b6-b513-eb375930e9c8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:23.497574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-966b92ef-3f7d-40b6-b513-eb375930e9c8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:23.498328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-966b92ef-3f7d-40b6-b513-eb375930e9c8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:23.498762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-966b92ef-3f7d-40b6-b513-eb375930e9c8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:23.623253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-966b92ef-3f7d-40b6-b513-eb375930e9c8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:23.630980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-966b92ef-3f7d-40b6-b513-eb375930e9c8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144653 May 12 07:18:23.631540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1267/2624] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:23 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:24.426850 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-69019a89-3f57-4cdb-879d-cbaa65c6e592 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:24.427461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-69019a89-3f57-4cdb-879d-cbaa65c6e592 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:24.433735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69019a89-3f57-4cdb-879d-cbaa65c6e592 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:24.434181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69019a89-3f57-4cdb-879d-cbaa65c6e592 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:24.434944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69019a89-3f57-4cdb-879d-cbaa65c6e592 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:24.435374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-69019a89-3f57-4cdb-879d-cbaa65c6e592 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:24.495220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-69019a89-3f57-4cdb-879d-cbaa65c6e592 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:24.502929 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-69019a89-3f57-4cdb-879d-cbaa65c6e592 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079857 May 12 07:18:24.503464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1358/2625] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:24 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:24.648066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-42053a8a-98cc-45b8-a44e-05a888f0d6ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:24.648608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-42053a8a-98cc-45b8-a44e-05a888f0d6ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:24.654969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42053a8a-98cc-45b8-a44e-05a888f0d6ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:24.655930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42053a8a-98cc-45b8-a44e-05a888f0d6ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:24.656688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42053a8a-98cc-45b8-a44e-05a888f0d6ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:24.657120 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-42053a8a-98cc-45b8-a44e-05a888f0d6ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:24.781360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-42053a8a-98cc-45b8-a44e-05a888f0d6ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:24.789060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-42053a8a-98cc-45b8-a44e-05a888f0d6ca tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144987 May 12 07:18:24.789620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1268/2626] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:24 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:25.520195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0b1e777f-55a4-4a4e-8cd6-72013b21f6b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:25.520768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0b1e777f-55a4-4a4e-8cd6-72013b21f6b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:25.527075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b1e777f-55a4-4a4e-8cd6-72013b21f6b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:25.527520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b1e777f-55a4-4a4e-8cd6-72013b21f6b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:25.528319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b1e777f-55a4-4a4e-8cd6-72013b21f6b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:25.528756 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b1e777f-55a4-4a4e-8cd6-72013b21f6b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:25.588308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0b1e777f-55a4-4a4e-8cd6-72013b21f6b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:25.595979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0b1e777f-55a4-4a4e-8cd6-72013b21f6b7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079695 May 12 07:18:25.596544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1359/2627] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:25 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:25.806616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fc52ca49-9332-439f-98fb-632078be23e9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:25.807159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fc52ca49-9332-439f-98fb-632078be23e9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:25.814173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc52ca49-9332-439f-98fb-632078be23e9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:25.814627 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc52ca49-9332-439f-98fb-632078be23e9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:25.815399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc52ca49-9332-439f-98fb-632078be23e9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:25.815879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fc52ca49-9332-439f-98fb-632078be23e9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:26.180260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fc52ca49-9332-439f-98fb-632078be23e9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:26.188088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fc52ca49-9332-439f-98fb-632078be23e9 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.385406 May 12 07:18:26.188658 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1269/2628] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:25 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:26.612782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cbf94007-9dd6-4272-a05b-5edabbd51fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:26.613428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cbf94007-9dd6-4272-a05b-5edabbd51fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:26.619749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbf94007-9dd6-4272-a05b-5edabbd51fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:26.620199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbf94007-9dd6-4272-a05b-5edabbd51fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:26.620966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbf94007-9dd6-4272-a05b-5edabbd51fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:26.621402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cbf94007-9dd6-4272-a05b-5edabbd51fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:26.683521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cbf94007-9dd6-4272-a05b-5edabbd51fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:26.692057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cbf94007-9dd6-4272-a05b-5edabbd51fe4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083135 May 12 07:18:26.692625 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1360/2629] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:26 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:27.204944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cf33dff9-915c-4c6e-9bdc-7ea8be274134 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:27.205564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cf33dff9-915c-4c6e-9bdc-7ea8be274134 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:27.211830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf33dff9-915c-4c6e-9bdc-7ea8be274134 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:27.212274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf33dff9-915c-4c6e-9bdc-7ea8be274134 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:27.213031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf33dff9-915c-4c6e-9bdc-7ea8be274134 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:27.213464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf33dff9-915c-4c6e-9bdc-7ea8be274134 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:27.339492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cf33dff9-915c-4c6e-9bdc-7ea8be274134 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:27.347242 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cf33dff9-915c-4c6e-9bdc-7ea8be274134 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146158 May 12 07:18:27.347837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1270/2630] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:27 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:27.708551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-940d4bd4-8ec5-49da-bcd7-1d87d445f4be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:27.709168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-940d4bd4-8ec5-49da-bcd7-1d87d445f4be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:27.715383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-940d4bd4-8ec5-49da-bcd7-1d87d445f4be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:27.715868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-940d4bd4-8ec5-49da-bcd7-1d87d445f4be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:27.716629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-940d4bd4-8ec5-49da-bcd7-1d87d445f4be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:27.717064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-940d4bd4-8ec5-49da-bcd7-1d87d445f4be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:27.776483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-940d4bd4-8ec5-49da-bcd7-1d87d445f4be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:27.784678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-940d4bd4-8ec5-49da-bcd7-1d87d445f4be tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079957 May 12 07:18:27.785237 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1361/2631] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:27 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:28.364192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c838f31e-9391-4eb5-9831-97dcf5681f42 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:28.364805 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c838f31e-9391-4eb5-9831-97dcf5681f42 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:28.371100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c838f31e-9391-4eb5-9831-97dcf5681f42 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:28.371550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c838f31e-9391-4eb5-9831-97dcf5681f42 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:28.372346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c838f31e-9391-4eb5-9831-97dcf5681f42 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:28.372788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c838f31e-9391-4eb5-9831-97dcf5681f42 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:28.495996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c838f31e-9391-4eb5-9831-97dcf5681f42 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:28.504608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c838f31e-9391-4eb5-9831-97dcf5681f42 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144300 May 12 07:18:28.505178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1271/2632] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:28 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:28.801540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e73cb98c-28a3-4bea-8d56-abe84edeae22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:28.802167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e73cb98c-28a3-4bea-8d56-abe84edeae22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:28.808627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e73cb98c-28a3-4bea-8d56-abe84edeae22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:28.809083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e73cb98c-28a3-4bea-8d56-abe84edeae22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:28.809854 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e73cb98c-28a3-4bea-8d56-abe84edeae22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:28.810296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e73cb98c-28a3-4bea-8d56-abe84edeae22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:28.869724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e73cb98c-28a3-4bea-8d56-abe84edeae22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:28.877526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e73cb98c-28a3-4bea-8d56-abe84edeae22 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079855 May 12 07:18:28.878094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1362/2633] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:28 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:29.526965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-517bafc6-4fc6-4b72-8db2-6ba35656abba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:29.526965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-517bafc6-4fc6-4b72-8db2-6ba35656abba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:29.528284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-517bafc6-4fc6-4b72-8db2-6ba35656abba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:29.528728 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-517bafc6-4fc6-4b72-8db2-6ba35656abba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:29.529492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-517bafc6-4fc6-4b72-8db2-6ba35656abba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:29.529923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-517bafc6-4fc6-4b72-8db2-6ba35656abba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:29.656624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-517bafc6-4fc6-4b72-8db2-6ba35656abba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:29.664407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-517bafc6-4fc6-4b72-8db2-6ba35656abba tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146667 May 12 07:18:29.664972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1272/2634] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:29 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:29.894256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4e43601c-18fb-453f-8496-e5601f3aea18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:29.894808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4e43601c-18fb-453f-8496-e5601f3aea18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:29.901117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e43601c-18fb-453f-8496-e5601f3aea18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:29.901572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e43601c-18fb-453f-8496-e5601f3aea18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:29.902350 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e43601c-18fb-453f-8496-e5601f3aea18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:29.902798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e43601c-18fb-453f-8496-e5601f3aea18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:29.962724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4e43601c-18fb-453f-8496-e5601f3aea18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:29.970989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4e43601c-18fb-453f-8496-e5601f3aea18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080728 May 12 07:18:29.971546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1363/2635] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:29 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:30.682109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3f9d22f8-e432-4262-afb1-ed3531b113cb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:30.682716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3f9d22f8-e432-4262-afb1-ed3531b113cb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:30.689123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3f9d22f8-e432-4262-afb1-ed3531b113cb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:30.689572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3f9d22f8-e432-4262-afb1-ed3531b113cb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:30.690337 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3f9d22f8-e432-4262-afb1-ed3531b113cb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:30.690773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3f9d22f8-e432-4262-afb1-ed3531b113cb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:30.816103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3f9d22f8-e432-4262-afb1-ed3531b113cb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:30.823885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3f9d22f8-e432-4262-afb1-ed3531b113cb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145574 May 12 07:18:30.824449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1273/2636] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:30 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:30.988265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-529e65fc-a83e-41ea-b5e4-6eafe2f5e25b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:30.988813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-529e65fc-a83e-41ea-b5e4-6eafe2f5e25b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:30.995125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529e65fc-a83e-41ea-b5e4-6eafe2f5e25b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:30.995599 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529e65fc-a83e-41ea-b5e4-6eafe2f5e25b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:30.996401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529e65fc-a83e-41ea-b5e4-6eafe2f5e25b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:30.996846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-529e65fc-a83e-41ea-b5e4-6eafe2f5e25b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:31.057255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-529e65fc-a83e-41ea-b5e4-6eafe2f5e25b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:31.065105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-529e65fc-a83e-41ea-b5e4-6eafe2f5e25b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080817 May 12 07:18:31.065684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1364/2637] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:30 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:31.841794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6bfa4be4-2782-42ba-9782-ff5d02077eef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:31.842411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6bfa4be4-2782-42ba-9782-ff5d02077eef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:31.848463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bfa4be4-2782-42ba-9782-ff5d02077eef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:31.848911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bfa4be4-2782-42ba-9782-ff5d02077eef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:31.849671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bfa4be4-2782-42ba-9782-ff5d02077eef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:31.850103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bfa4be4-2782-42ba-9782-ff5d02077eef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:31.972951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6bfa4be4-2782-42ba-9782-ff5d02077eef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:31.980591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6bfa4be4-2782-42ba-9782-ff5d02077eef tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.142720 May 12 07:18:31.981158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1274/2638] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:31 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:32.081937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f507b5b6-d96c-47cc-a007-8cb385e63d51 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:32.082551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f507b5b6-d96c-47cc-a007-8cb385e63d51 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:32.088863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f507b5b6-d96c-47cc-a007-8cb385e63d51 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:32.089305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f507b5b6-d96c-47cc-a007-8cb385e63d51 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:32.090068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f507b5b6-d96c-47cc-a007-8cb385e63d51 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:32.090497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f507b5b6-d96c-47cc-a007-8cb385e63d51 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:32.149358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f507b5b6-d96c-47cc-a007-8cb385e63d51 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:32.157470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f507b5b6-d96c-47cc-a007-8cb385e63d51 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079439 May 12 07:18:32.158029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1365/2639] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:32 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:32.998308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e8f6ef1f-139f-4b5f-be43-bd6e790fd5fd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:32.999467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e8f6ef1f-139f-4b5f-be43-bd6e790fd5fd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:33.005839 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8f6ef1f-139f-4b5f-be43-bd6e790fd5fd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:33.006289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8f6ef1f-139f-4b5f-be43-bd6e790fd5fd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:33.007046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8f6ef1f-139f-4b5f-be43-bd6e790fd5fd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:33.007487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e8f6ef1f-139f-4b5f-be43-bd6e790fd5fd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:33.136779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e8f6ef1f-139f-4b5f-be43-bd6e790fd5fd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:33.144488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e8f6ef1f-139f-4b5f-be43-bd6e790fd5fd tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.150084 May 12 07:18:33.145044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1275/2640] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:32 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:33.174956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ca84e972-60f5-4a83-a667-06c90eb74e2d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:33.175722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ca84e972-60f5-4a83-a667-06c90eb74e2d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:33.182121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ca84e972-60f5-4a83-a667-06c90eb74e2d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:33.182574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ca84e972-60f5-4a83-a667-06c90eb74e2d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:33.183369 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ca84e972-60f5-4a83-a667-06c90eb74e2d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:33.183907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ca84e972-60f5-4a83-a667-06c90eb74e2d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:33.247002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ca84e972-60f5-4a83-a667-06c90eb74e2d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:33.255710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ca84e972-60f5-4a83-a667-06c90eb74e2d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085381 May 12 07:18:33.256476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1366/2641] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:33 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:34.161892 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-66c542fe-f645-422f-ac00-8f3aa4a70f94 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:34.162503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-66c542fe-f645-422f-ac00-8f3aa4a70f94 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:34.168959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66c542fe-f645-422f-ac00-8f3aa4a70f94 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:34.169411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66c542fe-f645-422f-ac00-8f3aa4a70f94 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:34.170164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66c542fe-f645-422f-ac00-8f3aa4a70f94 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:34.170625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66c542fe-f645-422f-ac00-8f3aa4a70f94 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:34.272748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1b12e1c4-d8cf-45d5-8edf-ecf289df4483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:34.273365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1b12e1c4-d8cf-45d5-8edf-ecf289df4483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:34.279543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1b12e1c4-d8cf-45d5-8edf-ecf289df4483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:34.280126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1b12e1c4-d8cf-45d5-8edf-ecf289df4483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:34.280904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1b12e1c4-d8cf-45d5-8edf-ecf289df4483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:34.281344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1b12e1c4-d8cf-45d5-8edf-ecf289df4483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:34.298527 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-66c542fe-f645-422f-ac00-8f3aa4a70f94 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:34.306205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-66c542fe-f645-422f-ac00-8f3aa4a70f94 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148208 May 12 07:18:34.306775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1276/2642] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:34 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:34.341954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1b12e1c4-d8cf-45d5-8edf-ecf289df4483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:34.349818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1b12e1c4-d8cf-45d5-8edf-ecf289df4483 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080949 May 12 07:18:34.350388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1367/2643] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:34 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:35.323772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-38ca0a6f-3639-458e-9447-28873182ab4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:35.324395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-38ca0a6f-3639-458e-9447-28873182ab4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:35.331198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-38ca0a6f-3639-458e-9447-28873182ab4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:35.331649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-38ca0a6f-3639-458e-9447-28873182ab4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:35.332435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-38ca0a6f-3639-458e-9447-28873182ab4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:35.332873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-38ca0a6f-3639-458e-9447-28873182ab4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:35.366311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-619a2acb-7dcf-442d-a9e9-a864fab008d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:35.366925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-619a2acb-7dcf-442d-a9e9-a864fab008d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:35.373263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-619a2acb-7dcf-442d-a9e9-a864fab008d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:35.373707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-619a2acb-7dcf-442d-a9e9-a864fab008d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:35.374507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-619a2acb-7dcf-442d-a9e9-a864fab008d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:35.374943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-619a2acb-7dcf-442d-a9e9-a864fab008d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:35.445341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-619a2acb-7dcf-442d-a9e9-a864fab008d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:35.453698 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-619a2acb-7dcf-442d-a9e9-a864fab008d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.091239 May 12 07:18:35.454271 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1368/2644] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:35 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:35.479185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-38ca0a6f-3639-458e-9447-28873182ab4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:35.486942 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-38ca0a6f-3639-458e-9447-28873182ab4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.167041 May 12 07:18:35.487483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1277/2645] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:35 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:36.470437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aa6f5b65-47bc-49a7-97cd-96664d6afd2f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:36.471055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-aa6f5b65-47bc-49a7-97cd-96664d6afd2f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:36.477338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa6f5b65-47bc-49a7-97cd-96664d6afd2f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:36.477797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa6f5b65-47bc-49a7-97cd-96664d6afd2f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:36.478561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa6f5b65-47bc-49a7-97cd-96664d6afd2f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:36.478999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aa6f5b65-47bc-49a7-97cd-96664d6afd2f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:36.502737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-847997f4-bae7-4959-9ae5-56f6639e5f2f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:36.503342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-847997f4-bae7-4959-9ae5-56f6639e5f2f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:36.509859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-847997f4-bae7-4959-9ae5-56f6639e5f2f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:36.510305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-847997f4-bae7-4959-9ae5-56f6639e5f2f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:36.511125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-847997f4-bae7-4959-9ae5-56f6639e5f2f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:36.511560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-847997f4-bae7-4959-9ae5-56f6639e5f2f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:36.542263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-aa6f5b65-47bc-49a7-97cd-96664d6afd2f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:36.550987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aa6f5b65-47bc-49a7-97cd-96664d6afd2f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084887 May 12 07:18:36.551568 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1369/2646] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:36 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:36.584792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 12 07:18:36.585020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:18:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f (ip 10.222.0.25) !!! May 12 07:18:36.637640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-847997f4-bae7-4959-9ae5-56f6639e5f2f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:36.645437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-847997f4-bae7-4959-9ae5-56f6639e5f2f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146528 May 12 07:18:36.645999 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1278/2647] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:36 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:37.567901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b61d1866-9380-4201-9873-7127836cb1a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:37.568428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b61d1866-9380-4201-9873-7127836cb1a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:37.574775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b61d1866-9380-4201-9873-7127836cb1a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:37.575228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b61d1866-9380-4201-9873-7127836cb1a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:37.576025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b61d1866-9380-4201-9873-7127836cb1a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:37.577078 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b61d1866-9380-4201-9873-7127836cb1a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:37.636538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b61d1866-9380-4201-9873-7127836cb1a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:37.644404 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b61d1866-9380-4201-9873-7127836cb1a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080475 May 12 07:18:37.644976 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1370/2648] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:37 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:37.662086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-50d845e9-c4c7-4309-b198-37d5e1e0da29 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:37.662700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-50d845e9-c4c7-4309-b198-37d5e1e0da29 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:37.668901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50d845e9-c4c7-4309-b198-37d5e1e0da29 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:37.669347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50d845e9-c4c7-4309-b198-37d5e1e0da29 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:37.670100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50d845e9-c4c7-4309-b198-37d5e1e0da29 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:37.671020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50d845e9-c4c7-4309-b198-37d5e1e0da29 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:37.797891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-50d845e9-c4c7-4309-b198-37d5e1e0da29 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:37.805658 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-50d845e9-c4c7-4309-b198-37d5e1e0da29 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147354 May 12 07:18:37.806233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1279/2649] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:37 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:38.661779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f364ed2e-5b20-403c-b33e-e2c2261d40bf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:38.662323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f364ed2e-5b20-403c-b33e-e2c2261d40bf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:38.668592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f364ed2e-5b20-403c-b33e-e2c2261d40bf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:38.669045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f364ed2e-5b20-403c-b33e-e2c2261d40bf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:38.669822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f364ed2e-5b20-403c-b33e-e2c2261d40bf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:38.670261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f364ed2e-5b20-403c-b33e-e2c2261d40bf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:38.730624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f364ed2e-5b20-403c-b33e-e2c2261d40bf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:38.738341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f364ed2e-5b20-403c-b33e-e2c2261d40bf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080514 May 12 07:18:38.738917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1371/2650] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:38 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:38.823023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d0bcd78a-e5ed-4d80-aecb-4a062a4a591b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:38.823635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d0bcd78a-e5ed-4d80-aecb-4a062a4a591b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:38.830431 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0bcd78a-e5ed-4d80-aecb-4a062a4a591b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:38.830873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0bcd78a-e5ed-4d80-aecb-4a062a4a591b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:38.831630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0bcd78a-e5ed-4d80-aecb-4a062a4a591b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:38.832103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0bcd78a-e5ed-4d80-aecb-4a062a4a591b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:38.955659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d0bcd78a-e5ed-4d80-aecb-4a062a4a591b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:38.963464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d0bcd78a-e5ed-4d80-aecb-4a062a4a591b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144346 May 12 07:18:38.964054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1280/2651] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:38 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:39.755772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0515b0c3-2678-4543-96fe-1f3d08aee87e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:39.756420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0515b0c3-2678-4543-96fe-1f3d08aee87e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:39.762722 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0515b0c3-2678-4543-96fe-1f3d08aee87e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:39.763180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0515b0c3-2678-4543-96fe-1f3d08aee87e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:39.763993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0515b0c3-2678-4543-96fe-1f3d08aee87e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:39.764435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0515b0c3-2678-4543-96fe-1f3d08aee87e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:39.827163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0515b0c3-2678-4543-96fe-1f3d08aee87e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:39.834921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0515b0c3-2678-4543-96fe-1f3d08aee87e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083039 May 12 07:18:39.835497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1372/2652] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:39 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:39.979879 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f72ab9b1-b2e1-463b-945e-abba4d962e4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:39.980505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f72ab9b1-b2e1-463b-945e-abba4d962e4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:39.987488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f72ab9b1-b2e1-463b-945e-abba4d962e4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:39.987971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f72ab9b1-b2e1-463b-945e-abba4d962e4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:39.988746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f72ab9b1-b2e1-463b-945e-abba4d962e4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:39.989188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f72ab9b1-b2e1-463b-945e-abba4d962e4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:40.113258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f72ab9b1-b2e1-463b-945e-abba4d962e4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:40.120958 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f72ab9b1-b2e1-463b-945e-abba4d962e4f tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144999 May 12 07:18:40.121527 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1281/2653] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:39 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:40.852079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8a92a231-908c-4635-8f57-8ac59ade63bc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:40.852696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8a92a231-908c-4635-8f57-8ac59ade63bc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:40.858922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a92a231-908c-4635-8f57-8ac59ade63bc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:40.859377 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a92a231-908c-4635-8f57-8ac59ade63bc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:40.860172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a92a231-908c-4635-8f57-8ac59ade63bc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:40.860613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a92a231-908c-4635-8f57-8ac59ade63bc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:40.922628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8a92a231-908c-4635-8f57-8ac59ade63bc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:40.930401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8a92a231-908c-4635-8f57-8ac59ade63bc tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082154 May 12 07:18:40.930969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1373/2654] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:40 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:41.138122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3c55aa4b-b161-4284-85eb-554bc0b2cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:41.138666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3c55aa4b-b161-4284-85eb-554bc0b2cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:41.145019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c55aa4b-b161-4284-85eb-554bc0b2cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:41.145465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c55aa4b-b161-4284-85eb-554bc0b2cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:41.146219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c55aa4b-b161-4284-85eb-554bc0b2cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:41.146655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c55aa4b-b161-4284-85eb-554bc0b2cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:41.272320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3c55aa4b-b161-4284-85eb-554bc0b2cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:41.280099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3c55aa4b-b161-4284-85eb-554bc0b2cb07 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145889 May 12 07:18:41.280665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1282/2655] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:41 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:41.947725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ad1e746f-d7e3-4134-86f8-77183f631568 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:41.948339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ad1e746f-d7e3-4134-86f8-77183f631568 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:41.955127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad1e746f-d7e3-4134-86f8-77183f631568 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:41.955577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad1e746f-d7e3-4134-86f8-77183f631568 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:41.956374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad1e746f-d7e3-4134-86f8-77183f631568 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:41.956817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ad1e746f-d7e3-4134-86f8-77183f631568 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:42.017283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ad1e746f-d7e3-4134-86f8-77183f631568 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:42.025024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ad1e746f-d7e3-4134-86f8-77183f631568 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081181 May 12 07:18:42.025591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1374/2656] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:41 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:42.297161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a0f53ac0-c3b8-4073-b312-3343a3388d72 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:42.297771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a0f53ac0-c3b8-4073-b312-3343a3388d72 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:42.304020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0f53ac0-c3b8-4073-b312-3343a3388d72 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:42.304465 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0f53ac0-c3b8-4073-b312-3343a3388d72 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:42.305222 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0f53ac0-c3b8-4073-b312-3343a3388d72 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:42.305650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a0f53ac0-c3b8-4073-b312-3343a3388d72 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:42.430642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a0f53ac0-c3b8-4073-b312-3343a3388d72 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:42.438788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a0f53ac0-c3b8-4073-b312-3343a3388d72 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145693 May 12 07:18:42.439349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1283/2657] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:42 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:43.042236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e8e3c2a7-2d28-4ec6-82ff-b418eb0880f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:43.042864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e8e3c2a7-2d28-4ec6-82ff-b418eb0880f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:43.050045 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8e3c2a7-2d28-4ec6-82ff-b418eb0880f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:43.050487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8e3c2a7-2d28-4ec6-82ff-b418eb0880f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:43.051243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8e3c2a7-2d28-4ec6-82ff-b418eb0880f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:43.051675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e8e3c2a7-2d28-4ec6-82ff-b418eb0880f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:43.114098 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e8e3c2a7-2d28-4ec6-82ff-b418eb0880f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:43.121823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e8e3c2a7-2d28-4ec6-82ff-b418eb0880f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083413 May 12 07:18:43.122378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1375/2658] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:43 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:43.456278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-24fabc6b-b7eb-45fc-a131-50473f347688 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:43.456901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-24fabc6b-b7eb-45fc-a131-50473f347688 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:43.463223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-24fabc6b-b7eb-45fc-a131-50473f347688 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:43.463680 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-24fabc6b-b7eb-45fc-a131-50473f347688 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:43.464482 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-24fabc6b-b7eb-45fc-a131-50473f347688 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:43.464925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-24fabc6b-b7eb-45fc-a131-50473f347688 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:43.588386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-24fabc6b-b7eb-45fc-a131-50473f347688 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:43.596996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-24fabc6b-b7eb-45fc-a131-50473f347688 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145105 May 12 07:18:43.597563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1284/2659] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:43 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:44.138375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-50f4ffb5-9717-4aea-8f58-cec26b6035b0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:44.138994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-50f4ffb5-9717-4aea-8f58-cec26b6035b0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:44.145366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50f4ffb5-9717-4aea-8f58-cec26b6035b0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:44.145818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50f4ffb5-9717-4aea-8f58-cec26b6035b0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:44.146600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50f4ffb5-9717-4aea-8f58-cec26b6035b0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:44.147037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50f4ffb5-9717-4aea-8f58-cec26b6035b0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:44.207132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-50f4ffb5-9717-4aea-8f58-cec26b6035b0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:44.214952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-50f4ffb5-9717-4aea-8f58-cec26b6035b0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080399 May 12 07:18:44.215518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1376/2660] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:44 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:44.613935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bb2d2552-fca2-4597-88bc-7ae2cec55046 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:44.614582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bb2d2552-fca2-4597-88bc-7ae2cec55046 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:44.620909 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb2d2552-fca2-4597-88bc-7ae2cec55046 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:44.621364 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb2d2552-fca2-4597-88bc-7ae2cec55046 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:44.622133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb2d2552-fca2-4597-88bc-7ae2cec55046 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:44.622574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bb2d2552-fca2-4597-88bc-7ae2cec55046 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:44.751937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bb2d2552-fca2-4597-88bc-7ae2cec55046 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:44.759843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bb2d2552-fca2-4597-88bc-7ae2cec55046 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.149893 May 12 07:18:44.760413 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1285/2661] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:44 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:45.231316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f69818de-438d-4e5d-926c-0ada66e83f05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:45.232018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f69818de-438d-4e5d-926c-0ada66e83f05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:45.239061 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69818de-438d-4e5d-926c-0ada66e83f05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:45.239509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69818de-438d-4e5d-926c-0ada66e83f05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:45.240304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69818de-438d-4e5d-926c-0ada66e83f05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:45.240740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f69818de-438d-4e5d-926c-0ada66e83f05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:45.300915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f69818de-438d-4e5d-926c-0ada66e83f05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:45.308569 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f69818de-438d-4e5d-926c-0ada66e83f05 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081110 May 12 07:18:45.309136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1377/2662] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:45 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:45.777282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-de140741-1b75-440d-942b-81881414ea1b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:45.777897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-de140741-1b75-440d-942b-81881414ea1b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:45.784226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de140741-1b75-440d-942b-81881414ea1b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:45.784671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de140741-1b75-440d-942b-81881414ea1b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:45.785423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de140741-1b75-440d-942b-81881414ea1b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:45.785854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de140741-1b75-440d-942b-81881414ea1b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:45.910108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-de140741-1b75-440d-942b-81881414ea1b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:45.917901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-de140741-1b75-440d-942b-81881414ea1b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144433 May 12 07:18:45.918467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1286/2663] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:45 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:46.325642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-59602403-4b37-48a3-9923-2de90769886f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:46.326291 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-59602403-4b37-48a3-9923-2de90769886f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:46.333052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59602403-4b37-48a3-9923-2de90769886f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:46.333504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59602403-4b37-48a3-9923-2de90769886f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:46.334262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59602403-4b37-48a3-9923-2de90769886f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:46.334703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59602403-4b37-48a3-9923-2de90769886f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:46.397620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-59602403-4b37-48a3-9923-2de90769886f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:46.405391 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-59602403-4b37-48a3-9923-2de90769886f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083575 May 12 07:18:46.406508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1378/2664] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:46 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:46.935314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9e633934-b011-4e82-944d-924eda37254b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:46.935999 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9e633934-b011-4e82-944d-924eda37254b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:46.942771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e633934-b011-4e82-944d-924eda37254b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:46.943218 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e633934-b011-4e82-944d-924eda37254b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:46.944002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e633934-b011-4e82-944d-924eda37254b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:46.944435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9e633934-b011-4e82-944d-924eda37254b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:47.070187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9e633934-b011-4e82-944d-924eda37254b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:47.078077 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9e633934-b011-4e82-944d-924eda37254b tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146587 May 12 07:18:47.078648 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1287/2665] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:46 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:47.423307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-954817d9-3bad-4c97-9746-988fd19e0946 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:47.423948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-954817d9-3bad-4c97-9746-988fd19e0946 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:47.430257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-954817d9-3bad-4c97-9746-988fd19e0946 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:47.430710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-954817d9-3bad-4c97-9746-988fd19e0946 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:47.431483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-954817d9-3bad-4c97-9746-988fd19e0946 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:47.431953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-954817d9-3bad-4c97-9746-988fd19e0946 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:47.493630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-954817d9-3bad-4c97-9746-988fd19e0946 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:47.501213 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-954817d9-3bad-4c97-9746-988fd19e0946 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082401 May 12 07:18:47.501777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1379/2666] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:47 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:48.094526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3c0dc0be-f1aa-4b63-a4a0-642e9fd1698a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:48.095159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3c0dc0be-f1aa-4b63-a4a0-642e9fd1698a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:48.101418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c0dc0be-f1aa-4b63-a4a0-642e9fd1698a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:48.101867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c0dc0be-f1aa-4b63-a4a0-642e9fd1698a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:48.102722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c0dc0be-f1aa-4b63-a4a0-642e9fd1698a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:48.103159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c0dc0be-f1aa-4b63-a4a0-642e9fd1698a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:48.229684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3c0dc0be-f1aa-4b63-a4a0-642e9fd1698a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:48.238094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3c0dc0be-f1aa-4b63-a4a0-642e9fd1698a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147995 May 12 07:18:48.238662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1288/2667] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:48 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:48.518302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-781b8f87-5763-4304-b46f-2fcd38a3adfd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:48.524915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-781b8f87-5763-4304-b46f-2fcd38a3adfd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:48.525240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-781b8f87-5763-4304-b46f-2fcd38a3adfd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:48.525689 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-781b8f87-5763-4304-b46f-2fcd38a3adfd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:48.526448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-781b8f87-5763-4304-b46f-2fcd38a3adfd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:48.526882 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-781b8f87-5763-4304-b46f-2fcd38a3adfd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:48.586837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-781b8f87-5763-4304-b46f-2fcd38a3adfd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:48.595236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-781b8f87-5763-4304-b46f-2fcd38a3adfd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081294 May 12 07:18:48.595825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1380/2668] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:48 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:49.255653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2aef6b1e-8d79-4693-925a-4daed83ed2fe tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:49.256254 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2aef6b1e-8d79-4693-925a-4daed83ed2fe tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:49.262574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aef6b1e-8d79-4693-925a-4daed83ed2fe tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:49.263031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aef6b1e-8d79-4693-925a-4daed83ed2fe tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:49.263830 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aef6b1e-8d79-4693-925a-4daed83ed2fe tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:49.264276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aef6b1e-8d79-4693-925a-4daed83ed2fe tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:49.388161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2aef6b1e-8d79-4693-925a-4daed83ed2fe tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:49.395982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2aef6b1e-8d79-4693-925a-4daed83ed2fe tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144245 May 12 07:18:49.396559 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1289/2669] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:49 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:49.612997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a7634df9-4c09-49f0-b8e0-0d9fcbe45ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:49.613533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a7634df9-4c09-49f0-b8e0-0d9fcbe45ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:49.619798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7634df9-4c09-49f0-b8e0-0d9fcbe45ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:49.620309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7634df9-4c09-49f0-b8e0-0d9fcbe45ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:49.621083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7634df9-4c09-49f0-b8e0-0d9fcbe45ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:49.621521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a7634df9-4c09-49f0-b8e0-0d9fcbe45ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:49.684963 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a7634df9-4c09-49f0-b8e0-0d9fcbe45ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:49.693040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a7634df9-4c09-49f0-b8e0-0d9fcbe45ca1 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084484 May 12 07:18:49.693606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1381/2670] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:49 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:50.413453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1ffa2083-1248-413e-948c-234ae599ebcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:50.413987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1ffa2083-1248-413e-948c-234ae599ebcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:50.420389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1ffa2083-1248-413e-948c-234ae599ebcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:50.420843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1ffa2083-1248-413e-948c-234ae599ebcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:50.421872 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1ffa2083-1248-413e-948c-234ae599ebcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:50.422310 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1ffa2083-1248-413e-948c-234ae599ebcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:50.547031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1ffa2083-1248-413e-948c-234ae599ebcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:50.554757 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1ffa2083-1248-413e-948c-234ae599ebcc tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145293 May 12 07:18:50.555327 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1290/2671] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:50 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:50.709862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a2f8af52-cfc0-498c-a3bc-8bb1d08951f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:50.710397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a2f8af52-cfc0-498c-a3bc-8bb1d08951f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:50.716723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2f8af52-cfc0-498c-a3bc-8bb1d08951f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:50.717173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2f8af52-cfc0-498c-a3bc-8bb1d08951f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:50.718065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2f8af52-cfc0-498c-a3bc-8bb1d08951f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:50.718505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2f8af52-cfc0-498c-a3bc-8bb1d08951f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:50.778027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a2f8af52-cfc0-498c-a3bc-8bb1d08951f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:50.785662 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a2f8af52-cfc0-498c-a3bc-8bb1d08951f0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079726 May 12 07:18:50.786230 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1382/2672] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:50 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:51.571329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1d1c9adc-06fe-4efd-b426-a21468164b6d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:51.571905 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1d1c9adc-06fe-4efd-b426-a21468164b6d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:51.578200 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d1c9adc-06fe-4efd-b426-a21468164b6d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:51.578638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d1c9adc-06fe-4efd-b426-a21468164b6d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:51.579410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d1c9adc-06fe-4efd-b426-a21468164b6d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:51.579869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d1c9adc-06fe-4efd-b426-a21468164b6d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:51.706662 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1d1c9adc-06fe-4efd-b426-a21468164b6d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:51.714886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1d1c9adc-06fe-4efd-b426-a21468164b6d tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147456 May 12 07:18:51.715455 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1291/2673] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:51 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:51.803328 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1d818549-29ea-4b95-a053-bac8996c0cdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:51.803953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1d818549-29ea-4b95-a053-bac8996c0cdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:51.810072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d818549-29ea-4b95-a053-bac8996c0cdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:51.810525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d818549-29ea-4b95-a053-bac8996c0cdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:51.811308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d818549-29ea-4b95-a053-bac8996c0cdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:51.812449 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1d818549-29ea-4b95-a053-bac8996c0cdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:51.872240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1d818549-29ea-4b95-a053-bac8996c0cdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:51.880100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1d818549-29ea-4b95-a053-bac8996c0cdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080768 May 12 07:18:51.880670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1383/2674] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:51 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:52.731658 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9efc3eaa-17a3-4813-ab9d-87868d9dfafb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:52.732291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9efc3eaa-17a3-4813-ab9d-87868d9dfafb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:52.738580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9efc3eaa-17a3-4813-ab9d-87868d9dfafb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:52.739021 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9efc3eaa-17a3-4813-ab9d-87868d9dfafb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:52.739805 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9efc3eaa-17a3-4813-ab9d-87868d9dfafb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:52.740239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9efc3eaa-17a3-4813-ab9d-87868d9dfafb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:52.863676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9efc3eaa-17a3-4813-ab9d-87868d9dfafb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:52.871567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9efc3eaa-17a3-4813-ab9d-87868d9dfafb tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.143729 May 12 07:18:52.872173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1292/2675] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:52 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:52.896753 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6d2892fe-639d-43ac-8d92-3d58f4080ba3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:52.897363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6d2892fe-639d-43ac-8d92-3d58f4080ba3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:52.903629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6d2892fe-639d-43ac-8d92-3d58f4080ba3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:52.904105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6d2892fe-639d-43ac-8d92-3d58f4080ba3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:52.904868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6d2892fe-639d-43ac-8d92-3d58f4080ba3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:52.905298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6d2892fe-639d-43ac-8d92-3d58f4080ba3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:52.968593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6d2892fe-639d-43ac-8d92-3d58f4080ba3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:52.976496 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6d2892fe-639d-43ac-8d92-3d58f4080ba3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083571 May 12 07:18:52.977072 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1384/2676] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:52 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:53.888787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2aa231f5-72e0-4ead-a4b1-c1000f9ec001 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:53.889408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2aa231f5-72e0-4ead-a4b1-c1000f9ec001 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:53.896276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aa231f5-72e0-4ead-a4b1-c1000f9ec001 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:53.896733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aa231f5-72e0-4ead-a4b1-c1000f9ec001 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:53.897672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aa231f5-72e0-4ead-a4b1-c1000f9ec001 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:53.898124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2aa231f5-72e0-4ead-a4b1-c1000f9ec001 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:53.993783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0df52d68-4d03-41bc-9448-cf77edf5cc30 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:53.994408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0df52d68-4d03-41bc-9448-cf77edf5cc30 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:54.000513 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0df52d68-4d03-41bc-9448-cf77edf5cc30 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:54.000967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0df52d68-4d03-41bc-9448-cf77edf5cc30 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:54.001745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0df52d68-4d03-41bc-9448-cf77edf5cc30 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:54.002183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0df52d68-4d03-41bc-9448-cf77edf5cc30 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:54.024933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2aa231f5-72e0-4ead-a4b1-c1000f9ec001 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:54.033321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2aa231f5-72e0-4ead-a4b1-c1000f9ec001 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148382 May 12 07:18:54.033903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1293/2677] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:53 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:54.063953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0df52d68-4d03-41bc-9448-cf77edf5cc30 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:54.071778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0df52d68-4d03-41bc-9448-cf77edf5cc30 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081880 May 12 07:18:54.072343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1385/2678] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:53 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:55.051460 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c3ec27d3-35d1-427e-8285-a47f902e1d8e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:55.052098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c3ec27d3-35d1-427e-8285-a47f902e1d8e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:55.058464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3ec27d3-35d1-427e-8285-a47f902e1d8e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:55.058912 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3ec27d3-35d1-427e-8285-a47f902e1d8e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:55.059670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3ec27d3-35d1-427e-8285-a47f902e1d8e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:55.060129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3ec27d3-35d1-427e-8285-a47f902e1d8e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:55.088983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-40a78a04-8291-4250-a9c3-ff227a70fafb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:55.089620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-40a78a04-8291-4250-a9c3-ff227a70fafb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:55.096360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-40a78a04-8291-4250-a9c3-ff227a70fafb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:55.096803 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-40a78a04-8291-4250-a9c3-ff227a70fafb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:55.097572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-40a78a04-8291-4250-a9c3-ff227a70fafb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:55.098004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-40a78a04-8291-4250-a9c3-ff227a70fafb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:55.180699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-40a78a04-8291-4250-a9c3-ff227a70fafb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:55.188407 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-40a78a04-8291-4250-a9c3-ff227a70fafb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.103188 May 12 07:18:55.189306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1386/2679] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:55 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:55.209532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c3ec27d3-35d1-427e-8285-a47f902e1d8e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:55.217288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c3ec27d3-35d1-427e-8285-a47f902e1d8e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.169652 May 12 07:18:55.218400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1294/2680] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:55 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:56.205507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0f7014e8-970a-490e-ae3f-6c7abb1b393f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:56.206119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0f7014e8-970a-490e-ae3f-6c7abb1b393f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:56.212430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f7014e8-970a-490e-ae3f-6c7abb1b393f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:56.212877 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f7014e8-970a-490e-ae3f-6c7abb1b393f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:56.213673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f7014e8-970a-490e-ae3f-6c7abb1b393f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:56.214128 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0f7014e8-970a-490e-ae3f-6c7abb1b393f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:56.234833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e29baf61-8b9e-453d-8bfd-500e7000e423 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:56.235495 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e29baf61-8b9e-453d-8bfd-500e7000e423 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:56.242105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e29baf61-8b9e-453d-8bfd-500e7000e423 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:56.242473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e29baf61-8b9e-453d-8bfd-500e7000e423 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:56.243286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e29baf61-8b9e-453d-8bfd-500e7000e423 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:56.243764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e29baf61-8b9e-453d-8bfd-500e7000e423 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:56.274719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0f7014e8-970a-490e-ae3f-6c7abb1b393f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:56.282532 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0f7014e8-970a-490e-ae3f-6c7abb1b393f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080936 May 12 07:18:56.283322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1387/2681] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:56 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:56.368473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e29baf61-8b9e-453d-8bfd-500e7000e423 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:56.376218 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e29baf61-8b9e-453d-8bfd-500e7000e423 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145676 May 12 07:18:56.376794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1295/2682] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:56 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:18:57.299173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1e3eca43-7230-4523-8546-c61dba871a56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:57.299814 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1e3eca43-7230-4523-8546-c61dba871a56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:57.306178 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e3eca43-7230-4523-8546-c61dba871a56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:57.306622 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e3eca43-7230-4523-8546-c61dba871a56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:57.307381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e3eca43-7230-4523-8546-c61dba871a56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:57.307846 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1e3eca43-7230-4523-8546-c61dba871a56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:57.370198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1e3eca43-7230-4523-8546-c61dba871a56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:57.377960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1e3eca43-7230-4523-8546-c61dba871a56 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083533 May 12 07:18:57.378521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1388/2683] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:57 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:57.392911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5b23bb57-c246-4ec2-b5dc-246eac4e3de7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:57.393525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5b23bb57-c246-4ec2-b5dc-246eac4e3de7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:57.399782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b23bb57-c246-4ec2-b5dc-246eac4e3de7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:57.400239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b23bb57-c246-4ec2-b5dc-246eac4e3de7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:57.401004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b23bb57-c246-4ec2-b5dc-246eac4e3de7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:57.401472 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b23bb57-c246-4ec2-b5dc-246eac4e3de7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:57.526945 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5b23bb57-c246-4ec2-b5dc-246eac4e3de7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:57.535272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5b23bb57-c246-4ec2-b5dc-246eac4e3de7 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146142 May 12 07:18:57.535804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1296/2684] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:57 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:58.394718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b616bcd1-3759-476b-95e5-6ff5a03a3675 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:58.395284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b616bcd1-3759-476b-95e5-6ff5a03a3675 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:58.401657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b616bcd1-3759-476b-95e5-6ff5a03a3675 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:58.402103 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b616bcd1-3759-476b-95e5-6ff5a03a3675 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:58.402895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b616bcd1-3759-476b-95e5-6ff5a03a3675 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:58.403332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b616bcd1-3759-476b-95e5-6ff5a03a3675 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:58.463782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b616bcd1-3759-476b-95e5-6ff5a03a3675 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:58.471379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b616bcd1-3759-476b-95e5-6ff5a03a3675 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080559 May 12 07:18:58.472065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1389/2685] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:58 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:58.552427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2954ecde-5782-44bc-8963-0e331fda2b43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:58.553036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2954ecde-5782-44bc-8963-0e331fda2b43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:58.559420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2954ecde-5782-44bc-8963-0e331fda2b43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:58.559910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2954ecde-5782-44bc-8963-0e331fda2b43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:58.560670 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2954ecde-5782-44bc-8963-0e331fda2b43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:58.561752 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2954ecde-5782-44bc-8963-0e331fda2b43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:58.688504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2954ecde-5782-44bc-8963-0e331fda2b43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:58.696295 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2954ecde-5782-44bc-8963-0e331fda2b43 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.147639 May 12 07:18:58.696889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1297/2686] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:58 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:59.488486 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b21ae958-4471-4b91-91ea-4e89cb19b079 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:59.489098 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b21ae958-4471-4b91-91ea-4e89cb19b079 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:59.495527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b21ae958-4471-4b91-91ea-4e89cb19b079 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:59.496000 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b21ae958-4471-4b91-91ea-4e89cb19b079 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:59.496760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b21ae958-4471-4b91-91ea-4e89cb19b079 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:59.497191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b21ae958-4471-4b91-91ea-4e89cb19b079 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:59.557764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b21ae958-4471-4b91-91ea-4e89cb19b079 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:59.566030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b21ae958-4471-4b91-91ea-4e89cb19b079 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081437 May 12 07:18:59.568039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1390/2687] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:59 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:18:59.712658 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5fc31b79-416b-4b1b-849b-91b5e43895a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:18:59.713307 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5fc31b79-416b-4b1b-849b-91b5e43895a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:18:59.719636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5fc31b79-416b-4b1b-849b-91b5e43895a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:59.720119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5fc31b79-416b-4b1b-849b-91b5e43895a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:59.720885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5fc31b79-416b-4b1b-849b-91b5e43895a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:18:59.721324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5fc31b79-416b-4b1b-849b-91b5e43895a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:18:59.843855 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5fc31b79-416b-4b1b-849b-91b5e43895a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:18:59.851639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5fc31b79-416b-4b1b-849b-91b5e43895a1 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.142838 May 12 07:18:59.852230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1298/2688] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:18:59 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:00.583016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b8f6f9de-9c3e-41d5-9010-31337cc15ccf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:00.583626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b8f6f9de-9c3e-41d5-9010-31337cc15ccf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:00.589970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8f6f9de-9c3e-41d5-9010-31337cc15ccf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:00.590414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8f6f9de-9c3e-41d5-9010-31337cc15ccf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:00.591173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8f6f9de-9c3e-41d5-9010-31337cc15ccf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:00.591605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b8f6f9de-9c3e-41d5-9010-31337cc15ccf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:00.653878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b8f6f9de-9c3e-41d5-9010-31337cc15ccf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:00.662223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b8f6f9de-9c3e-41d5-9010-31337cc15ccf tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083057 May 12 07:19:00.662794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1391/2689] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:00 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:00.868488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cca316fd-9665-463d-9ae8-0fea1f44c66a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:00.869030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cca316fd-9665-463d-9ae8-0fea1f44c66a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:00.875829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cca316fd-9665-463d-9ae8-0fea1f44c66a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:00.876282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cca316fd-9665-463d-9ae8-0fea1f44c66a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:00.877047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cca316fd-9665-463d-9ae8-0fea1f44c66a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:00.877487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cca316fd-9665-463d-9ae8-0fea1f44c66a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:01.012726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cca316fd-9665-463d-9ae8-0fea1f44c66a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:01.021156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cca316fd-9665-463d-9ae8-0fea1f44c66a tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.156701 May 12 07:19:01.021727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1299/2690] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:00 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:01.678462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2fd841a9-6f41-4da5-a425-bf29ef5a4430 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:01.679015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2fd841a9-6f41-4da5-a425-bf29ef5a4430 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:01.685222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fd841a9-6f41-4da5-a425-bf29ef5a4430 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:01.685676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fd841a9-6f41-4da5-a425-bf29ef5a4430 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:01.696538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fd841a9-6f41-4da5-a425-bf29ef5a4430 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:01.696538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fd841a9-6f41-4da5-a425-bf29ef5a4430 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:01.747464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2fd841a9-6f41-4da5-a425-bf29ef5a4430 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:01.755296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2fd841a9-6f41-4da5-a425-bf29ef5a4430 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080771 May 12 07:19:01.755896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1392/2691] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:01 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:02.038085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ba5ab029-0a45-4f72-a975-54ee3b511e33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:02.038710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ba5ab029-0a45-4f72-a975-54ee3b511e33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:02.045128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba5ab029-0a45-4f72-a975-54ee3b511e33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:02.045632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba5ab029-0a45-4f72-a975-54ee3b511e33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:02.046659 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba5ab029-0a45-4f72-a975-54ee3b511e33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:02.047105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ba5ab029-0a45-4f72-a975-54ee3b511e33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:02.173228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ba5ab029-0a45-4f72-a975-54ee3b511e33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:02.181119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ba5ab029-0a45-4f72-a975-54ee3b511e33 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146889 May 12 07:19:02.181691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1300/2692] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:02 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:02.772376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-83055879-747d-4004-a727-986b4b522618 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:02.772994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-83055879-747d-4004-a727-986b4b522618 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:02.779290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83055879-747d-4004-a727-986b4b522618 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:02.779767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83055879-747d-4004-a727-986b4b522618 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:02.780541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83055879-747d-4004-a727-986b4b522618 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:02.780980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-83055879-747d-4004-a727-986b4b522618 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:02.842682 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-83055879-747d-4004-a727-986b4b522618 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:02.850380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-83055879-747d-4004-a727-986b4b522618 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081900 May 12 07:19:02.850950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1393/2693] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:02 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:03.198206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-70f93960-8912-431f-a3b4-2914707be8a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:03.198755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-70f93960-8912-431f-a3b4-2914707be8a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:03.205118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70f93960-8912-431f-a3b4-2914707be8a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:03.205574 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70f93960-8912-431f-a3b4-2914707be8a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:03.206339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70f93960-8912-431f-a3b4-2914707be8a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:03.206778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70f93960-8912-431f-a3b4-2914707be8a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:03.331080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-70f93960-8912-431f-a3b4-2914707be8a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:03.338779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-70f93960-8912-431f-a3b4-2914707be8a8 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.144524 May 12 07:19:03.339346 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1301/2694] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:03 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:03.867557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-51b0c00d-c367-458b-8e88-d79284bbfe8d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:03.868131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-51b0c00d-c367-458b-8e88-d79284bbfe8d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:03.874339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51b0c00d-c367-458b-8e88-d79284bbfe8d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:03.875275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51b0c00d-c367-458b-8e88-d79284bbfe8d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:03.876069 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51b0c00d-c367-458b-8e88-d79284bbfe8d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:03.876504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-51b0c00d-c367-458b-8e88-d79284bbfe8d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:03.939808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-51b0c00d-c367-458b-8e88-d79284bbfe8d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:03.947476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-51b0c00d-c367-458b-8e88-d79284bbfe8d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083930 May 12 07:19:03.948083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1394/2695] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:03 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:04.356315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-276677c5-ced9-425a-9211-5ae47ca66219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:04.357002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-276677c5-ced9-425a-9211-5ae47ca66219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:04.363786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-276677c5-ced9-425a-9211-5ae47ca66219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:04.364238 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-276677c5-ced9-425a-9211-5ae47ca66219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:04.365010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-276677c5-ced9-425a-9211-5ae47ca66219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:04.365448 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-276677c5-ced9-425a-9211-5ae47ca66219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:04.492744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-276677c5-ced9-425a-9211-5ae47ca66219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:04.501338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-276677c5-ced9-425a-9211-5ae47ca66219 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.148921 May 12 07:19:04.501904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1302/2696] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:04 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:04.964937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-145449ab-ffef-4cf3-afbc-6334e44eff6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:04.965531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-145449ab-ffef-4cf3-afbc-6334e44eff6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:04.972561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-145449ab-ffef-4cf3-afbc-6334e44eff6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:04.973040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-145449ab-ffef-4cf3-afbc-6334e44eff6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:04.973843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-145449ab-ffef-4cf3-afbc-6334e44eff6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:04.974283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-145449ab-ffef-4cf3-afbc-6334e44eff6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:05.034683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-145449ab-ffef-4cf3-afbc-6334e44eff6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:05.042444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-145449ab-ffef-4cf3-afbc-6334e44eff6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081489 May 12 07:19:05.043011 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1395/2697] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:04 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:05.518501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e13e1123-8b38-4e02-ae1a-65c80d0787c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:05.519115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e13e1123-8b38-4e02-ae1a-65c80d0787c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:05.525675 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e13e1123-8b38-4e02-ae1a-65c80d0787c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:05.526132 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e13e1123-8b38-4e02-ae1a-65c80d0787c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:05.526906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e13e1123-8b38-4e02-ae1a-65c80d0787c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:05.527384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e13e1123-8b38-4e02-ae1a-65c80d0787c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:05.652649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e13e1123-8b38-4e02-ae1a-65c80d0787c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:05.660428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e13e1123-8b38-4e02-ae1a-65c80d0787c3 tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.146418 May 12 07:19:05.660992 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1303/2698] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:05 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:06.059374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f7b832b9-d199-4836-b84e-31be25530913 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:06.060018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f7b832b9-d199-4836-b84e-31be25530913 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:06.066385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7b832b9-d199-4836-b84e-31be25530913 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:06.073789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7b832b9-d199-4836-b84e-31be25530913 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:06.073789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7b832b9-d199-4836-b84e-31be25530913 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:06.073789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7b832b9-d199-4836-b84e-31be25530913 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:06.129037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f7b832b9-d199-4836-b84e-31be25530913 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:06.136826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f7b832b9-d199-4836-b84e-31be25530913 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081379 May 12 07:19:06.137390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1396/2699] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:06 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:06.677671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3ae7960c-ccc7-423d-9312-5fea63ed573e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:06.678293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3ae7960c-ccc7-423d-9312-5fea63ed573e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] [instance: 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:06.684636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ae7960c-ccc7-423d-9312-5fea63ed573e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:06.685091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ae7960c-ccc7-423d-9312-5fea63ed573e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:06.685862 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ae7960c-ccc7-423d-9312-5fea63ed573e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:06.686302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3ae7960c-ccc7-423d-9312-5fea63ed573e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:06.810455 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3ae7960c-ccc7-423d-9312-5fea63ed573e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392ce5fe3514e7996676d8bcd5cceb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1faa1fff1642a0b9c78bc88800cbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:06.818949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3ae7960c-ccc7-423d-9312-5fea63ed573e tempest-VolumesSnapshotTestJSON-1513271114 tempest-VolumesSnapshotTestJSON-1513271114-project] 10.222.0.25 "GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f" status: 200 len: 1560 microversion: 2.1 time: 0.145159 May 12 07:19:06.819521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1304/2700] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:06 2022] GET /compute/v2.1/servers/19ebfe3f-ca98-4256-96c2-2bdb6f5a838f => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:07.153650 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d78d7388-5e90-453d-834a-08757d1bfba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:07.154262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d78d7388-5e90-453d-834a-08757d1bfba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:07.160778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d78d7388-5e90-453d-834a-08757d1bfba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:07.161234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d78d7388-5e90-453d-834a-08757d1bfba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:07.162008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d78d7388-5e90-453d-834a-08757d1bfba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:07.162451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d78d7388-5e90-453d-834a-08757d1bfba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:07.227957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d78d7388-5e90-453d-834a-08757d1bfba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:07.236125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d78d7388-5e90-453d-834a-08757d1bfba9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.086334 May 12 07:19:07.236685 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1397/2701] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:07 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:08.253322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-996e78cb-35b3-48d3-b497-98dcffe37729 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:08.253849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-996e78cb-35b3-48d3-b497-98dcffe37729 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:08.260230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-996e78cb-35b3-48d3-b497-98dcffe37729 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:08.260685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-996e78cb-35b3-48d3-b497-98dcffe37729 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:08.261448 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-996e78cb-35b3-48d3-b497-98dcffe37729 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:08.261886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-996e78cb-35b3-48d3-b497-98dcffe37729 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:08.322532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-996e78cb-35b3-48d3-b497-98dcffe37729 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:08.331208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-996e78cb-35b3-48d3-b497-98dcffe37729 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081828 May 12 07:19:08.331831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1305/2702] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:08 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:09.227162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-388e8ea3-0f31-4280-aa83-513b54ad116e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:09.227786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-388e8ea3-0f31-4280-aa83-513b54ad116e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:09.235223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-388e8ea3-0f31-4280-aa83-513b54ad116e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:09.235863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-388e8ea3-0f31-4280-aa83-513b54ad116e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:09.237085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-388e8ea3-0f31-4280-aa83-513b54ad116e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:09.237612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-388e8ea3-0f31-4280-aa83-513b54ad116e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:09.263634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-388e8ea3-0f31-4280-aa83-513b54ad116e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:19:09.348400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7c41934a-05c4-422d-95e4-87bf69110537 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:09.349850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7c41934a-05c4-422d-95e4-87bf69110537 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:09.356298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7c41934a-05c4-422d-95e4-87bf69110537 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:09.356748 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7c41934a-05c4-422d-95e4-87bf69110537 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:09.357551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7c41934a-05c4-422d-95e4-87bf69110537 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:09.358023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7c41934a-05c4-422d-95e4-87bf69110537 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:09.419035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7c41934a-05c4-422d-95e4-87bf69110537 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:09.427915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7c41934a-05c4-422d-95e4-87bf69110537 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083424 May 12 07:19:09.428520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1306/2703] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:09 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:09.553899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-388e8ea3-0f31-4280-aa83-513b54ad116e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 204 len: 0 microversion: 2.1 time: 0.330261 May 12 07:19:09.554412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1398/2704] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:19:09 2022] DELETE /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:19:09.562409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f6601fc6-18f6-42aa-88f9-f19148619783 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:09.565407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f6601fc6-18f6-42aa-88f9-f19148619783 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:09.569135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6601fc6-18f6-42aa-88f9-f19148619783 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:09.570086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6601fc6-18f6-42aa-88f9-f19148619783 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:09.570345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6601fc6-18f6-42aa-88f9-f19148619783 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:09.570777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f6601fc6-18f6-42aa-88f9-f19148619783 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:09.702274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f6601fc6-18f6-42aa-88f9-f19148619783 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:09.710529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f6601fc6-18f6-42aa-88f9-f19148619783 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.151970 May 12 07:19:09.711098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1307/2705] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:10.444992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0c15f51e-e5eb-4213-a26d-c2298f3599d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:10.445683 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0c15f51e-e5eb-4213-a26d-c2298f3599d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:10.451908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c15f51e-e5eb-4213-a26d-c2298f3599d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:10.452348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c15f51e-e5eb-4213-a26d-c2298f3599d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:10.453109 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c15f51e-e5eb-4213-a26d-c2298f3599d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:10.453540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c15f51e-e5eb-4213-a26d-c2298f3599d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:10.519122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0c15f51e-e5eb-4213-a26d-c2298f3599d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:10.526899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0c15f51e-e5eb-4213-a26d-c2298f3599d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.086128 May 12 07:19:10.527458 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1399/2706] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:10 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:10.728594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-35d39666-39c6-4e1c-870a-6c879d312561 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:10.729135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-35d39666-39c6-4e1c-870a-6c879d312561 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:10.736098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35d39666-39c6-4e1c-870a-6c879d312561 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:10.736555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35d39666-39c6-4e1c-870a-6c879d312561 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:10.737329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35d39666-39c6-4e1c-870a-6c879d312561 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:10.737773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-35d39666-39c6-4e1c-870a-6c879d312561 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:10.862372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-35d39666-39c6-4e1c-870a-6c879d312561 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:10.870197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-35d39666-39c6-4e1c-870a-6c879d312561 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145535 May 12 07:19:10.870762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1308/2707] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:11.543742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4b136161-1bdd-40d7-bc4a-4765165b378e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:11.544310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4b136161-1bdd-40d7-bc4a-4765165b378e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:11.550851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b136161-1bdd-40d7-bc4a-4765165b378e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:11.551299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b136161-1bdd-40d7-bc4a-4765165b378e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:11.552092 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b136161-1bdd-40d7-bc4a-4765165b378e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:11.552524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4b136161-1bdd-40d7-bc4a-4765165b378e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:11.611906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4b136161-1bdd-40d7-bc4a-4765165b378e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:11.619509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4b136161-1bdd-40d7-bc4a-4765165b378e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079691 May 12 07:19:11.620091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1400/2708] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:11 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:11.886528 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fdbe4872-6fbf-4d77-9cf2-ca9cc6122197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:11.887066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fdbe4872-6fbf-4d77-9cf2-ca9cc6122197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:11.893340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdbe4872-6fbf-4d77-9cf2-ca9cc6122197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:11.893799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdbe4872-6fbf-4d77-9cf2-ca9cc6122197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:11.894544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdbe4872-6fbf-4d77-9cf2-ca9cc6122197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:11.894977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdbe4872-6fbf-4d77-9cf2-ca9cc6122197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:12.023419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fdbe4872-6fbf-4d77-9cf2-ca9cc6122197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:12.031693 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fdbe4872-6fbf-4d77-9cf2-ca9cc6122197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149090 May 12 07:19:12.032276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1309/2709] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:12.636710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-10776c9b-6408-4dc4-9ef1-d32c60bbf925 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:12.637323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-10776c9b-6408-4dc4-9ef1-d32c60bbf925 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:12.644298 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10776c9b-6408-4dc4-9ef1-d32c60bbf925 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:12.644752 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10776c9b-6408-4dc4-9ef1-d32c60bbf925 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:12.645519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10776c9b-6408-4dc4-9ef1-d32c60bbf925 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:12.645961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-10776c9b-6408-4dc4-9ef1-d32c60bbf925 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:12.705885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-10776c9b-6408-4dc4-9ef1-d32c60bbf925 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:12.713573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-10776c9b-6408-4dc4-9ef1-d32c60bbf925 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080714 May 12 07:19:12.714131 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1401/2710] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:12 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:13.048238 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-529fbe9c-2819-471b-a915-6319706f4bdd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:13.048887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-529fbe9c-2819-471b-a915-6319706f4bdd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:13.055235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-529fbe9c-2819-471b-a915-6319706f4bdd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:13.055709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-529fbe9c-2819-471b-a915-6319706f4bdd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:13.056525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-529fbe9c-2819-471b-a915-6319706f4bdd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:13.056972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-529fbe9c-2819-471b-a915-6319706f4bdd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:13.179980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-529fbe9c-2819-471b-a915-6319706f4bdd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:13.188393 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-529fbe9c-2819-471b-a915-6319706f4bdd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144314 May 12 07:19:13.188963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1310/2711] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:13.731214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-333d3aa7-b194-4624-9ea2-2f10235df31c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:13.731820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-333d3aa7-b194-4624-9ea2-2f10235df31c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:13.738627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-333d3aa7-b194-4624-9ea2-2f10235df31c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:13.739071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-333d3aa7-b194-4624-9ea2-2f10235df31c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:13.739866 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-333d3aa7-b194-4624-9ea2-2f10235df31c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:13.740304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-333d3aa7-b194-4624-9ea2-2f10235df31c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:13.802137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-333d3aa7-b194-4624-9ea2-2f10235df31c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:13.809854 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-333d3aa7-b194-4624-9ea2-2f10235df31c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082629 May 12 07:19:13.810422 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1402/2712] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:13 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:14.206041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-034c58ea-8026-4c7f-9a11-e3882a704f35 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:14.206658 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-034c58ea-8026-4c7f-9a11-e3882a704f35 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:14.213123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-034c58ea-8026-4c7f-9a11-e3882a704f35 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:14.213578 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-034c58ea-8026-4c7f-9a11-e3882a704f35 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:14.214380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-034c58ea-8026-4c7f-9a11-e3882a704f35 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:14.214821 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-034c58ea-8026-4c7f-9a11-e3882a704f35 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:14.341145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-034c58ea-8026-4c7f-9a11-e3882a704f35 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:14.348936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-034c58ea-8026-4c7f-9a11-e3882a704f35 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147283 May 12 07:19:14.349505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1311/2713] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:14.826013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c71ff4f2-79aa-44f2-9ba5-700dc573f8bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:14.826649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c71ff4f2-79aa-44f2-9ba5-700dc573f8bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:14.833008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c71ff4f2-79aa-44f2-9ba5-700dc573f8bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:14.833459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c71ff4f2-79aa-44f2-9ba5-700dc573f8bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:14.834214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c71ff4f2-79aa-44f2-9ba5-700dc573f8bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:14.834647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c71ff4f2-79aa-44f2-9ba5-700dc573f8bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:14.894567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c71ff4f2-79aa-44f2-9ba5-700dc573f8bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:14.902239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c71ff4f2-79aa-44f2-9ba5-700dc573f8bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080075 May 12 07:19:14.902800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1403/2714] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:14 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:15.365857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-084feef8-96e5-4a8c-9048-055596e5280f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:15.366477 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-084feef8-96e5-4a8c-9048-055596e5280f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:15.372846 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-084feef8-96e5-4a8c-9048-055596e5280f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:15.373285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-084feef8-96e5-4a8c-9048-055596e5280f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:15.374050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-084feef8-96e5-4a8c-9048-055596e5280f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:15.374489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-084feef8-96e5-4a8c-9048-055596e5280f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:15.499640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-084feef8-96e5-4a8c-9048-055596e5280f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:15.507377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-084feef8-96e5-4a8c-9048-055596e5280f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145377 May 12 07:19:15.507979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1312/2715] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:15.918315 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-45b25c67-df1c-47e3-b47a-bd73211ccf6e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:15.918966 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-45b25c67-df1c-47e3-b47a-bd73211ccf6e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:15.925558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45b25c67-df1c-47e3-b47a-bd73211ccf6e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:15.926083 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45b25c67-df1c-47e3-b47a-bd73211ccf6e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:15.926864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45b25c67-df1c-47e3-b47a-bd73211ccf6e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:15.927308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-45b25c67-df1c-47e3-b47a-bd73211ccf6e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:15.993070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-45b25c67-df1c-47e3-b47a-bd73211ccf6e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:16.001225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-45b25c67-df1c-47e3-b47a-bd73211ccf6e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.086733 May 12 07:19:16.001834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1404/2716] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:15 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:16.524863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-312849f9-11a6-4d01-ad92-9d77f4138a5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:16.525483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-312849f9-11a6-4d01-ad92-9d77f4138a5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:16.532314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-312849f9-11a6-4d01-ad92-9d77f4138a5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:16.532772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-312849f9-11a6-4d01-ad92-9d77f4138a5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:16.533547 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-312849f9-11a6-4d01-ad92-9d77f4138a5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:16.533990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-312849f9-11a6-4d01-ad92-9d77f4138a5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:16.661393 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-312849f9-11a6-4d01-ad92-9d77f4138a5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:16.669176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-312849f9-11a6-4d01-ad92-9d77f4138a5c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148205 May 12 07:19:16.669749 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1313/2717] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:17.017767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-553efa98-28d6-4b71-b981-5b6be63b3d90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:17.018380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-553efa98-28d6-4b71-b981-5b6be63b3d90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:17.024636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-553efa98-28d6-4b71-b981-5b6be63b3d90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:17.025080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-553efa98-28d6-4b71-b981-5b6be63b3d90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:17.025840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-553efa98-28d6-4b71-b981-5b6be63b3d90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:17.026275 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-553efa98-28d6-4b71-b981-5b6be63b3d90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:17.090542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-553efa98-28d6-4b71-b981-5b6be63b3d90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:17.098788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-553efa98-28d6-4b71-b981-5b6be63b3d90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085364 May 12 07:19:17.099346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1405/2718] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:17 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:17.687631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-573b6d18-4f68-46fa-a207-67dd5678b86d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:17.688308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-573b6d18-4f68-46fa-a207-67dd5678b86d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:17.694412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-573b6d18-4f68-46fa-a207-67dd5678b86d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:17.694860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-573b6d18-4f68-46fa-a207-67dd5678b86d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:17.695619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-573b6d18-4f68-46fa-a207-67dd5678b86d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:17.696075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-573b6d18-4f68-46fa-a207-67dd5678b86d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:17.819613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-573b6d18-4f68-46fa-a207-67dd5678b86d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:17.827274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-573b6d18-4f68-46fa-a207-67dd5678b86d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144176 May 12 07:19:17.827929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1314/2719] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:17 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:18.115466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8c9a350b-c4dd-4977-a0b1-5c5b8f290877 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:18.116171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8c9a350b-c4dd-4977-a0b1-5c5b8f290877 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:18.122389 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c9a350b-c4dd-4977-a0b1-5c5b8f290877 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:18.122834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c9a350b-c4dd-4977-a0b1-5c5b8f290877 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:18.123592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c9a350b-c4dd-4977-a0b1-5c5b8f290877 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:18.124079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8c9a350b-c4dd-4977-a0b1-5c5b8f290877 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:18.184001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8c9a350b-c4dd-4977-a0b1-5c5b8f290877 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:18.191789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8c9a350b-c4dd-4977-a0b1-5c5b8f290877 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080165 May 12 07:19:18.192361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1406/2720] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:18 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:18.844234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2e255230-e4f8-4842-823f-510b346e74a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:18.844845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2e255230-e4f8-4842-823f-510b346e74a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:18.851082 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2e255230-e4f8-4842-823f-510b346e74a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:18.851530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2e255230-e4f8-4842-823f-510b346e74a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:18.852316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2e255230-e4f8-4842-823f-510b346e74a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:18.852759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2e255230-e4f8-4842-823f-510b346e74a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:18.979085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2e255230-e4f8-4842-823f-510b346e74a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:18.986877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2e255230-e4f8-4842-823f-510b346e74a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146449 May 12 07:19:18.987462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1315/2721] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:19.208781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-123af503-a89d-46ad-beed-7324f866c1a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:19.209336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-123af503-a89d-46ad-beed-7324f866c1a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:19.215624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-123af503-a89d-46ad-beed-7324f866c1a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:19.216117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-123af503-a89d-46ad-beed-7324f866c1a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:19.216883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-123af503-a89d-46ad-beed-7324f866c1a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:19.217321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-123af503-a89d-46ad-beed-7324f866c1a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:19.277621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-123af503-a89d-46ad-beed-7324f866c1a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:19.285462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-123af503-a89d-46ad-beed-7324f866c1a5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080679 May 12 07:19:19.286987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1407/2722] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:19 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:20.003647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a3953039-cf8d-4329-b617-47b0e1836c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:20.004289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a3953039-cf8d-4329-b617-47b0e1836c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:20.010558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a3953039-cf8d-4329-b617-47b0e1836c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:20.011009 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a3953039-cf8d-4329-b617-47b0e1836c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:20.011802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a3953039-cf8d-4329-b617-47b0e1836c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:20.012248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a3953039-cf8d-4329-b617-47b0e1836c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:20.138029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a3953039-cf8d-4329-b617-47b0e1836c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:20.146280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a3953039-cf8d-4329-b617-47b0e1836c56 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146551 May 12 07:19:20.146842 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1316/2723] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:20.302733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-46322e48-22af-4657-b234-000f264b96ba tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:20.303260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-46322e48-22af-4657-b234-000f264b96ba tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:20.309624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46322e48-22af-4657-b234-000f264b96ba tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:20.310071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46322e48-22af-4657-b234-000f264b96ba tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:20.310832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46322e48-22af-4657-b234-000f264b96ba tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:20.311783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46322e48-22af-4657-b234-000f264b96ba tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:20.374734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-46322e48-22af-4657-b234-000f264b96ba tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:20.382616 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-46322e48-22af-4657-b234-000f264b96ba tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083893 May 12 07:19:20.383176 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1408/2724] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:20 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:21.164200 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3e0309e5-4240-405d-b152-27cbab8f7182 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:21.164815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3e0309e5-4240-405d-b152-27cbab8f7182 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:21.171986 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e0309e5-4240-405d-b152-27cbab8f7182 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:21.172432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e0309e5-4240-405d-b152-27cbab8f7182 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:21.173192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e0309e5-4240-405d-b152-27cbab8f7182 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:21.173629 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e0309e5-4240-405d-b152-27cbab8f7182 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:21.299247 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3e0309e5-4240-405d-b152-27cbab8f7182 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:21.307001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3e0309e5-4240-405d-b152-27cbab8f7182 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146734 May 12 07:19:21.307592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1317/2725] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:21 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:21.399971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2117e641-a302-4a91-93e4-6eac5a606ba5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:21.400589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2117e641-a302-4a91-93e4-6eac5a606ba5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:21.407123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2117e641-a302-4a91-93e4-6eac5a606ba5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:21.407576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2117e641-a302-4a91-93e4-6eac5a606ba5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:21.408376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2117e641-a302-4a91-93e4-6eac5a606ba5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:21.408818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2117e641-a302-4a91-93e4-6eac5a606ba5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:21.469069 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2117e641-a302-4a91-93e4-6eac5a606ba5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:21.476780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2117e641-a302-4a91-93e4-6eac5a606ba5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080756 May 12 07:19:21.477352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1409/2726] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:21 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:22.324057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-58112fd2-ea79-4302-bc5a-bd84b6919540 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:22.324627 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-58112fd2-ea79-4302-bc5a-bd84b6919540 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:22.330919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58112fd2-ea79-4302-bc5a-bd84b6919540 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:22.331368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58112fd2-ea79-4302-bc5a-bd84b6919540 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:22.332158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58112fd2-ea79-4302-bc5a-bd84b6919540 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:22.332592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-58112fd2-ea79-4302-bc5a-bd84b6919540 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:22.459469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-58112fd2-ea79-4302-bc5a-bd84b6919540 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:22.467215 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-58112fd2-ea79-4302-bc5a-bd84b6919540 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147083 May 12 07:19:22.467808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1318/2727] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:22.493269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9c00ecdc-0716-459a-90f1-38b88f216a35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:22.493894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9c00ecdc-0716-459a-90f1-38b88f216a35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:22.500925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c00ecdc-0716-459a-90f1-38b88f216a35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:22.501386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c00ecdc-0716-459a-90f1-38b88f216a35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:22.502160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c00ecdc-0716-459a-90f1-38b88f216a35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:22.502602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c00ecdc-0716-459a-90f1-38b88f216a35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:22.562658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9c00ecdc-0716-459a-90f1-38b88f216a35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:22.570292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9c00ecdc-0716-459a-90f1-38b88f216a35 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080857 May 12 07:19:22.570865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1410/2728] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:22 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:23.484197 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-990c5526-559c-4e39-9697-efc21005c679 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:23.484804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-990c5526-559c-4e39-9697-efc21005c679 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:23.491006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-990c5526-559c-4e39-9697-efc21005c679 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:23.491452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-990c5526-559c-4e39-9697-efc21005c679 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:23.492245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-990c5526-559c-4e39-9697-efc21005c679 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:23.492676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-990c5526-559c-4e39-9697-efc21005c679 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:23.586423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b1aad4b8-fc20-4d31-8016-5b71a16504bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:23.587034 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b1aad4b8-fc20-4d31-8016-5b71a16504bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:23.593276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1aad4b8-fc20-4d31-8016-5b71a16504bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:23.593721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1aad4b8-fc20-4d31-8016-5b71a16504bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:23.594484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1aad4b8-fc20-4d31-8016-5b71a16504bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:23.594918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1aad4b8-fc20-4d31-8016-5b71a16504bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:23.616246 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-990c5526-559c-4e39-9697-efc21005c679 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:23.624443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-990c5526-559c-4e39-9697-efc21005c679 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143629 May 12 07:19:23.625015 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1319/2729] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:23.657305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b1aad4b8-fc20-4d31-8016-5b71a16504bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:23.665019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b1aad4b8-fc20-4d31-8016-5b71a16504bb tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082410 May 12 07:19:23.665585 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1411/2730] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:23 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:24.641739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fcf80e0d-ad7a-45f1-94ce-4b27340d292b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:24.642383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fcf80e0d-ad7a-45f1-94ce-4b27340d292b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:24.648611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fcf80e0d-ad7a-45f1-94ce-4b27340d292b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:24.649055 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fcf80e0d-ad7a-45f1-94ce-4b27340d292b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:24.649810 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fcf80e0d-ad7a-45f1-94ce-4b27340d292b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:24.650244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fcf80e0d-ad7a-45f1-94ce-4b27340d292b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:24.682491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9166ecc2-32bb-44e2-88ab-2fcee12b75c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:24.683219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9166ecc2-32bb-44e2-88ab-2fcee12b75c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:24.689785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9166ecc2-32bb-44e2-88ab-2fcee12b75c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:24.690321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9166ecc2-32bb-44e2-88ab-2fcee12b75c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:24.691214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9166ecc2-32bb-44e2-88ab-2fcee12b75c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:24.691750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9166ecc2-32bb-44e2-88ab-2fcee12b75c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:24.762978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9166ecc2-32bb-44e2-88ab-2fcee12b75c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:24.771411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9166ecc2-32bb-44e2-88ab-2fcee12b75c0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.092754 May 12 07:19:24.772027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1412/2731] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:24 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:24.807509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fcf80e0d-ad7a-45f1-94ce-4b27340d292b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:24.807509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fcf80e0d-ad7a-45f1-94ce-4b27340d292b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.168288 May 12 07:19:24.807509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1320/2732] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:25.788923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-15264ab1-b627-4b83-a228-1da337bb72d0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:25.789541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-15264ab1-b627-4b83-a228-1da337bb72d0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:25.795903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15264ab1-b627-4b83-a228-1da337bb72d0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:25.796616 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15264ab1-b627-4b83-a228-1da337bb72d0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:25.797383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15264ab1-b627-4b83-a228-1da337bb72d0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:25.797822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-15264ab1-b627-4b83-a228-1da337bb72d0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:25.822140 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-96b9a8cc-faff-4d13-ba15-f7c9fefb55b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:25.822773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-96b9a8cc-faff-4d13-ba15-f7c9fefb55b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:25.830065 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96b9a8cc-faff-4d13-ba15-f7c9fefb55b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:25.830516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96b9a8cc-faff-4d13-ba15-f7c9fefb55b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:25.831276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96b9a8cc-faff-4d13-ba15-f7c9fefb55b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:25.831725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96b9a8cc-faff-4d13-ba15-f7c9fefb55b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:25.858656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-15264ab1-b627-4b83-a228-1da337bb72d0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:25.866735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-15264ab1-b627-4b83-a228-1da337bb72d0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081597 May 12 07:19:25.867319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1413/2733] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:25 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:26.065355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-96b9a8cc-faff-4d13-ba15-f7c9fefb55b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:26.073257 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-96b9a8cc-faff-4d13-ba15-f7c9fefb55b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.254910 May 12 07:19:26.073837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1321/2734] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:26.884468 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1c594b32-5982-43ea-8fb8-c5a361d20295 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:26.885082 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1c594b32-5982-43ea-8fb8-c5a361d20295 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:26.891351 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c594b32-5982-43ea-8fb8-c5a361d20295 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:26.891844 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c594b32-5982-43ea-8fb8-c5a361d20295 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:26.892612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c594b32-5982-43ea-8fb8-c5a361d20295 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:26.893054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1c594b32-5982-43ea-8fb8-c5a361d20295 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:26.953062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1c594b32-5982-43ea-8fb8-c5a361d20295 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:26.960832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1c594b32-5982-43ea-8fb8-c5a361d20295 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080219 May 12 07:19:26.961400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1414/2735] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:26 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:27.090094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cc74b144-aa2e-4dc6-baca-065638e372bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:27.090702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cc74b144-aa2e-4dc6-baca-065638e372bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:27.097458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc74b144-aa2e-4dc6-baca-065638e372bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:27.097906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc74b144-aa2e-4dc6-baca-065638e372bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:27.098661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc74b144-aa2e-4dc6-baca-065638e372bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:27.099097 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc74b144-aa2e-4dc6-baca-065638e372bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:27.224635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cc74b144-aa2e-4dc6-baca-065638e372bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:27.232329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cc74b144-aa2e-4dc6-baca-065638e372bf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146081 May 12 07:19:27.233514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1322/2736] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:27.977675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3344fa1d-3c9a-4f19-9d27-c0ba11dad344 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:27.978284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3344fa1d-3c9a-4f19-9d27-c0ba11dad344 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:27.984570 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3344fa1d-3c9a-4f19-9d27-c0ba11dad344 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:27.985023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3344fa1d-3c9a-4f19-9d27-c0ba11dad344 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:27.985778 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3344fa1d-3c9a-4f19-9d27-c0ba11dad344 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:27.986213 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3344fa1d-3c9a-4f19-9d27-c0ba11dad344 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:28.048782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3344fa1d-3c9a-4f19-9d27-c0ba11dad344 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:28.056411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3344fa1d-3c9a-4f19-9d27-c0ba11dad344 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082624 May 12 07:19:28.056971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1415/2737] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:27 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:28.250397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-786e6bfd-2a38-4690-9570-96a057b509a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:28.251013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-786e6bfd-2a38-4690-9570-96a057b509a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:28.257329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-786e6bfd-2a38-4690-9570-96a057b509a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:28.257776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-786e6bfd-2a38-4690-9570-96a057b509a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:28.258533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-786e6bfd-2a38-4690-9570-96a057b509a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:28.258967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-786e6bfd-2a38-4690-9570-96a057b509a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:28.380923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-786e6bfd-2a38-4690-9570-96a057b509a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:28.388606 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-786e6bfd-2a38-4690-9570-96a057b509a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.142612 May 12 07:19:28.389204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1323/2738] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:29.073629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-503239a7-7023-4252-b523-d23f9cf2bbef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:29.074247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-503239a7-7023-4252-b523-d23f9cf2bbef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:29.081022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-503239a7-7023-4252-b523-d23f9cf2bbef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:29.081475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-503239a7-7023-4252-b523-d23f9cf2bbef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:29.082238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-503239a7-7023-4252-b523-d23f9cf2bbef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:29.082680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-503239a7-7023-4252-b523-d23f9cf2bbef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:29.141818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-503239a7-7023-4252-b523-d23f9cf2bbef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:29.149908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-503239a7-7023-4252-b523-d23f9cf2bbef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079860 May 12 07:19:29.150764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1416/2739] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:29 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:29.405541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-226c21b4-e054-445f-ae36-4113095007f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:29.406147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-226c21b4-e054-445f-ae36-4113095007f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:29.412387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-226c21b4-e054-445f-ae36-4113095007f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:29.412841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-226c21b4-e054-445f-ae36-4113095007f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:29.413600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-226c21b4-e054-445f-ae36-4113095007f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:29.414035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-226c21b4-e054-445f-ae36-4113095007f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:29.539557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-226c21b4-e054-445f-ae36-4113095007f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:29.547725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-226c21b4-e054-445f-ae36-4113095007f8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145992 May 12 07:19:29.548253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1324/2740] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:30.167870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3363192b-62c0-4246-9396-c4bd24116e90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:30.168505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3363192b-62c0-4246-9396-c4bd24116e90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:30.175679 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3363192b-62c0-4246-9396-c4bd24116e90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:30.176136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3363192b-62c0-4246-9396-c4bd24116e90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:30.176904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3363192b-62c0-4246-9396-c4bd24116e90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:30.177339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3363192b-62c0-4246-9396-c4bd24116e90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:30.236981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3363192b-62c0-4246-9396-c4bd24116e90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:30.256322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3363192b-62c0-4246-9396-c4bd24116e90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080667 May 12 07:19:30.256322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1417/2741] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:30 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:30.564591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a7368fa8-29e9-4281-a549-143c5b58306a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:30.565156 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a7368fa8-29e9-4281-a549-143c5b58306a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:30.571418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7368fa8-29e9-4281-a549-143c5b58306a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:30.571900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7368fa8-29e9-4281-a549-143c5b58306a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:30.572665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7368fa8-29e9-4281-a549-143c5b58306a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:30.573098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a7368fa8-29e9-4281-a549-143c5b58306a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:30.695232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a7368fa8-29e9-4281-a549-143c5b58306a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:30.703406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a7368fa8-29e9-4281-a549-143c5b58306a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.142704 May 12 07:19:30.704005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1325/2742] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:31.261696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f9095083-816d-4225-a9f0-fb47b5de2086 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:31.262258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f9095083-816d-4225-a9f0-fb47b5de2086 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:31.268501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9095083-816d-4225-a9f0-fb47b5de2086 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:31.268948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9095083-816d-4225-a9f0-fb47b5de2086 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:31.269706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9095083-816d-4225-a9f0-fb47b5de2086 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:31.270140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f9095083-816d-4225-a9f0-fb47b5de2086 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:31.334824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f9095083-816d-4225-a9f0-fb47b5de2086 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:31.342495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f9095083-816d-4225-a9f0-fb47b5de2086 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084702 May 12 07:19:31.343060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1418/2743] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:31 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:31.721145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f41b2574-2403-4b71-b45f-1debcc447690 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:31.721702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f41b2574-2403-4b71-b45f-1debcc447690 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:31.727557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f41b2574-2403-4b71-b45f-1debcc447690 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:31.728081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f41b2574-2403-4b71-b45f-1debcc447690 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:31.728845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f41b2574-2403-4b71-b45f-1debcc447690 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:31.729286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f41b2574-2403-4b71-b45f-1debcc447690 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:31.855164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f41b2574-2403-4b71-b45f-1debcc447690 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:31.863532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f41b2574-2403-4b71-b45f-1debcc447690 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147076 May 12 07:19:31.864136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1326/2744] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:32.359126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5ddfab39-94e5-4596-a6cb-2726d6574a80 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:32.359670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5ddfab39-94e5-4596-a6cb-2726d6574a80 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:32.365921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ddfab39-94e5-4596-a6cb-2726d6574a80 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:32.366372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ddfab39-94e5-4596-a6cb-2726d6574a80 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:32.367142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ddfab39-94e5-4596-a6cb-2726d6574a80 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:32.367583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ddfab39-94e5-4596-a6cb-2726d6574a80 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:32.426735 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5ddfab39-94e5-4596-a6cb-2726d6574a80 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:32.434334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5ddfab39-94e5-4596-a6cb-2726d6574a80 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079114 May 12 07:19:32.434909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1419/2745] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:32 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:32.884060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b5f6de15-decf-4143-9a84-8ac0c5abf318 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:32.884676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b5f6de15-decf-4143-9a84-8ac0c5abf318 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:32.891154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5f6de15-decf-4143-9a84-8ac0c5abf318 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:32.891608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5f6de15-decf-4143-9a84-8ac0c5abf318 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:32.892401 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5f6de15-decf-4143-9a84-8ac0c5abf318 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:32.892836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b5f6de15-decf-4143-9a84-8ac0c5abf318 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:33.020886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b5f6de15-decf-4143-9a84-8ac0c5abf318 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:33.028695 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b5f6de15-decf-4143-9a84-8ac0c5abf318 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148517 May 12 07:19:33.029264 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1327/2746] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:33.451811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8d211607-8513-40f2-bcb8-2f7a772bfb8f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:33.452427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8d211607-8513-40f2-bcb8-2f7a772bfb8f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:33.458764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d211607-8513-40f2-bcb8-2f7a772bfb8f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:33.459220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d211607-8513-40f2-bcb8-2f7a772bfb8f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:33.460014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d211607-8513-40f2-bcb8-2f7a772bfb8f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:33.460455 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8d211607-8513-40f2-bcb8-2f7a772bfb8f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:33.521217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8d211607-8513-40f2-bcb8-2f7a772bfb8f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:33.529958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8d211607-8513-40f2-bcb8-2f7a772bfb8f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081911 May 12 07:19:33.535978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1420/2747] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:33 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:34.046445 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-89d14ee7-e77b-4e44-bd17-e3112d0e72a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:34.047066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-89d14ee7-e77b-4e44-bd17-e3112d0e72a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:34.053442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-89d14ee7-e77b-4e44-bd17-e3112d0e72a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:34.053890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-89d14ee7-e77b-4e44-bd17-e3112d0e72a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:34.054655 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-89d14ee7-e77b-4e44-bd17-e3112d0e72a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:34.055092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-89d14ee7-e77b-4e44-bd17-e3112d0e72a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:34.178580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-89d14ee7-e77b-4e44-bd17-e3112d0e72a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:34.186936 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-89d14ee7-e77b-4e44-bd17-e3112d0e72a6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144610 May 12 07:19:34.187508 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1328/2748] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:34.547651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cd4c6bea-330f-4d35-bde2-139249bdbc83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:34.548322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cd4c6bea-330f-4d35-bde2-139249bdbc83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:34.554845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd4c6bea-330f-4d35-bde2-139249bdbc83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:34.555300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd4c6bea-330f-4d35-bde2-139249bdbc83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:34.556102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd4c6bea-330f-4d35-bde2-139249bdbc83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:34.556657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cd4c6bea-330f-4d35-bde2-139249bdbc83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:34.620012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cd4c6bea-330f-4d35-bde2-139249bdbc83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:34.627983 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cd4c6bea-330f-4d35-bde2-139249bdbc83 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085411 May 12 07:19:34.628566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1421/2749] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:34 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:35.204084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-87fb6ac9-5d25-4a38-a64f-9c3a48fe8ac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:35.204698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-87fb6ac9-5d25-4a38-a64f-9c3a48fe8ac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:35.210959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87fb6ac9-5d25-4a38-a64f-9c3a48fe8ac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:35.211404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87fb6ac9-5d25-4a38-a64f-9c3a48fe8ac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:35.212189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87fb6ac9-5d25-4a38-a64f-9c3a48fe8ac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:35.212621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-87fb6ac9-5d25-4a38-a64f-9c3a48fe8ac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:35.338283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-87fb6ac9-5d25-4a38-a64f-9c3a48fe8ac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:35.346078 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-87fb6ac9-5d25-4a38-a64f-9c3a48fe8ac7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146396 May 12 07:19:35.346643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1329/2750] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:35 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:35.645316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9973775c-f8db-49e8-98dd-1bb76d4293d6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:35.645863 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9973775c-f8db-49e8-98dd-1bb76d4293d6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:35.652211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9973775c-f8db-49e8-98dd-1bb76d4293d6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:35.652663 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9973775c-f8db-49e8-98dd-1bb76d4293d6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:35.653430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9973775c-f8db-49e8-98dd-1bb76d4293d6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:35.653869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9973775c-f8db-49e8-98dd-1bb76d4293d6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:35.713299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9973775c-f8db-49e8-98dd-1bb76d4293d6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:35.721043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9973775c-f8db-49e8-98dd-1bb76d4293d6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079638 May 12 07:19:35.721616 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1422/2751] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:35 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:36.362947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0b235a18-36ec-48ba-a26c-8a58dc115164 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:36.363558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0b235a18-36ec-48ba-a26c-8a58dc115164 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:36.369934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b235a18-36ec-48ba-a26c-8a58dc115164 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:36.370391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b235a18-36ec-48ba-a26c-8a58dc115164 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:36.371158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b235a18-36ec-48ba-a26c-8a58dc115164 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:36.371597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0b235a18-36ec-48ba-a26c-8a58dc115164 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:36.656645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0b235a18-36ec-48ba-a26c-8a58dc115164 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:36.664240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0b235a18-36ec-48ba-a26c-8a58dc115164 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.305127 May 12 07:19:36.664818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1330/2752] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:36.737516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-25f6a9d4-23df-4e9d-8c3e-ad163284f79c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:36.738122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-25f6a9d4-23df-4e9d-8c3e-ad163284f79c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:36.744347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25f6a9d4-23df-4e9d-8c3e-ad163284f79c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:36.744795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25f6a9d4-23df-4e9d-8c3e-ad163284f79c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:36.745554 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25f6a9d4-23df-4e9d-8c3e-ad163284f79c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:36.745987 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25f6a9d4-23df-4e9d-8c3e-ad163284f79c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:36.806766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-25f6a9d4-23df-4e9d-8c3e-ad163284f79c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:36.815203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-25f6a9d4-23df-4e9d-8c3e-ad163284f79c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081461 May 12 07:19:36.815834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1423/2753] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:36 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:37.681450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-45eb004e-8171-4986-b5b8-edb1606684ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:37.681980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-45eb004e-8171-4986-b5b8-edb1606684ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:37.688245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45eb004e-8171-4986-b5b8-edb1606684ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:37.688697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45eb004e-8171-4986-b5b8-edb1606684ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:37.689457 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45eb004e-8171-4986-b5b8-edb1606684ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:37.689891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45eb004e-8171-4986-b5b8-edb1606684ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:37.815568 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-45eb004e-8171-4986-b5b8-edb1606684ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:37.823459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-45eb004e-8171-4986-b5b8-edb1606684ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145917 May 12 07:19:37.824050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1331/2754] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:37.832786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a009a5ef-3848-4f85-982a-4668eabc2fff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:37.833408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a009a5ef-3848-4f85-982a-4668eabc2fff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:37.839916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a009a5ef-3848-4f85-982a-4668eabc2fff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:37.840376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a009a5ef-3848-4f85-982a-4668eabc2fff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:37.841162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a009a5ef-3848-4f85-982a-4668eabc2fff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:37.842141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a009a5ef-3848-4f85-982a-4668eabc2fff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:37.905296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a009a5ef-3848-4f85-982a-4668eabc2fff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:37.913028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a009a5ef-3848-4f85-982a-4668eabc2fff tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084258 May 12 07:19:37.913603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1424/2755] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:37 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:38.840567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f2bbe13b-6ac5-44d6-9086-f5dc2752f178 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:38.841192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f2bbe13b-6ac5-44d6-9086-f5dc2752f178 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:38.847422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2bbe13b-6ac5-44d6-9086-f5dc2752f178 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:38.847924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2bbe13b-6ac5-44d6-9086-f5dc2752f178 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:38.848698 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2bbe13b-6ac5-44d6-9086-f5dc2752f178 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:38.849135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2bbe13b-6ac5-44d6-9086-f5dc2752f178 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:38.930194 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-883aa8ca-55bd-4815-bc90-c948ac554d95 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:38.930812 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-883aa8ca-55bd-4815-bc90-c948ac554d95 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:38.937731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-883aa8ca-55bd-4815-bc90-c948ac554d95 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:38.938182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-883aa8ca-55bd-4815-bc90-c948ac554d95 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:38.938958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-883aa8ca-55bd-4815-bc90-c948ac554d95 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:38.939395 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-883aa8ca-55bd-4815-bc90-c948ac554d95 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:38.976483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f2bbe13b-6ac5-44d6-9086-f5dc2752f178 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:38.984771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f2bbe13b-6ac5-44d6-9086-f5dc2752f178 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148046 May 12 07:19:38.985421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1332/2756] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:38 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:39.005249 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-883aa8ca-55bd-4815-bc90-c948ac554d95 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:39.012948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-883aa8ca-55bd-4815-bc90-c948ac554d95 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.086539 May 12 07:19:39.013555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1425/2757] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:38 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:40.002370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3c2c3e31-0948-4a3c-8483-298a3e27e2cb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:40.002985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3c2c3e31-0948-4a3c-8483-298a3e27e2cb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:40.009289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c2c3e31-0948-4a3c-8483-298a3e27e2cb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:40.009737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c2c3e31-0948-4a3c-8483-298a3e27e2cb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:40.010500 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c2c3e31-0948-4a3c-8483-298a3e27e2cb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:40.010939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3c2c3e31-0948-4a3c-8483-298a3e27e2cb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:40.029641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-89713632-c651-4071-985a-03c0b8b5352f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:40.030265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-89713632-c651-4071-985a-03c0b8b5352f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:40.036664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89713632-c651-4071-985a-03c0b8b5352f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:40.037126 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89713632-c651-4071-985a-03c0b8b5352f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:40.037908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89713632-c651-4071-985a-03c0b8b5352f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:40.038353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-89713632-c651-4071-985a-03c0b8b5352f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:40.106009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-89713632-c651-4071-985a-03c0b8b5352f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:40.113784 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-89713632-c651-4071-985a-03c0b8b5352f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.088006 May 12 07:19:40.114362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1426/2758] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:40 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:40.161041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3c2c3e31-0948-4a3c-8483-298a3e27e2cb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:40.168819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3c2c3e31-0948-4a3c-8483-298a3e27e2cb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.170793 May 12 07:19:40.169322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1333/2759] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:41.131118 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-24aeb8ed-8f70-40a4-b7e5-885024cc5766 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:41.131759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-24aeb8ed-8f70-40a4-b7e5-885024cc5766 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:41.138068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24aeb8ed-8f70-40a4-b7e5-885024cc5766 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:41.139021 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24aeb8ed-8f70-40a4-b7e5-885024cc5766 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:41.139819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24aeb8ed-8f70-40a4-b7e5-885024cc5766 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:41.140264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-24aeb8ed-8f70-40a4-b7e5-885024cc5766 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:41.186160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e4c455bd-85d8-4cad-87e8-a0bb2283d472 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:41.186880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e4c455bd-85d8-4cad-87e8-a0bb2283d472 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:41.193194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4c455bd-85d8-4cad-87e8-a0bb2283d472 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:41.193647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4c455bd-85d8-4cad-87e8-a0bb2283d472 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:41.194416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4c455bd-85d8-4cad-87e8-a0bb2283d472 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:41.194851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4c455bd-85d8-4cad-87e8-a0bb2283d472 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:41.201981 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-24aeb8ed-8f70-40a4-b7e5-885024cc5766 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:41.209734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-24aeb8ed-8f70-40a4-b7e5-885024cc5766 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082562 May 12 07:19:41.210306 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1427/2760] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:41 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:41.323901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e4c455bd-85d8-4cad-87e8-a0bb2283d472 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:41.332259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e4c455bd-85d8-4cad-87e8-a0bb2283d472 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149927 May 12 07:19:41.332820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1334/2761] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:41 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:42.226340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b9bfc0bd-1bd5-4596-9005-bb47c10a3d68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:42.226957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b9bfc0bd-1bd5-4596-9005-bb47c10a3d68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:42.233947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9bfc0bd-1bd5-4596-9005-bb47c10a3d68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:42.234396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9bfc0bd-1bd5-4596-9005-bb47c10a3d68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:42.235163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9bfc0bd-1bd5-4596-9005-bb47c10a3d68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:42.235603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b9bfc0bd-1bd5-4596-9005-bb47c10a3d68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:42.295145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b9bfc0bd-1bd5-4596-9005-bb47c10a3d68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:42.303235 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b9bfc0bd-1bd5-4596-9005-bb47c10a3d68 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080763 May 12 07:19:42.303868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1428/2762] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:42 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:42.348172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-48ca2728-3a3d-4ed2-ab20-5fdcf0168eab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:42.348789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-48ca2728-3a3d-4ed2-ab20-5fdcf0168eab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:42.355012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-48ca2728-3a3d-4ed2-ab20-5fdcf0168eab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:42.355462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-48ca2728-3a3d-4ed2-ab20-5fdcf0168eab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:42.356280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-48ca2728-3a3d-4ed2-ab20-5fdcf0168eab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:42.356723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-48ca2728-3a3d-4ed2-ab20-5fdcf0168eab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:42.479335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-48ca2728-3a3d-4ed2-ab20-5fdcf0168eab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:42.487035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-48ca2728-3a3d-4ed2-ab20-5fdcf0168eab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.142657 May 12 07:19:42.487598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1335/2763] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:42 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:43.319620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-08681f65-3c8d-4290-91e2-547836902c3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:43.320269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-08681f65-3c8d-4290-91e2-547836902c3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:43.327096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08681f65-3c8d-4290-91e2-547836902c3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:43.327542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08681f65-3c8d-4290-91e2-547836902c3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:43.328355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08681f65-3c8d-4290-91e2-547836902c3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:43.328786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08681f65-3c8d-4290-91e2-547836902c3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:43.390702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-08681f65-3c8d-4290-91e2-547836902c3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:43.398446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-08681f65-3c8d-4290-91e2-547836902c3c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082661 May 12 07:19:43.399008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1429/2764] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:43 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:43.503815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1e06d095-9cae-4128-9470-258a6430f63a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:43.504436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1e06d095-9cae-4128-9470-258a6430f63a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:43.510730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e06d095-9cae-4128-9470-258a6430f63a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:43.511183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e06d095-9cae-4128-9470-258a6430f63a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:43.511976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e06d095-9cae-4128-9470-258a6430f63a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:43.512418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1e06d095-9cae-4128-9470-258a6430f63a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:43.871349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1e06d095-9cae-4128-9470-258a6430f63a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:43.879561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1e06d095-9cae-4128-9470-258a6430f63a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.379535 May 12 07:19:43.880155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1336/2765] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:44.415774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-08ce8cc3-4f6f-4edd-8556-0f96a5f26dcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:44.416394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-08ce8cc3-4f6f-4edd-8556-0f96a5f26dcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:44.423540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08ce8cc3-4f6f-4edd-8556-0f96a5f26dcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:44.424013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08ce8cc3-4f6f-4edd-8556-0f96a5f26dcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:44.424779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08ce8cc3-4f6f-4edd-8556-0f96a5f26dcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:44.425212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08ce8cc3-4f6f-4edd-8556-0f96a5f26dcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:44.484086 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-08ce8cc3-4f6f-4edd-8556-0f96a5f26dcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:44.491614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-08ce8cc3-4f6f-4edd-8556-0f96a5f26dcd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079737 May 12 07:19:44.492202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1430/2766] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:44 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:44.896958 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c17632fb-53ab-4777-95be-3e5d49a44ca3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:44.897575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c17632fb-53ab-4777-95be-3e5d49a44ca3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:44.904440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c17632fb-53ab-4777-95be-3e5d49a44ca3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:44.904927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c17632fb-53ab-4777-95be-3e5d49a44ca3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:44.905693 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c17632fb-53ab-4777-95be-3e5d49a44ca3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:44.906129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c17632fb-53ab-4777-95be-3e5d49a44ca3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:45.031462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c17632fb-53ab-4777-95be-3e5d49a44ca3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:45.039234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c17632fb-53ab-4777-95be-3e5d49a44ca3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146137 May 12 07:19:45.039818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1337/2767] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:45.508924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7d089c27-d280-4f99-9b14-9c1db76f80a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:45.509531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7d089c27-d280-4f99-9b14-9c1db76f80a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:45.515817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7d089c27-d280-4f99-9b14-9c1db76f80a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:45.516270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7d089c27-d280-4f99-9b14-9c1db76f80a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:45.517025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7d089c27-d280-4f99-9b14-9c1db76f80a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:45.517453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7d089c27-d280-4f99-9b14-9c1db76f80a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:45.578382 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7d089c27-d280-4f99-9b14-9c1db76f80a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:45.586013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7d089c27-d280-4f99-9b14-9c1db76f80a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080947 May 12 07:19:45.586571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1431/2768] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:45 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:46.056461 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c578b8da-2452-46b1-8b4f-df379003056e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:46.057067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c578b8da-2452-46b1-8b4f-df379003056e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:46.063223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c578b8da-2452-46b1-8b4f-df379003056e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:46.063668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c578b8da-2452-46b1-8b4f-df379003056e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:46.071203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c578b8da-2452-46b1-8b4f-df379003056e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:46.071203 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c578b8da-2452-46b1-8b4f-df379003056e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:46.188579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c578b8da-2452-46b1-8b4f-df379003056e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:46.196323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c578b8da-2452-46b1-8b4f-df379003056e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143712 May 12 07:19:46.196891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1338/2769] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:46 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:46.602296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5351ddc7-4a1f-416c-8ad6-8606e0a5f644 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:46.602913 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5351ddc7-4a1f-416c-8ad6-8606e0a5f644 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:46.609270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5351ddc7-4a1f-416c-8ad6-8606e0a5f644 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:46.609719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5351ddc7-4a1f-416c-8ad6-8606e0a5f644 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:46.610492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5351ddc7-4a1f-416c-8ad6-8606e0a5f644 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:46.610936 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5351ddc7-4a1f-416c-8ad6-8606e0a5f644 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:46.672898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5351ddc7-4a1f-416c-8ad6-8606e0a5f644 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:46.680547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5351ddc7-4a1f-416c-8ad6-8606e0a5f644 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082125 May 12 07:19:46.681119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1432/2770] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:46 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:47.213756 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c14ac189-5e81-4a1e-bff3-375cc2fd7601 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:47.214361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c14ac189-5e81-4a1e-bff3-375cc2fd7601 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:47.220786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c14ac189-5e81-4a1e-bff3-375cc2fd7601 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:47.221230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c14ac189-5e81-4a1e-bff3-375cc2fd7601 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:47.221993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c14ac189-5e81-4a1e-bff3-375cc2fd7601 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:47.222428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c14ac189-5e81-4a1e-bff3-375cc2fd7601 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:47.348227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c14ac189-5e81-4a1e-bff3-375cc2fd7601 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:47.356024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c14ac189-5e81-4a1e-bff3-375cc2fd7601 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146087 May 12 07:19:47.356584 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1339/2771] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:47.697742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0c93699a-9fa3-4956-91ad-5d8c96e22c90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:47.698304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0c93699a-9fa3-4956-91ad-5d8c96e22c90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:47.705035 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c93699a-9fa3-4956-91ad-5d8c96e22c90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:47.705480 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c93699a-9fa3-4956-91ad-5d8c96e22c90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:47.706241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c93699a-9fa3-4956-91ad-5d8c96e22c90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:47.706675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0c93699a-9fa3-4956-91ad-5d8c96e22c90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:47.765691 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0c93699a-9fa3-4956-91ad-5d8c96e22c90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:47.773338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0c93699a-9fa3-4956-91ad-5d8c96e22c90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079493 May 12 07:19:47.773899 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1433/2772] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:47 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:48.374162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-475346a3-3138-4632-a04a-bbc17f0229c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:48.374788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-475346a3-3138-4632-a04a-bbc17f0229c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:48.381086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-475346a3-3138-4632-a04a-bbc17f0229c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:48.381537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-475346a3-3138-4632-a04a-bbc17f0229c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:48.382297 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-475346a3-3138-4632-a04a-bbc17f0229c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:48.382729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-475346a3-3138-4632-a04a-bbc17f0229c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:48.508028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-475346a3-3138-4632-a04a-bbc17f0229c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:48.515700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-475346a3-3138-4632-a04a-bbc17f0229c5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145946 May 12 07:19:48.516263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1340/2773] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:48 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:48.790413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2d4ceab2-22ba-4b8d-b5b7-cb0afe844ba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:48.791009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2d4ceab2-22ba-4b8d-b5b7-cb0afe844ba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:48.798144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d4ceab2-22ba-4b8d-b5b7-cb0afe844ba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:48.798597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d4ceab2-22ba-4b8d-b5b7-cb0afe844ba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:48.799363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d4ceab2-22ba-4b8d-b5b7-cb0afe844ba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:48.799834 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d4ceab2-22ba-4b8d-b5b7-cb0afe844ba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:48.859832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2d4ceab2-22ba-4b8d-b5b7-cb0afe844ba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:48.867524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2d4ceab2-22ba-4b8d-b5b7-cb0afe844ba0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080956 May 12 07:19:48.868116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1434/2774] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:48 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:49.533700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1a954f20-e148-4e30-a327-2d3ccb0ce73e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:49.534318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1a954f20-e148-4e30-a327-2d3ccb0ce73e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:49.540667 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a954f20-e148-4e30-a327-2d3ccb0ce73e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:49.541122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a954f20-e148-4e30-a327-2d3ccb0ce73e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:49.541887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a954f20-e148-4e30-a327-2d3ccb0ce73e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:49.542324 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1a954f20-e148-4e30-a327-2d3ccb0ce73e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:49.668521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1a954f20-e148-4e30-a327-2d3ccb0ce73e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:49.677085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1a954f20-e148-4e30-a327-2d3ccb0ce73e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147833 May 12 07:19:49.677645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1341/2775] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:49 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:49.884442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b052bba9-c0ea-4b0f-a9ca-af3b1293ad29 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:49.884986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b052bba9-c0ea-4b0f-a9ca-af3b1293ad29 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:49.891710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b052bba9-c0ea-4b0f-a9ca-af3b1293ad29 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:49.892189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b052bba9-c0ea-4b0f-a9ca-af3b1293ad29 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:49.892959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b052bba9-c0ea-4b0f-a9ca-af3b1293ad29 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:49.893398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b052bba9-c0ea-4b0f-a9ca-af3b1293ad29 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:49.956718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b052bba9-c0ea-4b0f-a9ca-af3b1293ad29 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:49.964646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b052bba9-c0ea-4b0f-a9ca-af3b1293ad29 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084166 May 12 07:19:49.965222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1435/2776] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:49 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:50.693978 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b3dc0850-4814-495a-a540-08850151fc17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:50.694576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b3dc0850-4814-495a-a540-08850151fc17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:50.700844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3dc0850-4814-495a-a540-08850151fc17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:50.701530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3dc0850-4814-495a-a540-08850151fc17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:50.702323 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3dc0850-4814-495a-a540-08850151fc17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:50.702763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b3dc0850-4814-495a-a540-08850151fc17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:50.827047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b3dc0850-4814-495a-a540-08850151fc17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:50.834713 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b3dc0850-4814-495a-a540-08850151fc17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144605 May 12 07:19:50.835278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1342/2777] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:50.982060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e6f70af3-460e-4164-a4cd-a1384ab81a1f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:50.983182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e6f70af3-460e-4164-a4cd-a1384ab81a1f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:50.989537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6f70af3-460e-4164-a4cd-a1384ab81a1f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:50.989990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6f70af3-460e-4164-a4cd-a1384ab81a1f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:50.990762 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6f70af3-460e-4164-a4cd-a1384ab81a1f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:50.991201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e6f70af3-460e-4164-a4cd-a1384ab81a1f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:51.051613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e6f70af3-460e-4164-a4cd-a1384ab81a1f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:51.059163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e6f70af3-460e-4164-a4cd-a1384ab81a1f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081017 May 12 07:19:51.059748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1436/2778] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:50 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:51.851733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-45581299-defc-424e-9db4-1208d6d10ea0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:51.852380 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-45581299-defc-424e-9db4-1208d6d10ea0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:51.858630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45581299-defc-424e-9db4-1208d6d10ea0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:51.859083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45581299-defc-424e-9db4-1208d6d10ea0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:51.859886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45581299-defc-424e-9db4-1208d6d10ea0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:51.860331 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45581299-defc-424e-9db4-1208d6d10ea0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:51.987128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-45581299-defc-424e-9db4-1208d6d10ea0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:51.995256 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-45581299-defc-424e-9db4-1208d6d10ea0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147400 May 12 07:19:51.995852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1343/2779] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:52.075704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5e080f25-9e62-4e38-a335-9ab0f0d8d115 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:52.076940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5e080f25-9e62-4e38-a335-9ab0f0d8d115 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:52.082751 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e080f25-9e62-4e38-a335-9ab0f0d8d115 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:52.083208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e080f25-9e62-4e38-a335-9ab0f0d8d115 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:52.084013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e080f25-9e62-4e38-a335-9ab0f0d8d115 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:52.084460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e080f25-9e62-4e38-a335-9ab0f0d8d115 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:52.144477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5e080f25-9e62-4e38-a335-9ab0f0d8d115 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:52.152285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5e080f25-9e62-4e38-a335-9ab0f0d8d115 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080555 May 12 07:19:52.152887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1437/2780] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:52 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:53.012816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-407605ab-f24b-442c-bc6f-25dc26ea472b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:53.013907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-407605ab-f24b-442c-bc6f-25dc26ea472b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:53.020183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-407605ab-f24b-442c-bc6f-25dc26ea472b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:53.020633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-407605ab-f24b-442c-bc6f-25dc26ea472b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:53.021392 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-407605ab-f24b-442c-bc6f-25dc26ea472b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:53.021823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-407605ab-f24b-442c-bc6f-25dc26ea472b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:53.144295 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-407605ab-f24b-442c-bc6f-25dc26ea472b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:53.151939 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-407605ab-f24b-442c-bc6f-25dc26ea472b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143010 May 12 07:19:53.152490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1344/2781] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:53.168911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-95003877-782e-448e-a32e-003bb4a404e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:53.169530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-95003877-782e-448e-a32e-003bb4a404e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:53.176106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95003877-782e-448e-a32e-003bb4a404e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:53.176554 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95003877-782e-448e-a32e-003bb4a404e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:53.177322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95003877-782e-448e-a32e-003bb4a404e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:53.177760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95003877-782e-448e-a32e-003bb4a404e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:53.242440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-95003877-782e-448e-a32e-003bb4a404e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:53.250184 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-95003877-782e-448e-a32e-003bb4a404e4 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085093 May 12 07:19:53.250752 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1438/2782] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:53 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:54.169607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ed1fb225-7eb6-4213-8457-f52effe82533 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:54.170226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ed1fb225-7eb6-4213-8457-f52effe82533 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:54.177489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed1fb225-7eb6-4213-8457-f52effe82533 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:54.177937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed1fb225-7eb6-4213-8457-f52effe82533 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:54.178702 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed1fb225-7eb6-4213-8457-f52effe82533 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:54.179139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ed1fb225-7eb6-4213-8457-f52effe82533 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:54.266264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0b94616d-afdc-411c-a605-13b25f3d5750 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:54.266875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0b94616d-afdc-411c-a605-13b25f3d5750 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:54.273113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b94616d-afdc-411c-a605-13b25f3d5750 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:54.273562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b94616d-afdc-411c-a605-13b25f3d5750 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:54.274330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b94616d-afdc-411c-a605-13b25f3d5750 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:54.274766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b94616d-afdc-411c-a605-13b25f3d5750 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:54.303628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ed1fb225-7eb6-4213-8457-f52effe82533 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:54.311745 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ed1fb225-7eb6-4213-8457-f52effe82533 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145955 May 12 07:19:54.312322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1345/2783] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:54.334695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0b94616d-afdc-411c-a605-13b25f3d5750 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:54.343071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0b94616d-afdc-411c-a605-13b25f3d5750 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080208 May 12 07:19:54.343648 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1439/2784] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:54 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:55.328938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2d9a373f-8d6f-4324-9397-90a64dde2b69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:55.329551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2d9a373f-8d6f-4324-9397-90a64dde2b69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:55.335940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d9a373f-8d6f-4324-9397-90a64dde2b69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:55.336396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d9a373f-8d6f-4324-9397-90a64dde2b69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:55.337166 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d9a373f-8d6f-4324-9397-90a64dde2b69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:55.337605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2d9a373f-8d6f-4324-9397-90a64dde2b69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:55.360490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e2f6b0b8-7996-4197-85af-2e9d6f36cc5b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:55.361136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e2f6b0b8-7996-4197-85af-2e9d6f36cc5b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:55.367574 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2f6b0b8-7996-4197-85af-2e9d6f36cc5b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:55.368059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2f6b0b8-7996-4197-85af-2e9d6f36cc5b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:55.368843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2f6b0b8-7996-4197-85af-2e9d6f36cc5b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:55.369288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2f6b0b8-7996-4197-85af-2e9d6f36cc5b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:55.445403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e2f6b0b8-7996-4197-85af-2e9d6f36cc5b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:55.453401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e2f6b0b8-7996-4197-85af-2e9d6f36cc5b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.097315 May 12 07:19:55.453985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1440/2785] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:55 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:55.488903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2d9a373f-8d6f-4324-9397-90a64dde2b69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:55.496818 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2d9a373f-8d6f-4324-9397-90a64dde2b69 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.171848 May 12 07:19:55.497381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1346/2786] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:55 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:56.470163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9b3e451c-07d4-4057-b608-0ba6b9801310 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:56.470710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9b3e451c-07d4-4057-b608-0ba6b9801310 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:56.476988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b3e451c-07d4-4057-b608-0ba6b9801310 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:56.477441 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b3e451c-07d4-4057-b608-0ba6b9801310 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:56.478213 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b3e451c-07d4-4057-b608-0ba6b9801310 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:56.478655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b3e451c-07d4-4057-b608-0ba6b9801310 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:56.514740 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-557aac86-5eff-4581-801e-1f6353204e6a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:56.515356 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-557aac86-5eff-4581-801e-1f6353204e6a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:56.521739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-557aac86-5eff-4581-801e-1f6353204e6a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:56.522185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-557aac86-5eff-4581-801e-1f6353204e6a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:56.522961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-557aac86-5eff-4581-801e-1f6353204e6a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:56.523394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-557aac86-5eff-4581-801e-1f6353204e6a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:56.538591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9b3e451c-07d4-4057-b608-0ba6b9801310 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:56.546766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9b3e451c-07d4-4057-b608-0ba6b9801310 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080510 May 12 07:19:56.547349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1441/2787] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:56 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:56.648783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-557aac86-5eff-4581-801e-1f6353204e6a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:56.656543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-557aac86-5eff-4581-801e-1f6353204e6a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146138 May 12 07:19:56.657112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1347/2788] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:57.563895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-16fbc784-504e-4fb3-9d23-fef608529a18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:57.564491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-16fbc784-504e-4fb3-9d23-fef608529a18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:57.570716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16fbc784-504e-4fb3-9d23-fef608529a18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:57.571169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16fbc784-504e-4fb3-9d23-fef608529a18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:57.571984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16fbc784-504e-4fb3-9d23-fef608529a18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:57.572410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16fbc784-504e-4fb3-9d23-fef608529a18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:57.631796 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-16fbc784-504e-4fb3-9d23-fef608529a18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:57.640047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-16fbc784-504e-4fb3-9d23-fef608529a18 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080167 May 12 07:19:57.640614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1442/2789] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:57 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:57.673389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3b861f05-8ba3-4a9b-aa73-f38b8baef6db tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:57.674006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3b861f05-8ba3-4a9b-aa73-f38b8baef6db tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:57.680198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b861f05-8ba3-4a9b-aa73-f38b8baef6db tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:57.680646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b861f05-8ba3-4a9b-aa73-f38b8baef6db tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:57.681409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b861f05-8ba3-4a9b-aa73-f38b8baef6db tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:57.681845 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b861f05-8ba3-4a9b-aa73-f38b8baef6db tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:57.807938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3b861f05-8ba3-4a9b-aa73-f38b8baef6db tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:57.816145 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3b861f05-8ba3-4a9b-aa73-f38b8baef6db tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146691 May 12 07:19:57.816650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1348/2790] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:58.657342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-317506f2-4fed-48a3-84d3-7daeaded7217 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:58.657943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-317506f2-4fed-48a3-84d3-7daeaded7217 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:58.664353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-317506f2-4fed-48a3-84d3-7daeaded7217 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:58.664805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-317506f2-4fed-48a3-84d3-7daeaded7217 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:58.665572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-317506f2-4fed-48a3-84d3-7daeaded7217 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:58.666017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-317506f2-4fed-48a3-84d3-7daeaded7217 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:58.725576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-317506f2-4fed-48a3-84d3-7daeaded7217 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:58.733869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-317506f2-4fed-48a3-84d3-7daeaded7217 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080873 May 12 07:19:58.734438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1443/2791] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:58 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:58.833279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4cbcf765-1c57-41a1-bf64-75870ac57d6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:58.833951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4cbcf765-1c57-41a1-bf64-75870ac57d6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:58.840443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4cbcf765-1c57-41a1-bf64-75870ac57d6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:58.840901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4cbcf765-1c57-41a1-bf64-75870ac57d6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:58.841677 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4cbcf765-1c57-41a1-bf64-75870ac57d6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:58.842626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4cbcf765-1c57-41a1-bf64-75870ac57d6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:58.971735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4cbcf765-1c57-41a1-bf64-75870ac57d6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:58.979349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4cbcf765-1c57-41a1-bf64-75870ac57d6c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149903 May 12 07:19:58.980023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1349/2792] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:19:59.750285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c17f3098-a23e-41c8-b445-e7c8230f12da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:59.750937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c17f3098-a23e-41c8-b445-e7c8230f12da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:19:59.757282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c17f3098-a23e-41c8-b445-e7c8230f12da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:59.757734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c17f3098-a23e-41c8-b445-e7c8230f12da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:59.758506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c17f3098-a23e-41c8-b445-e7c8230f12da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:19:59.758949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c17f3098-a23e-41c8-b445-e7c8230f12da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:19:59.818876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c17f3098-a23e-41c8-b445-e7c8230f12da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:19:59.826687 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c17f3098-a23e-41c8-b445-e7c8230f12da tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080770 May 12 07:19:59.827264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1444/2793] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:59 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:19:59.996306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f1f7f5aa-40e3-4a8a-946f-554795168e88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:19:59.996914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f1f7f5aa-40e3-4a8a-946f-554795168e88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:00.003894 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1f7f5aa-40e3-4a8a-946f-554795168e88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:00.004283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1f7f5aa-40e3-4a8a-946f-554795168e88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:00.005036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1f7f5aa-40e3-4a8a-946f-554795168e88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:00.005467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1f7f5aa-40e3-4a8a-946f-554795168e88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:00.130808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f1f7f5aa-40e3-4a8a-946f-554795168e88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:00.138520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f1f7f5aa-40e3-4a8a-946f-554795168e88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146053 May 12 07:20:00.139084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1350/2794] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:19:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:00.843357 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b4f5daca-df01-4f6e-814f-818689b4caf3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:00.843990 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b4f5daca-df01-4f6e-814f-818689b4caf3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:00.850280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4f5daca-df01-4f6e-814f-818689b4caf3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:00.850725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4f5daca-df01-4f6e-814f-818689b4caf3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:00.851485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4f5daca-df01-4f6e-814f-818689b4caf3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:00.851949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b4f5daca-df01-4f6e-814f-818689b4caf3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:00.913300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b4f5daca-df01-4f6e-814f-818689b4caf3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:00.921642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b4f5daca-df01-4f6e-814f-818689b4caf3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081920 May 12 07:20:00.922211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1445/2795] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:00 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:01.050029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:20:01.050188 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:20:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:20:01.155433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-31c708f1-3cfe-4461-a423-b11281796cdb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:01.155997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-31c708f1-3cfe-4461-a423-b11281796cdb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:01.161925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31c708f1-3cfe-4461-a423-b11281796cdb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:01.162372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31c708f1-3cfe-4461-a423-b11281796cdb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:01.163127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31c708f1-3cfe-4461-a423-b11281796cdb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:01.163563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31c708f1-3cfe-4461-a423-b11281796cdb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:01.286225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-31c708f1-3cfe-4461-a423-b11281796cdb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:01.293837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-31c708f1-3cfe-4461-a423-b11281796cdb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.142457 May 12 07:20:01.294398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1351/2796] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:01.938338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5965040d-4696-4384-9942-9923628f6046 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:01.938986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5965040d-4696-4384-9942-9923628f6046 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:01.945311 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5965040d-4696-4384-9942-9923628f6046 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:01.945784 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5965040d-4696-4384-9942-9923628f6046 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:01.946569 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5965040d-4696-4384-9942-9923628f6046 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:01.947001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5965040d-4696-4384-9942-9923628f6046 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:02.012792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5965040d-4696-4384-9942-9923628f6046 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:02.021090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5965040d-4696-4384-9942-9923628f6046 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.086610 May 12 07:20:02.021643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1446/2797] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:01 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:02.311912 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5cbd90bb-66b4-4b46-b0df-710badf4418b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:02.312553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5cbd90bb-66b4-4b46-b0df-710badf4418b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:02.318720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cbd90bb-66b4-4b46-b0df-710badf4418b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:02.319169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cbd90bb-66b4-4b46-b0df-710badf4418b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:02.319975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cbd90bb-66b4-4b46-b0df-710badf4418b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:02.320415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cbd90bb-66b4-4b46-b0df-710badf4418b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:02.447511 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5cbd90bb-66b4-4b46-b0df-710badf4418b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:02.455799 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5cbd90bb-66b4-4b46-b0df-710badf4418b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148261 May 12 07:20:02.456361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1352/2798] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:03.038440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5ce0ecd7-fa88-4cbc-b196-99578187679a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:03.039055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5ce0ecd7-fa88-4cbc-b196-99578187679a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:03.046302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ce0ecd7-fa88-4cbc-b196-99578187679a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:03.046747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ce0ecd7-fa88-4cbc-b196-99578187679a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:03.047516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ce0ecd7-fa88-4cbc-b196-99578187679a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:03.047985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ce0ecd7-fa88-4cbc-b196-99578187679a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:03.106745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5ce0ecd7-fa88-4cbc-b196-99578187679a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:03.114971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5ce0ecd7-fa88-4cbc-b196-99578187679a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080438 May 12 07:20:03.115536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1447/2799] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:03 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:03.472725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e2aec6bf-7aa8-4fcd-a048-c8e8398c5809 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:03.473340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e2aec6bf-7aa8-4fcd-a048-c8e8398c5809 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:03.479626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e2aec6bf-7aa8-4fcd-a048-c8e8398c5809 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:03.480109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e2aec6bf-7aa8-4fcd-a048-c8e8398c5809 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:03.480875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e2aec6bf-7aa8-4fcd-a048-c8e8398c5809 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:03.481317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e2aec6bf-7aa8-4fcd-a048-c8e8398c5809 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:03.613460 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e2aec6bf-7aa8-4fcd-a048-c8e8398c5809 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:03.621305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e2aec6bf-7aa8-4fcd-a048-c8e8398c5809 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.152412 May 12 07:20:03.621889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1353/2800] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:04.132047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-abf37a2c-90ca-40ca-a766-41cd243b94e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:04.132688 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-abf37a2c-90ca-40ca-a766-41cd243b94e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:04.139541 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abf37a2c-90ca-40ca-a766-41cd243b94e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:04.140012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abf37a2c-90ca-40ca-a766-41cd243b94e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:04.140775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abf37a2c-90ca-40ca-a766-41cd243b94e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:04.141209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abf37a2c-90ca-40ca-a766-41cd243b94e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:04.201398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-abf37a2c-90ca-40ca-a766-41cd243b94e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:04.209023 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-abf37a2c-90ca-40ca-a766-41cd243b94e9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080811 May 12 07:20:04.209588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1448/2801] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:04 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:04.638232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e4423914-eeca-489e-b8cf-1c08744140d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:04.639099 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e4423914-eeca-489e-b8cf-1c08744140d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:04.645619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4423914-eeca-489e-b8cf-1c08744140d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:04.646067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4423914-eeca-489e-b8cf-1c08744140d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:04.647136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4423914-eeca-489e-b8cf-1c08744140d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:04.647774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e4423914-eeca-489e-b8cf-1c08744140d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:04.778246 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e4423914-eeca-489e-b8cf-1c08744140d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:04.787088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e4423914-eeca-489e-b8cf-1c08744140d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.152764 May 12 07:20:04.787653 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1354/2802] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:05.225547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b444b85f-feec-482e-a856-cde5671d23a7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:05.226090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b444b85f-feec-482e-a856-cde5671d23a7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:05.232352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b444b85f-feec-482e-a856-cde5671d23a7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:05.232800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b444b85f-feec-482e-a856-cde5671d23a7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:05.233557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b444b85f-feec-482e-a856-cde5671d23a7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:05.233998 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b444b85f-feec-482e-a856-cde5671d23a7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:05.293953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b444b85f-feec-482e-a856-cde5671d23a7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:05.301886 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b444b85f-feec-482e-a856-cde5671d23a7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080301 May 12 07:20:05.302451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1449/2803] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:05 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:05.805076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-606a14c0-3f9c-46c0-92b3-4238a28083ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:05.805688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-606a14c0-3f9c-46c0-92b3-4238a28083ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:05.812654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-606a14c0-3f9c-46c0-92b3-4238a28083ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:05.813103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-606a14c0-3f9c-46c0-92b3-4238a28083ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:05.813858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-606a14c0-3f9c-46c0-92b3-4238a28083ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:05.814293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-606a14c0-3f9c-46c0-92b3-4238a28083ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:05.939984 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-606a14c0-3f9c-46c0-92b3-4238a28083ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:05.947908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-606a14c0-3f9c-46c0-92b3-4238a28083ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146577 May 12 07:20:05.948481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1355/2804] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:06.318330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bfdf515d-1c55-49b5-bee6-ae68fc12e5e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:06.318950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bfdf515d-1c55-49b5-bee6-ae68fc12e5e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:06.325240 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfdf515d-1c55-49b5-bee6-ae68fc12e5e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:06.325688 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfdf515d-1c55-49b5-bee6-ae68fc12e5e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:06.326459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfdf515d-1c55-49b5-bee6-ae68fc12e5e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:06.326901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bfdf515d-1c55-49b5-bee6-ae68fc12e5e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:06.386867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bfdf515d-1c55-49b5-bee6-ae68fc12e5e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:06.395003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bfdf515d-1c55-49b5-bee6-ae68fc12e5e2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080589 May 12 07:20:06.395573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1450/2805] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:06 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:06.965227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1afc2b45-3b68-4ecc-8e61-d73194514a81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:06.970393 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1afc2b45-3b68-4ecc-8e61-d73194514a81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:06.972172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1afc2b45-3b68-4ecc-8e61-d73194514a81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:06.972625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1afc2b45-3b68-4ecc-8e61-d73194514a81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:06.973398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1afc2b45-3b68-4ecc-8e61-d73194514a81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:06.973841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1afc2b45-3b68-4ecc-8e61-d73194514a81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:07.104697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1afc2b45-3b68-4ecc-8e61-d73194514a81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:07.112485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1afc2b45-3b68-4ecc-8e61-d73194514a81 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.151120 May 12 07:20:07.113067 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1356/2806] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:07.411400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e12e1897-43b1-4b4a-87ae-95430912d4a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:07.412080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e12e1897-43b1-4b4a-87ae-95430912d4a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:07.418420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e12e1897-43b1-4b4a-87ae-95430912d4a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:07.418942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e12e1897-43b1-4b4a-87ae-95430912d4a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:07.420273 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e12e1897-43b1-4b4a-87ae-95430912d4a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:07.420727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e12e1897-43b1-4b4a-87ae-95430912d4a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:07.483187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e12e1897-43b1-4b4a-87ae-95430912d4a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:07.490787 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e12e1897-43b1-4b4a-87ae-95430912d4a8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083192 May 12 07:20:07.491358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1451/2807] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:07 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:08.129801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9b29cfce-022d-41a2-a5cf-0b8bd01452b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:08.130409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9b29cfce-022d-41a2-a5cf-0b8bd01452b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:08.136695 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9b29cfce-022d-41a2-a5cf-0b8bd01452b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:08.137141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9b29cfce-022d-41a2-a5cf-0b8bd01452b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:08.137900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9b29cfce-022d-41a2-a5cf-0b8bd01452b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:08.138332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9b29cfce-022d-41a2-a5cf-0b8bd01452b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:08.264447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9b29cfce-022d-41a2-a5cf-0b8bd01452b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:08.272129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9b29cfce-022d-41a2-a5cf-0b8bd01452b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146195 May 12 07:20:08.272690 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1357/2808] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:08.507489 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-00926702-697b-4f61-9e77-c6db25eb3b0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:08.508153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-00926702-697b-4f61-9e77-c6db25eb3b0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:08.515312 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00926702-697b-4f61-9e77-c6db25eb3b0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:08.515718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00926702-697b-4f61-9e77-c6db25eb3b0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:08.516510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00926702-697b-4f61-9e77-c6db25eb3b0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:08.516949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00926702-697b-4f61-9e77-c6db25eb3b0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:08.737542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-00926702-697b-4f61-9e77-c6db25eb3b0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:08.746377 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-00926702-697b-4f61-9e77-c6db25eb3b0d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.242686 May 12 07:20:08.747062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1452/2809] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:08 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:09.289030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7bbd8d41-c094-48a2-9ba2-a9eb8d58864b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:09.289579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7bbd8d41-c094-48a2-9ba2-a9eb8d58864b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:09.296891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bbd8d41-c094-48a2-9ba2-a9eb8d58864b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:09.297463 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bbd8d41-c094-48a2-9ba2-a9eb8d58864b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:09.298340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bbd8d41-c094-48a2-9ba2-a9eb8d58864b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:09.298979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bbd8d41-c094-48a2-9ba2-a9eb8d58864b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:09.429504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7bbd8d41-c094-48a2-9ba2-a9eb8d58864b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:09.437258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7bbd8d41-c094-48a2-9ba2-a9eb8d58864b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.152155 May 12 07:20:09.437823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1358/2810] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:09.764099 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-664fb0a1-27c5-4fab-ad6f-211bd93cc14f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:09.764921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-664fb0a1-27c5-4fab-ad6f-211bd93cc14f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:09.770912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-664fb0a1-27c5-4fab-ad6f-211bd93cc14f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:09.771359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-664fb0a1-27c5-4fab-ad6f-211bd93cc14f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:09.772157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-664fb0a1-27c5-4fab-ad6f-211bd93cc14f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:09.772593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-664fb0a1-27c5-4fab-ad6f-211bd93cc14f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:09.833014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-664fb0a1-27c5-4fab-ad6f-211bd93cc14f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:09.840792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-664fb0a1-27c5-4fab-ad6f-211bd93cc14f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081168 May 12 07:20:09.841360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1453/2811] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:09 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:10.454207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b82ef67b-97ca-4b64-9359-f49886d7d6be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:10.454813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b82ef67b-97ca-4b64-9359-f49886d7d6be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:10.461136 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b82ef67b-97ca-4b64-9359-f49886d7d6be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:10.461590 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b82ef67b-97ca-4b64-9359-f49886d7d6be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:10.462357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b82ef67b-97ca-4b64-9359-f49886d7d6be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:10.462800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b82ef67b-97ca-4b64-9359-f49886d7d6be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:10.589849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b82ef67b-97ca-4b64-9359-f49886d7d6be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:10.598113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b82ef67b-97ca-4b64-9359-f49886d7d6be tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147755 May 12 07:20:10.598678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1359/2812] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:10.858264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3a0b1c1c-8988-4b66-b112-5ab861feb89f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:10.858908 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3a0b1c1c-8988-4b66-b112-5ab861feb89f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:10.865156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a0b1c1c-8988-4b66-b112-5ab861feb89f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:10.865610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a0b1c1c-8988-4b66-b112-5ab861feb89f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:10.866379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a0b1c1c-8988-4b66-b112-5ab861feb89f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:10.866817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a0b1c1c-8988-4b66-b112-5ab861feb89f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:10.926059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3a0b1c1c-8988-4b66-b112-5ab861feb89f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:10.933840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3a0b1c1c-8988-4b66-b112-5ab861feb89f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080029 May 12 07:20:10.934396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1454/2813] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:10 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:11.615815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-de61cabf-a993-490e-ae83-44175b675e6b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:11.616382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-de61cabf-a993-490e-ae83-44175b675e6b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:11.623141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de61cabf-a993-490e-ae83-44175b675e6b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:11.623634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de61cabf-a993-490e-ae83-44175b675e6b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:11.624416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de61cabf-a993-490e-ae83-44175b675e6b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:11.624849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-de61cabf-a993-490e-ae83-44175b675e6b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:11.749676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-de61cabf-a993-490e-ae83-44175b675e6b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:11.757499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-de61cabf-a993-490e-ae83-44175b675e6b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145723 May 12 07:20:11.758060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1360/2814] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:11.950530 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2c3c1ac0-3ef2-426d-8f39-254c688d629a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:11.951066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2c3c1ac0-3ef2-426d-8f39-254c688d629a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:11.957401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c3c1ac0-3ef2-426d-8f39-254c688d629a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:11.957861 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c3c1ac0-3ef2-426d-8f39-254c688d629a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:11.958642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c3c1ac0-3ef2-426d-8f39-254c688d629a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:11.959084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c3c1ac0-3ef2-426d-8f39-254c688d629a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:12.019327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2c3c1ac0-3ef2-426d-8f39-254c688d629a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:12.027059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2c3c1ac0-3ef2-426d-8f39-254c688d629a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080494 May 12 07:20:12.027618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1455/2815] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:11 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:12.774504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-372fe4c9-2067-4c58-9942-f204f7b02305 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:12.775150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-372fe4c9-2067-4c58-9942-f204f7b02305 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:12.781564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-372fe4c9-2067-4c58-9942-f204f7b02305 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:12.782014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-372fe4c9-2067-4c58-9942-f204f7b02305 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:12.782781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-372fe4c9-2067-4c58-9942-f204f7b02305 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:12.783216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-372fe4c9-2067-4c58-9942-f204f7b02305 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:12.910170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-372fe4c9-2067-4c58-9942-f204f7b02305 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:12.918083 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-372fe4c9-2067-4c58-9942-f204f7b02305 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147468 May 12 07:20:12.918664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1361/2816] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:12 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:13.044401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4a221f1c-7eaa-40de-9be0-c6ff263df27d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:13.044958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4a221f1c-7eaa-40de-9be0-c6ff263df27d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:13.051445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a221f1c-7eaa-40de-9be0-c6ff263df27d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:13.051932 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a221f1c-7eaa-40de-9be0-c6ff263df27d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:13.052704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a221f1c-7eaa-40de-9be0-c6ff263df27d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:13.053147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a221f1c-7eaa-40de-9be0-c6ff263df27d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:13.113011 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4a221f1c-7eaa-40de-9be0-c6ff263df27d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:13.120659 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4a221f1c-7eaa-40de-9be0-c6ff263df27d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080125 May 12 07:20:13.121211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1456/2817] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:13 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:13.935416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c7febb35-0560-431e-b099-88da56bb70a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:13.936074 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c7febb35-0560-431e-b099-88da56bb70a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:13.942386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7febb35-0560-431e-b099-88da56bb70a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:13.942832 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7febb35-0560-431e-b099-88da56bb70a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:13.943590 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7febb35-0560-431e-b099-88da56bb70a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:13.944052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c7febb35-0560-431e-b099-88da56bb70a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:14.074308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c7febb35-0560-431e-b099-88da56bb70a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:14.082527 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c7febb35-0560-431e-b099-88da56bb70a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.151008 May 12 07:20:14.083081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1362/2818] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:14.137892 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5bb8bca7-666c-46cb-95c2-0020c05f8711 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:14.139027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5bb8bca7-666c-46cb-95c2-0020c05f8711 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:14.145374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bb8bca7-666c-46cb-95c2-0020c05f8711 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:14.145822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bb8bca7-666c-46cb-95c2-0020c05f8711 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:14.146592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bb8bca7-666c-46cb-95c2-0020c05f8711 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:14.147029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bb8bca7-666c-46cb-95c2-0020c05f8711 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:14.206734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5bb8bca7-666c-46cb-95c2-0020c05f8711 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:14.214364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5bb8bca7-666c-46cb-95c2-0020c05f8711 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080322 May 12 07:20:14.214915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1457/2819] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:14 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:15.100185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8e6e4d35-adc9-47d3-980a-9c7c8ec12b84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:15.260762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8e6e4d35-adc9-47d3-980a-9c7c8ec12b84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:15.260762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8e6e4d35-adc9-47d3-980a-9c7c8ec12b84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:15.260762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8e6e4d35-adc9-47d3-980a-9c7c8ec12b84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:15.260762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8e6e4d35-adc9-47d3-980a-9c7c8ec12b84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:15.261990 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8e6e4d35-adc9-47d3-980a-9c7c8ec12b84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:15.262115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ff111e61-cc74-4986-8eb3-5bc3ff44526a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:15.262115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ff111e61-cc74-4986-8eb3-5bc3ff44526a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:15.262115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff111e61-cc74-4986-8eb3-5bc3ff44526a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:15.262115 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff111e61-cc74-4986-8eb3-5bc3ff44526a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:15.262717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff111e61-cc74-4986-8eb3-5bc3ff44526a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:15.262717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff111e61-cc74-4986-8eb3-5bc3ff44526a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:15.262863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8e6e4d35-adc9-47d3-980a-9c7c8ec12b84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:15.262863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8e6e4d35-adc9-47d3-980a-9c7c8ec12b84 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.153073 May 12 07:20:15.262863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1363/2820] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:15.302875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ff111e61-cc74-4986-8eb3-5bc3ff44526a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:15.310540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ff111e61-cc74-4986-8eb3-5bc3ff44526a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082665 May 12 07:20:15.311101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1458/2821] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:15 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:16.267039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1f286507-eb95-48ad-8789-863e137ac445 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:16.267581 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1f286507-eb95-48ad-8789-863e137ac445 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:16.273843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f286507-eb95-48ad-8789-863e137ac445 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:16.274290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f286507-eb95-48ad-8789-863e137ac445 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:16.275044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f286507-eb95-48ad-8789-863e137ac445 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:16.275480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1f286507-eb95-48ad-8789-863e137ac445 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:16.326420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-43106aed-4415-43e0-967d-6b65f94421ce tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:16.327184 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-43106aed-4415-43e0-967d-6b65f94421ce tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:16.333713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43106aed-4415-43e0-967d-6b65f94421ce tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:16.334239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43106aed-4415-43e0-967d-6b65f94421ce tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:16.335146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43106aed-4415-43e0-967d-6b65f94421ce tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:16.335600 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-43106aed-4415-43e0-967d-6b65f94421ce tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:16.407264 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-43106aed-4415-43e0-967d-6b65f94421ce tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:16.415158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-43106aed-4415-43e0-967d-6b65f94421ce tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.092641 May 12 07:20:16.415891 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1459/2822] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:16 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:16.430155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1f286507-eb95-48ad-8789-863e137ac445 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:16.438576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1f286507-eb95-48ad-8789-863e137ac445 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.175554 May 12 07:20:16.439150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1364/2823] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:17.432652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5ef17a57-e89d-47e1-8308-a59b8dbfea90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:17.433268 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5ef17a57-e89d-47e1-8308-a59b8dbfea90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:17.440064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ef17a57-e89d-47e1-8308-a59b8dbfea90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:17.440543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ef17a57-e89d-47e1-8308-a59b8dbfea90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:17.441310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ef17a57-e89d-47e1-8308-a59b8dbfea90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:17.441747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5ef17a57-e89d-47e1-8308-a59b8dbfea90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:17.455908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ae3a3029-ebeb-452e-926a-7ae99119814d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:17.456534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ae3a3029-ebeb-452e-926a-7ae99119814d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:17.462728 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae3a3029-ebeb-452e-926a-7ae99119814d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:17.463185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae3a3029-ebeb-452e-926a-7ae99119814d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:17.463989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae3a3029-ebeb-452e-926a-7ae99119814d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:17.464432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae3a3029-ebeb-452e-926a-7ae99119814d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:17.504446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5ef17a57-e89d-47e1-8308-a59b8dbfea90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:17.512359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5ef17a57-e89d-47e1-8308-a59b8dbfea90 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083481 May 12 07:20:17.512941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1460/2824] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:17 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:17.601557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ae3a3029-ebeb-452e-926a-7ae99119814d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:17.609239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ae3a3029-ebeb-452e-926a-7ae99119814d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.157206 May 12 07:20:17.609800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1365/2825] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:17 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:18.529652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-256aa54d-ed37-416e-a27d-5f6fc97d85a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:18.530270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-256aa54d-ed37-416e-a27d-5f6fc97d85a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:18.536561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-256aa54d-ed37-416e-a27d-5f6fc97d85a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:18.537015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-256aa54d-ed37-416e-a27d-5f6fc97d85a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:18.537782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-256aa54d-ed37-416e-a27d-5f6fc97d85a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:18.538220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-256aa54d-ed37-416e-a27d-5f6fc97d85a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:18.601299 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-256aa54d-ed37-416e-a27d-5f6fc97d85a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:18.609173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-256aa54d-ed37-416e-a27d-5f6fc97d85a2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083994 May 12 07:20:18.609742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1461/2826] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:18 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:18.626040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-69a6f382-3f66-4497-b720-92ab95e2d222 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:18.626716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-69a6f382-3f66-4497-b720-92ab95e2d222 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:18.634274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69a6f382-3f66-4497-b720-92ab95e2d222 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:18.638564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69a6f382-3f66-4497-b720-92ab95e2d222 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:18.638564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69a6f382-3f66-4497-b720-92ab95e2d222 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:18.638564 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69a6f382-3f66-4497-b720-92ab95e2d222 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:18.764942 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-69a6f382-3f66-4497-b720-92ab95e2d222 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:18.772991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-69a6f382-3f66-4497-b720-92ab95e2d222 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150830 May 12 07:20:18.773573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1366/2827] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:19.626066 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-679659c9-3f2b-4362-8f00-d9dbf497acb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:19.626611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-679659c9-3f2b-4362-8f00-d9dbf497acb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:19.632912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-679659c9-3f2b-4362-8f00-d9dbf497acb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:19.633449 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-679659c9-3f2b-4362-8f00-d9dbf497acb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:19.634228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-679659c9-3f2b-4362-8f00-d9dbf497acb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:19.634670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-679659c9-3f2b-4362-8f00-d9dbf497acb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:19.698829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-679659c9-3f2b-4362-8f00-d9dbf497acb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:19.706748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-679659c9-3f2b-4362-8f00-d9dbf497acb6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084475 May 12 07:20:19.707312 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1462/2828] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:19 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:19.790111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f9abd83c-d4a9-4d52-a682-d74abf24c901 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:19.790748 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f9abd83c-d4a9-4d52-a682-d74abf24c901 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:19.798378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9abd83c-d4a9-4d52-a682-d74abf24c901 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:19.798825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9abd83c-d4a9-4d52-a682-d74abf24c901 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:19.799610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9abd83c-d4a9-4d52-a682-d74abf24c901 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:19.800073 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f9abd83c-d4a9-4d52-a682-d74abf24c901 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:19.924678 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f9abd83c-d4a9-4d52-a682-d74abf24c901 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:19.932397 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f9abd83c-d4a9-4d52-a682-d74abf24c901 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146128 May 12 07:20:19.932953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1367/2829] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:20.722678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fcfce8af-2a33-4ed5-996c-b268cb50dcdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:20.723286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fcfce8af-2a33-4ed5-996c-b268cb50dcdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:20.729838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcfce8af-2a33-4ed5-996c-b268cb50dcdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:20.730287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcfce8af-2a33-4ed5-996c-b268cb50dcdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:20.731043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcfce8af-2a33-4ed5-996c-b268cb50dcdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:20.731483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fcfce8af-2a33-4ed5-996c-b268cb50dcdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:20.790633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fcfce8af-2a33-4ed5-996c-b268cb50dcdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:20.798984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fcfce8af-2a33-4ed5-996c-b268cb50dcdd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080166 May 12 07:20:20.799543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1463/2830] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:20 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:20.948669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-537657e9-8b68-44ae-b1eb-518761cd9047 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:20.949285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-537657e9-8b68-44ae-b1eb-518761cd9047 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:20.955521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-537657e9-8b68-44ae-b1eb-518761cd9047 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:20.955991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-537657e9-8b68-44ae-b1eb-518761cd9047 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:20.956751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-537657e9-8b68-44ae-b1eb-518761cd9047 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:20.957208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-537657e9-8b68-44ae-b1eb-518761cd9047 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:21.083030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-537657e9-8b68-44ae-b1eb-518761cd9047 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:21.090777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-537657e9-8b68-44ae-b1eb-518761cd9047 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145926 May 12 07:20:21.091858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1368/2831] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:20 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:21.816154 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5d894ae5-7588-4518-8c91-81c02e3ef570 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:21.817370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5d894ae5-7588-4518-8c91-81c02e3ef570 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:21.823845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d894ae5-7588-4518-8c91-81c02e3ef570 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:21.828142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d894ae5-7588-4518-8c91-81c02e3ef570 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:21.828142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d894ae5-7588-4518-8c91-81c02e3ef570 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:21.828142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d894ae5-7588-4518-8c91-81c02e3ef570 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:21.888384 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5d894ae5-7588-4518-8c91-81c02e3ef570 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:21.896148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5d894ae5-7588-4518-8c91-81c02e3ef570 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083858 May 12 07:20:21.896723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1464/2832] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:21 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:22.108178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e5b6acbd-6fcd-471a-b1c3-0c8e137fe8c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:22.108779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e5b6acbd-6fcd-471a-b1c3-0c8e137fe8c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:22.115029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5b6acbd-6fcd-471a-b1c3-0c8e137fe8c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:22.115460 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5b6acbd-6fcd-471a-b1c3-0c8e137fe8c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:22.116340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5b6acbd-6fcd-471a-b1c3-0c8e137fe8c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:22.116775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e5b6acbd-6fcd-471a-b1c3-0c8e137fe8c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:22.245602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e5b6acbd-6fcd-471a-b1c3-0c8e137fe8c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:22.253993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e5b6acbd-6fcd-471a-b1c3-0c8e137fe8c7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149761 May 12 07:20:22.254556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1369/2833] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:22.913507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4a121366-26cc-433d-b79d-e514609c60c6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:22.914127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4a121366-26cc-433d-b79d-e514609c60c6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:22.920484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a121366-26cc-433d-b79d-e514609c60c6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:22.921197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a121366-26cc-433d-b79d-e514609c60c6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:22.921974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a121366-26cc-433d-b79d-e514609c60c6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:22.922417 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a121366-26cc-433d-b79d-e514609c60c6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:22.986994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4a121366-26cc-433d-b79d-e514609c60c6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:22.994911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4a121366-26cc-433d-b79d-e514609c60c6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085238 May 12 07:20:22.995472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1465/2834] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:22 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:23.270987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9c78f83f-4a66-424d-809f-6df156e3d475 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:23.271640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9c78f83f-4a66-424d-809f-6df156e3d475 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:23.277994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c78f83f-4a66-424d-809f-6df156e3d475 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:23.278498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c78f83f-4a66-424d-809f-6df156e3d475 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:23.279268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c78f83f-4a66-424d-809f-6df156e3d475 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:23.279735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c78f83f-4a66-424d-809f-6df156e3d475 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:23.406007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c78f83f-4a66-424d-809f-6df156e3d475 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:23.413838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9c78f83f-4a66-424d-809f-6df156e3d475 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146725 May 12 07:20:23.416825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1370/2835] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:24.011218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-306f8cc2-c225-4a9d-9d76-78aac12e52d2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:24.011874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-306f8cc2-c225-4a9d-9d76-78aac12e52d2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:24.018196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-306f8cc2-c225-4a9d-9d76-78aac12e52d2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:24.018645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-306f8cc2-c225-4a9d-9d76-78aac12e52d2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:24.019409 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-306f8cc2-c225-4a9d-9d76-78aac12e52d2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:24.019883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-306f8cc2-c225-4a9d-9d76-78aac12e52d2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:24.080047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-306f8cc2-c225-4a9d-9d76-78aac12e52d2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:24.087630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-306f8cc2-c225-4a9d-9d76-78aac12e52d2 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080255 May 12 07:20:24.088213 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1466/2836] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:24 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:24.432280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3685b18e-78ff-4daf-b1ba-aaba8c787c22 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:24.432841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3685b18e-78ff-4daf-b1ba-aaba8c787c22 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:24.439181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3685b18e-78ff-4daf-b1ba-aaba8c787c22 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:24.439633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3685b18e-78ff-4daf-b1ba-aaba8c787c22 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:24.440432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3685b18e-78ff-4daf-b1ba-aaba8c787c22 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:24.440873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3685b18e-78ff-4daf-b1ba-aaba8c787c22 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:24.569054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3685b18e-78ff-4daf-b1ba-aaba8c787c22 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:24.577353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3685b18e-78ff-4daf-b1ba-aaba8c787c22 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149024 May 12 07:20:24.577921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1371/2837] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:25.104783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cb04cc37-c1b0-497c-8360-37016110a30c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:25.105393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cb04cc37-c1b0-497c-8360-37016110a30c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:25.111744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb04cc37-c1b0-497c-8360-37016110a30c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:25.112190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb04cc37-c1b0-497c-8360-37016110a30c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:25.112955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb04cc37-c1b0-497c-8360-37016110a30c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:25.113393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cb04cc37-c1b0-497c-8360-37016110a30c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:25.176904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cb04cc37-c1b0-497c-8360-37016110a30c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:25.185710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cb04cc37-c1b0-497c-8360-37016110a30c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084749 May 12 07:20:25.186265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1467/2838] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:25 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:25.601478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8c3397a0-4f81-4419-9447-2fcc48474aa7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:25.602013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8c3397a0-4f81-4419-9447-2fcc48474aa7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:25.608476 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c3397a0-4f81-4419-9447-2fcc48474aa7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:25.608923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c3397a0-4f81-4419-9447-2fcc48474aa7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:25.609684 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c3397a0-4f81-4419-9447-2fcc48474aa7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:25.610118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8c3397a0-4f81-4419-9447-2fcc48474aa7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:25.732935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8c3397a0-4f81-4419-9447-2fcc48474aa7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:25.740647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8c3397a0-4f81-4419-9447-2fcc48474aa7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143604 May 12 07:20:25.741212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1372/2839] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:26.202758 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-50b911d4-6a92-40f0-90fe-7fc2bf168ba8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:26.203370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-50b911d4-6a92-40f0-90fe-7fc2bf168ba8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:26.209685 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50b911d4-6a92-40f0-90fe-7fc2bf168ba8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:26.210138 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50b911d4-6a92-40f0-90fe-7fc2bf168ba8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:26.210910 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50b911d4-6a92-40f0-90fe-7fc2bf168ba8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:26.211349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50b911d4-6a92-40f0-90fe-7fc2bf168ba8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:26.274030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-50b911d4-6a92-40f0-90fe-7fc2bf168ba8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:26.281729 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-50b911d4-6a92-40f0-90fe-7fc2bf168ba8 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083310 May 12 07:20:26.282290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1468/2840] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:26 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:26.756901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d1c8b99d-0713-4787-81da-deea405fb3aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:26.757513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d1c8b99d-0713-4787-81da-deea405fb3aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:26.763977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1c8b99d-0713-4787-81da-deea405fb3aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:26.764427 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1c8b99d-0713-4787-81da-deea405fb3aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:26.765192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1c8b99d-0713-4787-81da-deea405fb3aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:26.765626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d1c8b99d-0713-4787-81da-deea405fb3aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:26.889048 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d1c8b99d-0713-4787-81da-deea405fb3aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:26.896681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d1c8b99d-0713-4787-81da-deea405fb3aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143618 May 12 07:20:26.897244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1373/2841] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:27.299297 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-99229cb6-248c-4b6c-a264-bd00e618507b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:27.299938 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-99229cb6-248c-4b6c-a264-bd00e618507b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:27.306182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99229cb6-248c-4b6c-a264-bd00e618507b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:27.306630 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99229cb6-248c-4b6c-a264-bd00e618507b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:27.307390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99229cb6-248c-4b6c-a264-bd00e618507b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:27.307859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-99229cb6-248c-4b6c-a264-bd00e618507b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:27.367247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-99229cb6-248c-4b6c-a264-bd00e618507b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:27.375068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-99229cb6-248c-4b6c-a264-bd00e618507b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079821 May 12 07:20:27.375629 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1469/2842] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:27 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:27.914520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9c78b30b-d32d-4289-848e-21e3c43a7e71 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:27.915554 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9c78b30b-d32d-4289-848e-21e3c43a7e71 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:27.922971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c78b30b-d32d-4289-848e-21e3c43a7e71 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:27.927259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c78b30b-d32d-4289-848e-21e3c43a7e71 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:27.927259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c78b30b-d32d-4289-848e-21e3c43a7e71 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:27.927259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9c78b30b-d32d-4289-848e-21e3c43a7e71 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:28.057498 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9c78b30b-d32d-4289-848e-21e3c43a7e71 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:28.065396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9c78b30b-d32d-4289-848e-21e3c43a7e71 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.154917 May 12 07:20:28.065962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1374/2843] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:28.391825 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9105171b-6fd2-444f-8dbb-3bb9cc6c9659 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:28.392448 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9105171b-6fd2-444f-8dbb-3bb9cc6c9659 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:28.398740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9105171b-6fd2-444f-8dbb-3bb9cc6c9659 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:28.399193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9105171b-6fd2-444f-8dbb-3bb9cc6c9659 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:28.399994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9105171b-6fd2-444f-8dbb-3bb9cc6c9659 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:28.400439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9105171b-6fd2-444f-8dbb-3bb9cc6c9659 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:28.460047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9105171b-6fd2-444f-8dbb-3bb9cc6c9659 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:28.467658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9105171b-6fd2-444f-8dbb-3bb9cc6c9659 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079761 May 12 07:20:28.468251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1470/2844] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:28 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:29.082308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3415105d-5f4e-45dc-af18-0705ee727a52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:29.082916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3415105d-5f4e-45dc-af18-0705ee727a52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:29.089337 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3415105d-5f4e-45dc-af18-0705ee727a52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:29.089789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3415105d-5f4e-45dc-af18-0705ee727a52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:29.090552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3415105d-5f4e-45dc-af18-0705ee727a52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:29.091624 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3415105d-5f4e-45dc-af18-0705ee727a52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:29.216339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3415105d-5f4e-45dc-af18-0705ee727a52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:29.224267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3415105d-5f4e-45dc-af18-0705ee727a52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145926 May 12 07:20:29.224838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1375/2845] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:29.484247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-08132336-8e7c-4ec1-a3fa-a558d1ac1003 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:29.484869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-08132336-8e7c-4ec1-a3fa-a558d1ac1003 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:29.491162 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08132336-8e7c-4ec1-a3fa-a558d1ac1003 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:29.491615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08132336-8e7c-4ec1-a3fa-a558d1ac1003 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:29.492419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08132336-8e7c-4ec1-a3fa-a558d1ac1003 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:29.492862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08132336-8e7c-4ec1-a3fa-a558d1ac1003 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:29.557360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-08132336-8e7c-4ec1-a3fa-a558d1ac1003 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:29.565533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-08132336-8e7c-4ec1-a3fa-a558d1ac1003 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085169 May 12 07:20:29.566091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1471/2846] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:29 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:30.240585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6fd46cb3-8822-4729-a64e-1ae5b8b3e61a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:30.241226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6fd46cb3-8822-4729-a64e-1ae5b8b3e61a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:30.247560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6fd46cb3-8822-4729-a64e-1ae5b8b3e61a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:30.247977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6fd46cb3-8822-4729-a64e-1ae5b8b3e61a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:30.248769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6fd46cb3-8822-4729-a64e-1ae5b8b3e61a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:30.249206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6fd46cb3-8822-4729-a64e-1ae5b8b3e61a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:30.374435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6fd46cb3-8822-4729-a64e-1ae5b8b3e61a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:30.382165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6fd46cb3-8822-4729-a64e-1ae5b8b3e61a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145462 May 12 07:20:30.382723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1376/2847] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:30.582141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e2f31f32-848b-46ab-ac49-6403113ed5e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:30.582713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e2f31f32-848b-46ab-ac49-6403113ed5e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:30.588944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2f31f32-848b-46ab-ac49-6403113ed5e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:30.589401 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2f31f32-848b-46ab-ac49-6403113ed5e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:30.590164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2f31f32-848b-46ab-ac49-6403113ed5e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:30.590606 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e2f31f32-848b-46ab-ac49-6403113ed5e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:30.649307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e2f31f32-848b-46ab-ac49-6403113ed5e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:30.657656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e2f31f32-848b-46ab-ac49-6403113ed5e6 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079437 May 12 07:20:30.658215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1472/2848] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:30 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:31.399822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b64696ad-3629-45e9-a525-571178a7ab2b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:31.400442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b64696ad-3629-45e9-a525-571178a7ab2b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:31.407010 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b64696ad-3629-45e9-a525-571178a7ab2b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:31.407455 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b64696ad-3629-45e9-a525-571178a7ab2b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:31.408251 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b64696ad-3629-45e9-a525-571178a7ab2b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:31.408687 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b64696ad-3629-45e9-a525-571178a7ab2b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:31.533891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b64696ad-3629-45e9-a525-571178a7ab2b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:31.541551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b64696ad-3629-45e9-a525-571178a7ab2b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145686 May 12 07:20:31.542108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1377/2849] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:31.673654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ff3e8f69-4b90-4a67-85ca-171d0cf11fef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:31.674194 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ff3e8f69-4b90-4a67-85ca-171d0cf11fef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:31.680422 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff3e8f69-4b90-4a67-85ca-171d0cf11fef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:31.680872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff3e8f69-4b90-4a67-85ca-171d0cf11fef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:31.681634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff3e8f69-4b90-4a67-85ca-171d0cf11fef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:31.682070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff3e8f69-4b90-4a67-85ca-171d0cf11fef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:31.741205 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ff3e8f69-4b90-4a67-85ca-171d0cf11fef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:31.749224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ff3e8f69-4b90-4a67-85ca-171d0cf11fef tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079729 May 12 07:20:31.749851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1473/2850] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:31 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:32.558848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4453288c-196e-4cd1-a3cc-4a27dd9aaea3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:32.559468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4453288c-196e-4cd1-a3cc-4a27dd9aaea3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:32.565815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4453288c-196e-4cd1-a3cc-4a27dd9aaea3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:32.566288 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4453288c-196e-4cd1-a3cc-4a27dd9aaea3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:32.567050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4453288c-196e-4cd1-a3cc-4a27dd9aaea3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:32.567488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4453288c-196e-4cd1-a3cc-4a27dd9aaea3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:32.690019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4453288c-196e-4cd1-a3cc-4a27dd9aaea3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:32.697666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4453288c-196e-4cd1-a3cc-4a27dd9aaea3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.142646 May 12 07:20:32.698234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1378/2851] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:32.766388 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b1ff32fe-107b-406d-a012-10e075bb9abd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:32.766997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b1ff32fe-107b-406d-a012-10e075bb9abd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:32.773192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1ff32fe-107b-406d-a012-10e075bb9abd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:32.773645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1ff32fe-107b-406d-a012-10e075bb9abd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:32.774407 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1ff32fe-107b-406d-a012-10e075bb9abd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:32.774842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1ff32fe-107b-406d-a012-10e075bb9abd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:32.837244 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b1ff32fe-107b-406d-a012-10e075bb9abd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:32.845556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b1ff32fe-107b-406d-a012-10e075bb9abd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083463 May 12 07:20:32.846100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1474/2852] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:32 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:33.715730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f1028857-c7f0-44da-8be7-f6b1dfc7ad52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:33.716270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f1028857-c7f0-44da-8be7-f6b1dfc7ad52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:33.722732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1028857-c7f0-44da-8be7-f6b1dfc7ad52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:33.723185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1028857-c7f0-44da-8be7-f6b1dfc7ad52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:33.723982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1028857-c7f0-44da-8be7-f6b1dfc7ad52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:33.724425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f1028857-c7f0-44da-8be7-f6b1dfc7ad52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:33.855086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f1028857-c7f0-44da-8be7-f6b1dfc7ad52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:33.863290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a2247e93-4e2e-4f1f-8167-ad76830afa89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:33.863841 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f1028857-c7f0-44da-8be7-f6b1dfc7ad52 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.151776 May 12 07:20:33.863941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a2247e93-4e2e-4f1f-8167-ad76830afa89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:33.864161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1379/2853] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:33 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:33.870355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2247e93-4e2e-4f1f-8167-ad76830afa89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:33.870804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2247e93-4e2e-4f1f-8167-ad76830afa89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:33.871569 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2247e93-4e2e-4f1f-8167-ad76830afa89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:33.872027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a2247e93-4e2e-4f1f-8167-ad76830afa89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:33.932158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a2247e93-4e2e-4f1f-8167-ad76830afa89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:33.939959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a2247e93-4e2e-4f1f-8167-ad76830afa89 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080536 May 12 07:20:33.940516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1475/2854] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:33 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:34.880622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7f2eca84-142b-4786-948a-86a70fc4b410 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:34.881245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7f2eca84-142b-4786-948a-86a70fc4b410 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:34.887560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f2eca84-142b-4786-948a-86a70fc4b410 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:34.888052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f2eca84-142b-4786-948a-86a70fc4b410 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:34.888828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f2eca84-142b-4786-948a-86a70fc4b410 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:34.889273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7f2eca84-142b-4786-948a-86a70fc4b410 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:34.956740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fca94603-5339-473e-824d-fd10bedd38f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:34.957395 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fca94603-5339-473e-824d-fd10bedd38f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:34.963940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fca94603-5339-473e-824d-fd10bedd38f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:34.964818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fca94603-5339-473e-824d-fd10bedd38f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:34.965151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fca94603-5339-473e-824d-fd10bedd38f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:34.965588 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fca94603-5339-473e-824d-fd10bedd38f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:35.036912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fca94603-5339-473e-824d-fd10bedd38f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:35.040991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7f2eca84-142b-4786-948a-86a70fc4b410 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:35.045245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fca94603-5339-473e-824d-fd10bedd38f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.092420 May 12 07:20:35.046077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1476/2855] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:34 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:35.049589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7f2eca84-142b-4786-948a-86a70fc4b410 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.172814 May 12 07:20:35.050154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1380/2856] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:36.062370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-09c7a634-c6cb-40fc-b9a7-2cfab7576eae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:36.063716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-09c7a634-c6cb-40fc-b9a7-2cfab7576eae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:36.066005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-61cf0214-6d01-4543-af15-70ec8d21ea0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:36.066625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-61cf0214-6d01-4543-af15-70ec8d21ea0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:36.069994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09c7a634-c6cb-40fc-b9a7-2cfab7576eae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:36.070443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09c7a634-c6cb-40fc-b9a7-2cfab7576eae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:36.071216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09c7a634-c6cb-40fc-b9a7-2cfab7576eae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:36.071654 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-09c7a634-c6cb-40fc-b9a7-2cfab7576eae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:36.072850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61cf0214-6d01-4543-af15-70ec8d21ea0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:36.073307 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61cf0214-6d01-4543-af15-70ec8d21ea0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:36.074075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61cf0214-6d01-4543-af15-70ec8d21ea0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:36.074514 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-61cf0214-6d01-4543-af15-70ec8d21ea0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:36.139135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-09c7a634-c6cb-40fc-b9a7-2cfab7576eae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:36.149060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-09c7a634-c6cb-40fc-b9a7-2cfab7576eae tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.089035 May 12 07:20:36.149060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1477/2857] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:36 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:36.220290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-61cf0214-6d01-4543-af15-70ec8d21ea0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:36.228088 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-61cf0214-6d01-4543-af15-70ec8d21ea0c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.165839 May 12 07:20:36.228658 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1381/2858] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:37.164862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-50f4c8a2-2c1a-45b8-906c-ae6d65bda18a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:37.165407 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-50f4c8a2-2c1a-45b8-906c-ae6d65bda18a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:37.172363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50f4c8a2-2c1a-45b8-906c-ae6d65bda18a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:37.172815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50f4c8a2-2c1a-45b8-906c-ae6d65bda18a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:37.173576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50f4c8a2-2c1a-45b8-906c-ae6d65bda18a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:37.174008 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50f4c8a2-2c1a-45b8-906c-ae6d65bda18a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:37.238094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-50f4c8a2-2c1a-45b8-906c-ae6d65bda18a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:37.245874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-50f4c8a2-2c1a-45b8-906c-ae6d65bda18a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085008 May 12 07:20:37.246051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d905fe88-5a2e-4bf6-9452-1a845486fcf7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:37.246464 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1478/2859] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:37 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:37.246614 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d905fe88-5a2e-4bf6-9452-1a845486fcf7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:37.253623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d905fe88-5a2e-4bf6-9452-1a845486fcf7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:37.254081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d905fe88-5a2e-4bf6-9452-1a845486fcf7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:37.254857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d905fe88-5a2e-4bf6-9452-1a845486fcf7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:37.255299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d905fe88-5a2e-4bf6-9452-1a845486fcf7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:37.381942 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d905fe88-5a2e-4bf6-9452-1a845486fcf7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:37.389626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d905fe88-5a2e-4bf6-9452-1a845486fcf7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147597 May 12 07:20:37.390192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1382/2860] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:38.262933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-045c406b-bee4-4025-a673-2fd7290a7564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:38.263456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-045c406b-bee4-4025-a673-2fd7290a7564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:38.269831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-045c406b-bee4-4025-a673-2fd7290a7564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:38.270266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-045c406b-bee4-4025-a673-2fd7290a7564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:38.271036 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-045c406b-bee4-4025-a673-2fd7290a7564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:38.271478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-045c406b-bee4-4025-a673-2fd7290a7564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:38.332498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-045c406b-bee4-4025-a673-2fd7290a7564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:38.340483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-045c406b-bee4-4025-a673-2fd7290a7564 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082034 May 12 07:20:38.341051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1479/2861] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:38 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:38.406180 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-26a94698-253c-4625-81f9-1a140159f848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:38.406792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-26a94698-253c-4625-81f9-1a140159f848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:38.413070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26a94698-253c-4625-81f9-1a140159f848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:38.413519 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26a94698-253c-4625-81f9-1a140159f848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:38.414274 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26a94698-253c-4625-81f9-1a140159f848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:38.414707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-26a94698-253c-4625-81f9-1a140159f848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:38.556362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-26a94698-253c-4625-81f9-1a140159f848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:38.564595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-26a94698-253c-4625-81f9-1a140159f848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.162320 May 12 07:20:38.565149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1383/2862] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:38 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:39.357214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2b301c3d-e35d-4eb1-aa9d-1550ec860620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:39.357827 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2b301c3d-e35d-4eb1-aa9d-1550ec860620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:39.364292 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2b301c3d-e35d-4eb1-aa9d-1550ec860620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:39.364743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2b301c3d-e35d-4eb1-aa9d-1550ec860620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:39.365518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2b301c3d-e35d-4eb1-aa9d-1550ec860620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:39.365955 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2b301c3d-e35d-4eb1-aa9d-1550ec860620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:39.425343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2b301c3d-e35d-4eb1-aa9d-1550ec860620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:39.433024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2b301c3d-e35d-4eb1-aa9d-1550ec860620 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080316 May 12 07:20:39.433586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1480/2863] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:39 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:39.581390 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-483c3ab1-acdb-415e-9dd5-eb89cbd086e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:39.581933 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-483c3ab1-acdb-415e-9dd5-eb89cbd086e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:39.588322 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-483c3ab1-acdb-415e-9dd5-eb89cbd086e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:39.588774 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-483c3ab1-acdb-415e-9dd5-eb89cbd086e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:39.589539 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-483c3ab1-acdb-415e-9dd5-eb89cbd086e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:39.589984 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-483c3ab1-acdb-415e-9dd5-eb89cbd086e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:39.718422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-483c3ab1-acdb-415e-9dd5-eb89cbd086e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:39.726233 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-483c3ab1-acdb-415e-9dd5-eb89cbd086e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148816 May 12 07:20:39.726792 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1384/2864] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:40.449773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8488bc33-0f86-4147-83fe-07e3cf8194dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:40.450407 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8488bc33-0f86-4147-83fe-07e3cf8194dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:40.456675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8488bc33-0f86-4147-83fe-07e3cf8194dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:40.457123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8488bc33-0f86-4147-83fe-07e3cf8194dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:40.457915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8488bc33-0f86-4147-83fe-07e3cf8194dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:40.458348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8488bc33-0f86-4147-83fe-07e3cf8194dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:40.520731 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8488bc33-0f86-4147-83fe-07e3cf8194dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:40.528893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8488bc33-0f86-4147-83fe-07e3cf8194dd tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083015 May 12 07:20:40.529460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1481/2865] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:40 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:40.743671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4a5d4131-9b07-492f-bc5a-c860b71e447d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:40.744304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4a5d4131-9b07-492f-bc5a-c860b71e447d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:40.751111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a5d4131-9b07-492f-bc5a-c860b71e447d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:40.751570 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a5d4131-9b07-492f-bc5a-c860b71e447d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:40.752367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a5d4131-9b07-492f-bc5a-c860b71e447d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:40.752806 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4a5d4131-9b07-492f-bc5a-c860b71e447d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:40.876727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4a5d4131-9b07-492f-bc5a-c860b71e447d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:40.884367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4a5d4131-9b07-492f-bc5a-c860b71e447d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144609 May 12 07:20:40.884959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1385/2866] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:40 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:41.546820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e3741e83-605b-4ce3-8e95-85f329070d0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:41.547424 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e3741e83-605b-4ce3-8e95-85f329070d0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:41.553805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3741e83-605b-4ce3-8e95-85f329070d0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:41.554255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3741e83-605b-4ce3-8e95-85f329070d0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:41.555010 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3741e83-605b-4ce3-8e95-85f329070d0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:41.555446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3741e83-605b-4ce3-8e95-85f329070d0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:41.614811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e3741e83-605b-4ce3-8e95-85f329070d0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:41.622665 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e3741e83-605b-4ce3-8e95-85f329070d0b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080533 May 12 07:20:41.623220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1482/2867] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:41 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:41.901515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ae38b3d7-2b9a-4a1d-a46e-d0a42c05b373 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:41.902035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ae38b3d7-2b9a-4a1d-a46e-d0a42c05b373 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:41.908969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae38b3d7-2b9a-4a1d-a46e-d0a42c05b373 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:41.909425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae38b3d7-2b9a-4a1d-a46e-d0a42c05b373 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:41.910195 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae38b3d7-2b9a-4a1d-a46e-d0a42c05b373 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:41.910635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae38b3d7-2b9a-4a1d-a46e-d0a42c05b373 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:42.039280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ae38b3d7-2b9a-4a1d-a46e-d0a42c05b373 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:42.047331 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ae38b3d7-2b9a-4a1d-a46e-d0a42c05b373 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149828 May 12 07:20:42.047921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1386/2868] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:41 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:42.639169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4e9f4b58-e464-4338-affb-f51fb7d5d9b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:42.639797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4e9f4b58-e464-4338-affb-f51fb7d5d9b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:42.646174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e9f4b58-e464-4338-affb-f51fb7d5d9b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:42.646618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e9f4b58-e464-4338-affb-f51fb7d5d9b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:42.647376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e9f4b58-e464-4338-affb-f51fb7d5d9b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:42.647841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4e9f4b58-e464-4338-affb-f51fb7d5d9b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:42.707060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4e9f4b58-e464-4338-affb-f51fb7d5d9b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:42.714713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4e9f4b58-e464-4338-affb-f51fb7d5d9b9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079368 May 12 07:20:42.715364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1483/2869] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:42 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:43.064357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-4e359665-47f3-4770-9b2e-1ad427efc39b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:43.064967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-4e359665-47f3-4770-9b2e-1ad427efc39b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:43.071332 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4e359665-47f3-4770-9b2e-1ad427efc39b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:43.071823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4e359665-47f3-4770-9b2e-1ad427efc39b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:43.072590 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4e359665-47f3-4770-9b2e-1ad427efc39b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:43.073030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-4e359665-47f3-4770-9b2e-1ad427efc39b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:43.196008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-4e359665-47f3-4770-9b2e-1ad427efc39b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:43.204483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-4e359665-47f3-4770-9b2e-1ad427efc39b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144006 May 12 07:20:43.205057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1387/2870] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:43.731387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-edbc7f36-8ed7-4e16-a09d-6ef83b90e303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:43.731937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-edbc7f36-8ed7-4e16-a09d-6ef83b90e303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:43.738208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edbc7f36-8ed7-4e16-a09d-6ef83b90e303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:43.738657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edbc7f36-8ed7-4e16-a09d-6ef83b90e303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:43.739783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edbc7f36-8ed7-4e16-a09d-6ef83b90e303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:43.740525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edbc7f36-8ed7-4e16-a09d-6ef83b90e303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:43.804607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-edbc7f36-8ed7-4e16-a09d-6ef83b90e303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:43.812746 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-edbc7f36-8ed7-4e16-a09d-6ef83b90e303 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085246 May 12 07:20:43.813302 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1484/2871] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:43 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:44.221516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7216886f-aec8-4909-a722-6fb65043fece tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:44.222123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7216886f-aec8-4909-a722-6fb65043fece tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:44.228387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7216886f-aec8-4909-a722-6fb65043fece tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:44.228836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7216886f-aec8-4909-a722-6fb65043fece tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:44.229595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7216886f-aec8-4909-a722-6fb65043fece tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:44.230031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7216886f-aec8-4909-a722-6fb65043fece tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:44.353330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7216886f-aec8-4909-a722-6fb65043fece tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:44.361720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7216886f-aec8-4909-a722-6fb65043fece tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144048 May 12 07:20:44.362281 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1388/2872] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:44.829740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-94a08bdf-07f5-4e0b-ada8-5349a5adb704 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:44.830347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-94a08bdf-07f5-4e0b-ada8-5349a5adb704 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:44.836557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94a08bdf-07f5-4e0b-ada8-5349a5adb704 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:44.837006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94a08bdf-07f5-4e0b-ada8-5349a5adb704 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:44.837766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94a08bdf-07f5-4e0b-ada8-5349a5adb704 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:44.838199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-94a08bdf-07f5-4e0b-ada8-5349a5adb704 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:44.897191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-94a08bdf-07f5-4e0b-ada8-5349a5adb704 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:44.905359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-94a08bdf-07f5-4e0b-ada8-5349a5adb704 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079501 May 12 07:20:44.905922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1485/2873] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:44 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:45.378553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-49ab18d7-0a62-4fcd-aae4-99e01f85b988 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:45.379169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-49ab18d7-0a62-4fcd-aae4-99e01f85b988 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:45.385537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49ab18d7-0a62-4fcd-aae4-99e01f85b988 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:45.385991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49ab18d7-0a62-4fcd-aae4-99e01f85b988 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:45.386764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49ab18d7-0a62-4fcd-aae4-99e01f85b988 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:45.387206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49ab18d7-0a62-4fcd-aae4-99e01f85b988 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:45.513825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-49ab18d7-0a62-4fcd-aae4-99e01f85b988 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:45.521579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-49ab18d7-0a62-4fcd-aae4-99e01f85b988 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146905 May 12 07:20:45.522150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1389/2874] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:45 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:45.922762 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5bdb7792-ea3f-4b3e-bb0e-06b4ad22f0ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:45.923375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5bdb7792-ea3f-4b3e-bb0e-06b4ad22f0ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:45.929668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bdb7792-ea3f-4b3e-bb0e-06b4ad22f0ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:45.930116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bdb7792-ea3f-4b3e-bb0e-06b4ad22f0ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:45.930880 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bdb7792-ea3f-4b3e-bb0e-06b4ad22f0ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:45.931318 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bdb7792-ea3f-4b3e-bb0e-06b4ad22f0ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:45.990904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5bdb7792-ea3f-4b3e-bb0e-06b4ad22f0ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:45.998873 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5bdb7792-ea3f-4b3e-bb0e-06b4ad22f0ee tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080836 May 12 07:20:45.999641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1486/2875] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:45 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:46.538186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0466170c-e345-43a4-9ca8-5c84f2a4e5ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:46.538807 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0466170c-e345-43a4-9ca8-5c84f2a4e5ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:46.545972 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0466170c-e345-43a4-9ca8-5c84f2a4e5ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:46.546430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0466170c-e345-43a4-9ca8-5c84f2a4e5ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:46.547196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0466170c-e345-43a4-9ca8-5c84f2a4e5ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:46.547638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0466170c-e345-43a4-9ca8-5c84f2a4e5ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:46.674934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0466170c-e345-43a4-9ca8-5c84f2a4e5ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:46.682640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0466170c-e345-43a4-9ca8-5c84f2a4e5ed tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148405 May 12 07:20:46.683208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1390/2876] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:46 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:47.016362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8fb7266a-ca38-4da2-b8b3-c38ee4ad2d37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:47.016977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8fb7266a-ca38-4da2-b8b3-c38ee4ad2d37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:47.023223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fb7266a-ca38-4da2-b8b3-c38ee4ad2d37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:47.023673 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fb7266a-ca38-4da2-b8b3-c38ee4ad2d37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:47.024472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fb7266a-ca38-4da2-b8b3-c38ee4ad2d37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:47.024911 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8fb7266a-ca38-4da2-b8b3-c38ee4ad2d37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:47.086997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8fb7266a-ca38-4da2-b8b3-c38ee4ad2d37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:47.095379 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8fb7266a-ca38-4da2-b8b3-c38ee4ad2d37 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083557 May 12 07:20:47.095977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1487/2877] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:47 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:47.700045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-647c3d96-b9c1-4d22-a980-bc915e16b76d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:47.700597 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-647c3d96-b9c1-4d22-a980-bc915e16b76d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:47.706917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-647c3d96-b9c1-4d22-a980-bc915e16b76d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:47.707374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-647c3d96-b9c1-4d22-a980-bc915e16b76d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:47.708171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-647c3d96-b9c1-4d22-a980-bc915e16b76d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:47.708613 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-647c3d96-b9c1-4d22-a980-bc915e16b76d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:47.831543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-647c3d96-b9c1-4d22-a980-bc915e16b76d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:47.839363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-647c3d96-b9c1-4d22-a980-bc915e16b76d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143292 May 12 07:20:47.839959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1391/2878] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:48.112203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3b3fdd69-699d-416c-8263-b1775049a45d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:48.112822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3b3fdd69-699d-416c-8263-b1775049a45d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:48.119063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3b3fdd69-699d-416c-8263-b1775049a45d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:48.119517 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3b3fdd69-699d-416c-8263-b1775049a45d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:48.120310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3b3fdd69-699d-416c-8263-b1775049a45d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:48.120748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3b3fdd69-699d-416c-8263-b1775049a45d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:48.182303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3b3fdd69-699d-416c-8263-b1775049a45d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:48.190100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3b3fdd69-699d-416c-8263-b1775049a45d tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081701 May 12 07:20:48.190656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1488/2879] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:48 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:48.856371 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-31bab589-9126-43ac-ad80-a94772b393a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:48.856981 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-31bab589-9126-43ac-ad80-a94772b393a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:48.863248 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31bab589-9126-43ac-ad80-a94772b393a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:48.863720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31bab589-9126-43ac-ad80-a94772b393a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:48.864483 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31bab589-9126-43ac-ad80-a94772b393a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:48.864914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-31bab589-9126-43ac-ad80-a94772b393a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:48.990225 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-31bab589-9126-43ac-ad80-a94772b393a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:48.998986 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-31bab589-9126-43ac-ad80-a94772b393a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146461 May 12 07:20:48.999552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1392/2880] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:48 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:49.206928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c7c6caf8-73aa-4f57-bfcc-7d33fed248d7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:49.207465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c7c6caf8-73aa-4f57-bfcc-7d33fed248d7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:49.213690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7c6caf8-73aa-4f57-bfcc-7d33fed248d7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:49.214136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7c6caf8-73aa-4f57-bfcc-7d33fed248d7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:49.214896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7c6caf8-73aa-4f57-bfcc-7d33fed248d7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:49.215330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c7c6caf8-73aa-4f57-bfcc-7d33fed248d7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:49.274534 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c7c6caf8-73aa-4f57-bfcc-7d33fed248d7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:49.282178 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c7c6caf8-73aa-4f57-bfcc-7d33fed248d7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079128 May 12 07:20:49.282740 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1489/2881] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:49 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:50.016347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c8edef13-3a25-40e8-8755-ddf91d0371e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:50.016963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c8edef13-3a25-40e8-8755-ddf91d0371e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:50.023368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8edef13-3a25-40e8-8755-ddf91d0371e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:50.023854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8edef13-3a25-40e8-8755-ddf91d0371e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:50.024623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8edef13-3a25-40e8-8755-ddf91d0371e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:50.025066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c8edef13-3a25-40e8-8755-ddf91d0371e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:50.150006 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c8edef13-3a25-40e8-8755-ddf91d0371e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:50.158447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c8edef13-3a25-40e8-8755-ddf91d0371e4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145943 May 12 07:20:50.159018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1393/2882] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:50.298649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fe636452-be75-428b-89ab-74c927fc5933 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:50.299215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fe636452-be75-428b-89ab-74c927fc5933 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:50.305649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe636452-be75-428b-89ab-74c927fc5933 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:50.306097 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe636452-be75-428b-89ab-74c927fc5933 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:50.306859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe636452-be75-428b-89ab-74c927fc5933 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:50.307293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe636452-be75-428b-89ab-74c927fc5933 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:50.371461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fe636452-be75-428b-89ab-74c927fc5933 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:50.379145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fe636452-be75-428b-89ab-74c927fc5933 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084758 May 12 07:20:50.379734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1490/2883] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:50 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:51.176579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1d2693db-53ae-4bbb-b500-3ff2acdc8e80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:51.177220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1d2693db-53ae-4bbb-b500-3ff2acdc8e80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:51.183621 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d2693db-53ae-4bbb-b500-3ff2acdc8e80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:51.184105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d2693db-53ae-4bbb-b500-3ff2acdc8e80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:51.184866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d2693db-53ae-4bbb-b500-3ff2acdc8e80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:51.185337 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d2693db-53ae-4bbb-b500-3ff2acdc8e80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:51.307382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1d2693db-53ae-4bbb-b500-3ff2acdc8e80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:51.315095 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1d2693db-53ae-4bbb-b500-3ff2acdc8e80 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.142358 May 12 07:20:51.315663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1394/2884] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:51.396430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b07191b8-09cb-4e91-94fe-41490b92f8f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:51.397039 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b07191b8-09cb-4e91-94fe-41490b92f8f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:51.403604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b07191b8-09cb-4e91-94fe-41490b92f8f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:51.404079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b07191b8-09cb-4e91-94fe-41490b92f8f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:51.404841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b07191b8-09cb-4e91-94fe-41490b92f8f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:51.405274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b07191b8-09cb-4e91-94fe-41490b92f8f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:51.466206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b07191b8-09cb-4e91-94fe-41490b92f8f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:51.473824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b07191b8-09cb-4e91-94fe-41490b92f8f7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081194 May 12 07:20:51.474385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1491/2885] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:51 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:52.332367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-33f38ec4-6614-41fa-8db7-e0d6cd3927b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:52.332906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-33f38ec4-6614-41fa-8db7-e0d6cd3927b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:52.339186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33f38ec4-6614-41fa-8db7-e0d6cd3927b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:52.339638 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33f38ec4-6614-41fa-8db7-e0d6cd3927b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:52.340434 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33f38ec4-6614-41fa-8db7-e0d6cd3927b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:52.340876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-33f38ec4-6614-41fa-8db7-e0d6cd3927b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:52.469940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-33f38ec4-6614-41fa-8db7-e0d6cd3927b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:52.477646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-33f38ec4-6614-41fa-8db7-e0d6cd3927b5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149310 May 12 07:20:52.478220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1395/2886] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:52.490173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-48877735-b64c-49e6-819f-c44e525b518a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:52.490789 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-48877735-b64c-49e6-819f-c44e525b518a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:52.497696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48877735-b64c-49e6-819f-c44e525b518a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:52.498148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48877735-b64c-49e6-819f-c44e525b518a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:52.498923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48877735-b64c-49e6-819f-c44e525b518a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:52.499362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-48877735-b64c-49e6-819f-c44e525b518a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:52.559350 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-48877735-b64c-49e6-819f-c44e525b518a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:52.567015 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-48877735-b64c-49e6-819f-c44e525b518a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080684 May 12 07:20:52.567578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1492/2887] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:52 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:53.494694 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b2993df4-6b7a-47c2-8f91-5664a85b0395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:53.495315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b2993df4-6b7a-47c2-8f91-5664a85b0395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:53.502138 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2993df4-6b7a-47c2-8f91-5664a85b0395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:53.502588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2993df4-6b7a-47c2-8f91-5664a85b0395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:53.503352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2993df4-6b7a-47c2-8f91-5664a85b0395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:53.503824 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b2993df4-6b7a-47c2-8f91-5664a85b0395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:53.583920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0dabad83-120f-4c40-ab8d-37eac2c42602 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:53.584483 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0dabad83-120f-4c40-ab8d-37eac2c42602 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:53.590757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0dabad83-120f-4c40-ab8d-37eac2c42602 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:53.591236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0dabad83-120f-4c40-ab8d-37eac2c42602 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:53.592041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0dabad83-120f-4c40-ab8d-37eac2c42602 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:53.592482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0dabad83-120f-4c40-ab8d-37eac2c42602 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:53.639444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b2993df4-6b7a-47c2-8f91-5664a85b0395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:53.647330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b2993df4-6b7a-47c2-8f91-5664a85b0395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.156507 May 12 07:20:53.648151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1396/2888] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:53.655042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0dabad83-120f-4c40-ab8d-37eac2c42602 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:53.662802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0dabad83-120f-4c40-ab8d-37eac2c42602 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082757 May 12 07:20:53.663364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1493/2889] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:53 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:54.664326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bcbdf290-22e5-475f-8033-b6f07f5f7718 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:54.664946 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-bcbdf290-22e5-475f-8033-b6f07f5f7718 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:54.671486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bcbdf290-22e5-475f-8033-b6f07f5f7718 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:54.671976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bcbdf290-22e5-475f-8033-b6f07f5f7718 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:54.672750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bcbdf290-22e5-475f-8033-b6f07f5f7718 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:54.673194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-bcbdf290-22e5-475f-8033-b6f07f5f7718 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:54.680324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2d9344d3-d64f-4764-9637-6e0042fad709 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:54.680959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2d9344d3-d64f-4764-9637-6e0042fad709 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:54.687397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d9344d3-d64f-4764-9637-6e0042fad709 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:54.687988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d9344d3-d64f-4764-9637-6e0042fad709 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:54.688776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d9344d3-d64f-4764-9637-6e0042fad709 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:54.689218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2d9344d3-d64f-4764-9637-6e0042fad709 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:54.772709 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2d9344d3-d64f-4764-9637-6e0042fad709 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:54.781143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2d9344d3-d64f-4764-9637-6e0042fad709 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.104731 May 12 07:20:54.781741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1494/2890] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:54 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:54.828420 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-bcbdf290-22e5-475f-8033-b6f07f5f7718 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:54.836196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bcbdf290-22e5-475f-8033-b6f07f5f7718 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.175736 May 12 07:20:54.836767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1397/2891] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:55.797695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-95a026e0-3432-44e7-9287-35a1e7387559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:55.798321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-95a026e0-3432-44e7-9287-35a1e7387559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:55.804639 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95a026e0-3432-44e7-9287-35a1e7387559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:55.805091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95a026e0-3432-44e7-9287-35a1e7387559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:55.805867 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95a026e0-3432-44e7-9287-35a1e7387559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:55.806314 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-95a026e0-3432-44e7-9287-35a1e7387559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:55.853338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-902dfa66-8d22-4578-ab39-0c361b4540c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:55.854051 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-902dfa66-8d22-4578-ab39-0c361b4540c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:55.860980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-902dfa66-8d22-4578-ab39-0c361b4540c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:55.861436 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-902dfa66-8d22-4578-ab39-0c361b4540c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:55.862209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-902dfa66-8d22-4578-ab39-0c361b4540c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:55.862649 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-902dfa66-8d22-4578-ab39-0c361b4540c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:55.867841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-95a026e0-3432-44e7-9287-35a1e7387559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:55.875645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-95a026e0-3432-44e7-9287-35a1e7387559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.082628 May 12 07:20:55.876246 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1495/2892] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:55 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:55.990255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-902dfa66-8d22-4578-ab39-0c361b4540c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:55.998118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-902dfa66-8d22-4578-ab39-0c361b4540c3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148600 May 12 07:20:55.998726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1398/2893] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:55 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:56.892307 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-98473c4c-5c56-4c98-82b0-691a357e1fc0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:56.892921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-98473c4c-5c56-4c98-82b0-691a357e1fc0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:56.899200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98473c4c-5c56-4c98-82b0-691a357e1fc0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:56.899652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98473c4c-5c56-4c98-82b0-691a357e1fc0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:56.900453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98473c4c-5c56-4c98-82b0-691a357e1fc0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:56.900894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-98473c4c-5c56-4c98-82b0-691a357e1fc0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:56.960462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-98473c4c-5c56-4c98-82b0-691a357e1fc0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:56.968327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-98473c4c-5c56-4c98-82b0-691a357e1fc0 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079916 May 12 07:20:56.968889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1496/2894] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:56 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:57.014196 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-895f0d72-d16c-4d48-bbdc-6c18313b16e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:57.014809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-895f0d72-d16c-4d48-bbdc-6c18313b16e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:57.021121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-895f0d72-d16c-4d48-bbdc-6c18313b16e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:57.021571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-895f0d72-d16c-4d48-bbdc-6c18313b16e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:57.022326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-895f0d72-d16c-4d48-bbdc-6c18313b16e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:57.022765 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-895f0d72-d16c-4d48-bbdc-6c18313b16e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:57.145244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-895f0d72-d16c-4d48-bbdc-6c18313b16e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:57.153402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-895f0d72-d16c-4d48-bbdc-6c18313b16e8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143109 May 12 07:20:57.153968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1399/2895] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:57.985155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-65dbe963-5406-4250-a7b7-30b5a8f54788 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:57.985771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-65dbe963-5406-4250-a7b7-30b5a8f54788 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:57.992643 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65dbe963-5406-4250-a7b7-30b5a8f54788 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:57.992767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65dbe963-5406-4250-a7b7-30b5a8f54788 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:57.993435 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65dbe963-5406-4250-a7b7-30b5a8f54788 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:57.993878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-65dbe963-5406-4250-a7b7-30b5a8f54788 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:58.058651 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-65dbe963-5406-4250-a7b7-30b5a8f54788 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:58.066321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-65dbe963-5406-4250-a7b7-30b5a8f54788 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.085053 May 12 07:20:58.066883 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1497/2896] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:57 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:20:58.171172 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-da00c205-21b3-42fc-b5c5-4d7b3b4c2340 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:58.171873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-da00c205-21b3-42fc-b5c5-4d7b3b4c2340 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:58.178111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da00c205-21b3-42fc-b5c5-4d7b3b4c2340 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:58.178566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da00c205-21b3-42fc-b5c5-4d7b3b4c2340 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:58.179334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da00c205-21b3-42fc-b5c5-4d7b3b4c2340 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:58.179800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da00c205-21b3-42fc-b5c5-4d7b3b4c2340 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:58.303279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-da00c205-21b3-42fc-b5c5-4d7b3b4c2340 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:58.311733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-da00c205-21b3-42fc-b5c5-4d7b3b4c2340 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145166 May 12 07:20:58.312354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1400/2897] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:59.083698 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8072ca5a-5214-4c5c-b070-fae280f9cc7a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:59.084331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8072ca5a-5214-4c5c-b070-fae280f9cc7a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:59.091117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8072ca5a-5214-4c5c-b070-fae280f9cc7a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:59.091565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8072ca5a-5214-4c5c-b070-fae280f9cc7a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:59.092365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8072ca5a-5214-4c5c-b070-fae280f9cc7a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:59.092798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8072ca5a-5214-4c5c-b070-fae280f9cc7a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:59.151346 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8072ca5a-5214-4c5c-b070-fae280f9cc7a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:59.159580 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8072ca5a-5214-4c5c-b070-fae280f9cc7a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079697 May 12 07:20:59.160172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1498/2898] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:59 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:20:59.329350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ff13975c-da30-4940-b63f-73d2596d89a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:20:59.329897 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ff13975c-da30-4940-b63f-73d2596d89a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:20:59.336216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff13975c-da30-4940-b63f-73d2596d89a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:59.336672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff13975c-da30-4940-b63f-73d2596d89a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:59.337433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff13975c-da30-4940-b63f-73d2596d89a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:20:59.337867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ff13975c-da30-4940-b63f-73d2596d89a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:20:59.464317 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ff13975c-da30-4940-b63f-73d2596d89a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:20:59.471969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ff13975c-da30-4940-b63f-73d2596d89a0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146574 May 12 07:20:59.472535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1401/2899] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:20:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:00.176832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aec0cb91-25b2-41f8-aa12-c23b4173684e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:00.177445 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-aec0cb91-25b2-41f8-aa12-c23b4173684e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:00.183783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aec0cb91-25b2-41f8-aa12-c23b4173684e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:00.184238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aec0cb91-25b2-41f8-aa12-c23b4173684e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:00.185003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aec0cb91-25b2-41f8-aa12-c23b4173684e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:00.185443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aec0cb91-25b2-41f8-aa12-c23b4173684e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:00.245616 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-aec0cb91-25b2-41f8-aa12-c23b4173684e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:00.252971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aec0cb91-25b2-41f8-aa12-c23b4173684e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079969 May 12 07:21:00.253533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1499/2900] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:00 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:00.488791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f7dc300a-fa06-4911-acd1-3364bdcf351b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:00.489408 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f7dc300a-fa06-4911-acd1-3364bdcf351b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:00.495695 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f7dc300a-fa06-4911-acd1-3364bdcf351b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:00.496111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f7dc300a-fa06-4911-acd1-3364bdcf351b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:00.496893 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f7dc300a-fa06-4911-acd1-3364bdcf351b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:00.497329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f7dc300a-fa06-4911-acd1-3364bdcf351b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:00.621788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f7dc300a-fa06-4911-acd1-3364bdcf351b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:00.629635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f7dc300a-fa06-4911-acd1-3364bdcf351b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144673 May 12 07:21:00.630208 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1402/2901] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:01.269960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5945ffbc-e0d5-4d10-a517-5ebaa221b352 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:01.270496 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5945ffbc-e0d5-4d10-a517-5ebaa221b352 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:01.276781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5945ffbc-e0d5-4d10-a517-5ebaa221b352 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:01.277231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5945ffbc-e0d5-4d10-a517-5ebaa221b352 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:01.278001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5945ffbc-e0d5-4d10-a517-5ebaa221b352 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:01.278469 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5945ffbc-e0d5-4d10-a517-5ebaa221b352 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:01.341719 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5945ffbc-e0d5-4d10-a517-5ebaa221b352 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:01.349512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5945ffbc-e0d5-4d10-a517-5ebaa221b352 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.083499 May 12 07:21:01.350067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1500/2902] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:01 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:01.646736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5c9f3b64-a301-4535-939d-54ad37e16151 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:01.647271 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5c9f3b64-a301-4535-939d-54ad37e16151 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:01.653609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c9f3b64-a301-4535-939d-54ad37e16151 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:01.654055 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c9f3b64-a301-4535-939d-54ad37e16151 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:01.654812 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c9f3b64-a301-4535-939d-54ad37e16151 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:01.655245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5c9f3b64-a301-4535-939d-54ad37e16151 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:01.779707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5c9f3b64-a301-4535-939d-54ad37e16151 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:01.787494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5c9f3b64-a301-4535-939d-54ad37e16151 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144820 May 12 07:21:01.788127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1403/2903] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:02.366326 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4a72c6d7-2421-4abb-87ba-fd5d0ddd71d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:02.366891 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4a72c6d7-2421-4abb-87ba-fd5d0ddd71d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:02.373612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a72c6d7-2421-4abb-87ba-fd5d0ddd71d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:02.374058 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a72c6d7-2421-4abb-87ba-fd5d0ddd71d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:02.374818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a72c6d7-2421-4abb-87ba-fd5d0ddd71d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:02.375250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4a72c6d7-2421-4abb-87ba-fd5d0ddd71d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:02.434397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4a72c6d7-2421-4abb-87ba-fd5d0ddd71d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:02.441943 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4a72c6d7-2421-4abb-87ba-fd5d0ddd71d3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.079554 May 12 07:21:02.442497 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1501/2904] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:02 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:02.805648 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-00fdce23-b2eb-4d26-b3a2-aa898e46e8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:02.806269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-00fdce23-b2eb-4d26-b3a2-aa898e46e8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:02.813185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00fdce23-b2eb-4d26-b3a2-aa898e46e8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:02.813635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00fdce23-b2eb-4d26-b3a2-aa898e46e8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:02.814399 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00fdce23-b2eb-4d26-b3a2-aa898e46e8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:02.814837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00fdce23-b2eb-4d26-b3a2-aa898e46e8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:02.940874 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-00fdce23-b2eb-4d26-b3a2-aa898e46e8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:02.948628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-00fdce23-b2eb-4d26-b3a2-aa898e46e8dd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146891 May 12 07:21:02.949193 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1404/2905] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:03.459234 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9acd7d85-f412-4fe8-b820-0d346d832be7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:03.459873 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9acd7d85-f412-4fe8-b820-0d346d832be7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:03.466868 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9acd7d85-f412-4fe8-b820-0d346d832be7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:03.467319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9acd7d85-f412-4fe8-b820-0d346d832be7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:03.468118 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9acd7d85-f412-4fe8-b820-0d346d832be7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:03.468558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9acd7d85-f412-4fe8-b820-0d346d832be7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:03.528001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9acd7d85-f412-4fe8-b820-0d346d832be7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:03.535614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9acd7d85-f412-4fe8-b820-0d346d832be7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080273 May 12 07:21:03.536210 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1502/2906] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:03 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:03.965759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-11840e6d-fdf2-42fa-a81e-791b09e46d67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:03.966293 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-11840e6d-fdf2-42fa-a81e-791b09e46d67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:03.972690 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-11840e6d-fdf2-42fa-a81e-791b09e46d67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:03.973143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-11840e6d-fdf2-42fa-a81e-791b09e46d67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:03.973913 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-11840e6d-fdf2-42fa-a81e-791b09e46d67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:03.974351 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-11840e6d-fdf2-42fa-a81e-791b09e46d67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:04.098320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-11840e6d-fdf2-42fa-a81e-791b09e46d67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:04.106515 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-11840e6d-fdf2-42fa-a81e-791b09e46d67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144674 May 12 07:21:04.107089 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1405/2907] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:04.551870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-86f102d1-0f6b-412f-895e-aba0025ff2aa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:04.552492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-86f102d1-0f6b-412f-895e-aba0025ff2aa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:04.558718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-86f102d1-0f6b-412f-895e-aba0025ff2aa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:04.562106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-86f102d1-0f6b-412f-895e-aba0025ff2aa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:04.562106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-86f102d1-0f6b-412f-895e-aba0025ff2aa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:04.562106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-86f102d1-0f6b-412f-895e-aba0025ff2aa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:04.624156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-86f102d1-0f6b-412f-895e-aba0025ff2aa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:04.632135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-86f102d1-0f6b-412f-895e-aba0025ff2aa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.084152 May 12 07:21:04.641408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1503/2908] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:04 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:05.123504 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cf96136a-3700-46af-ab5c-26df9850235b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:05.124214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cf96136a-3700-46af-ab5c-26df9850235b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:05.130569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf96136a-3700-46af-ab5c-26df9850235b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:05.131026 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf96136a-3700-46af-ab5c-26df9850235b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:05.131823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf96136a-3700-46af-ab5c-26df9850235b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:05.132270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cf96136a-3700-46af-ab5c-26df9850235b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:05.258378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cf96136a-3700-46af-ab5c-26df9850235b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:05.266798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cf96136a-3700-46af-ab5c-26df9850235b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147239 May 12 07:21:05.267362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1406/2909] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:05.648088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e0d77988-0ced-480a-bfc8-31fe7d6fd28f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:05.648704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e0d77988-0ced-480a-bfc8-31fe7d6fd28f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:05.654909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0d77988-0ced-480a-bfc8-31fe7d6fd28f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:05.655365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0d77988-0ced-480a-bfc8-31fe7d6fd28f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:05.656161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0d77988-0ced-480a-bfc8-31fe7d6fd28f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:05.656594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e0d77988-0ced-480a-bfc8-31fe7d6fd28f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:05.717505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e0d77988-0ced-480a-bfc8-31fe7d6fd28f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:05.725258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e0d77988-0ced-480a-bfc8-31fe7d6fd28f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.081029 May 12 07:21:05.725824 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1504/2910] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:05 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:06.283886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9870ea67-759a-4c81-abd6-22a960609ee6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:06.284450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9870ea67-759a-4c81-abd6-22a960609ee6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:06.290685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9870ea67-759a-4c81-abd6-22a960609ee6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:06.291133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9870ea67-759a-4c81-abd6-22a960609ee6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:06.292510 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9870ea67-759a-4c81-abd6-22a960609ee6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:06.292952 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9870ea67-759a-4c81-abd6-22a960609ee6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:06.419383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9870ea67-759a-4c81-abd6-22a960609ee6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:06.427417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9870ea67-759a-4c81-abd6-22a960609ee6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147529 May 12 07:21:06.428214 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1407/2911] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:06.742212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bb87964c-60bd-41dc-82b3-032794653919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:06.742823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bb87964c-60bd-41dc-82b3-032794653919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:06.749550 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb87964c-60bd-41dc-82b3-032794653919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:06.749997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb87964c-60bd-41dc-82b3-032794653919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:06.750756 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb87964c-60bd-41dc-82b3-032794653919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:06.751191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb87964c-60bd-41dc-82b3-032794653919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:06.811381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bb87964c-60bd-41dc-82b3-032794653919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:06.819025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bb87964c-60bd-41dc-82b3-032794653919 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 200 len: 1368 microversion: 2.1 time: 0.080653 May 12 07:21:06.819584 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1505/2912] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:06 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:06.836160 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a31e3872-de06-491d-9ee6-40140a07f8ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '.version_select at 0x7f89db7a75e0>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:06.928668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a31e3872-de06-491d-9ee6-40140a07f8ea tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108455361" status: 202 len: 0 microversion: 2.1 time: 0.096188 May 12 07:21:06.929245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1408/2913] 10.222.0.25 () {58 vars in 1220 bytes} [Thu May 12 07:21:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108455361 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:21:07.444888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-78e2b851-0cbb-450d-a9cf-940023d20db2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:07.445810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-78e2b851-0cbb-450d-a9cf-940023d20db2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:07.451820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78e2b851-0cbb-450d-a9cf-940023d20db2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:07.454044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78e2b851-0cbb-450d-a9cf-940023d20db2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:07.454044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78e2b851-0cbb-450d-a9cf-940023d20db2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:07.454044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-78e2b851-0cbb-450d-a9cf-940023d20db2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:07.582471 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-78e2b851-0cbb-450d-a9cf-940023d20db2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:07.593049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-78e2b851-0cbb-450d-a9cf-940023d20db2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.152208 May 12 07:21:07.593676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1506/2914] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:07 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:21:07.798517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dafa6d83-4340-44f7-991f-fad27898297a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Action: 'create', calling method: .version_select at 0x7f89da367820>, body: {"keypair": {"name": "tempest-keypair-1062079306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZooHk7rNjOEuKTHU44lvqEcFmXxrOsONUbIiTZCBafOoR18RaRJ5ofi8yRebSbWEV0Jo/9Lry8idMsPNWjA5CJ3yZI4uRUb2hVF5/Hd6AhbzJA9Oqe8p3MG/jVieJIVA=="}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:21:07.812220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-dafa6d83-4340-44f7-991f-fad27898297a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Getting quotas for project 91ccbfb303dc40a7a2313fe5e6ab3332. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 07:21:07.815975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-dafa6d83-4340-44f7-991f-fad27898297a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Getting quotas for user 9f11c63feb0740aeb5283907c8b61680 and project 91ccbfb303dc40a7a2313fe5e6ab3332. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 07:21:07.894261 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dafa6d83-4340-44f7-991f-fad27898297a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100418 May 12 07:21:07.894857 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1409/2915] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 12 07:21:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:21:08.610725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f151a948-51a9-4c1f-a024-35f02752c7ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:08.611373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f151a948-51a9-4c1f-a024-35f02752c7ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:08.617934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f151a948-51a9-4c1f-a024-35f02752c7ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:08.618398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f151a948-51a9-4c1f-a024-35f02752c7ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:08.619182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f151a948-51a9-4c1f-a024-35f02752c7ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:08.619626 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f151a948-51a9-4c1f-a024-35f02752c7ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:08.748510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f151a948-51a9-4c1f-a024-35f02752c7ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:08.756539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f151a948-51a9-4c1f-a024-35f02752c7ce tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149687 May 12 07:21:08.757119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1507/2916] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:21:09.773992 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-af9d034e-4c68-4161-b232-0197c0f50380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:09.778188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-af9d034e-4c68-4161-b232-0197c0f50380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:09.781579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af9d034e-4c68-4161-b232-0197c0f50380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:09.782033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af9d034e-4c68-4161-b232-0197c0f50380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:09.782801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af9d034e-4c68-4161-b232-0197c0f50380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:09.783237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-af9d034e-4c68-4161-b232-0197c0f50380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:10.064655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1222317237", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da0f96e3-1311-43e5-90e2-f64c5fdcda1b"}], "security_groups": [{"name": "tempest-securitygroup--542659920"}], "key_name": "tempest-keypair-1062079306", "user_data": "}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:21:10.172070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-af9d034e-4c68-4161-b232-0197c0f50380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:10.180710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-af9d034e-4c68-4161-b232-0197c0f50380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.411078 May 12 07:21:10.191235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1410/2917] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:10.206012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.network.neutron [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] validate_networks() for [('da0f96e3-1311-43e5-90e2-f64c5fdcda1b', None, None, None, None, None)] {{(pid=124025) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 07:21:10.624248 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Flavor limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 07:21:10.624676 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Image limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 07:21:10.625155 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Flavor pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 07:21:10.625575 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Image pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 07:21:10.625994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 07:21:10.634589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:10.635042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:10.635906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:10.637022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:10.653339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Getting quotas for project 91ccbfb303dc40a7a2313fe5e6ab3332. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 07:21:10.657277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Getting quotas for user 9f11c63feb0740aeb5283907c8b61680 and project 91ccbfb303dc40a7a2313fe5e6ab3332. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 07:21:10.667995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Going to run 1 instances... {{(pid=124025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 07:21:10.670215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 07:21:10.800779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-04edb2bf-d069-406d-8a8b-1965c2a6c962 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.740361 May 12 07:21:10.801744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1508/2918] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 07:21:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 07:21:10.812061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f4630f32-1e66-4f67-9910-b0b707096887 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:10.812680 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f4630f32-1e66-4f67-9910-b0b707096887 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:10.864618 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f4630f32-1e66-4f67-9910-b0b707096887 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:10.871840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f4630f32-1e66-4f67-9910-b0b707096887 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1238 microversion: 2.1 time: 0.064163 May 12 07:21:10.872395 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1411/2919] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:10 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:11.198872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f13e288e-5ece-4f42-b7bd-1e461b3dcd73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:11.199501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f13e288e-5ece-4f42-b7bd-1e461b3dcd73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:11.205567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f13e288e-5ece-4f42-b7bd-1e461b3dcd73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:11.206029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f13e288e-5ece-4f42-b7bd-1e461b3dcd73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:11.206806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f13e288e-5ece-4f42-b7bd-1e461b3dcd73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:11.207254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f13e288e-5ece-4f42-b7bd-1e461b3dcd73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:11.335974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f13e288e-5ece-4f42-b7bd-1e461b3dcd73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:11.344336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f13e288e-5ece-4f42-b7bd-1e461b3dcd73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149835 May 12 07:21:11.345313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1509/2920] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:11.889258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-83361a3d-55bb-482c-b011-81545372b00e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:11.889866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-83361a3d-55bb-482c-b011-81545372b00e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:11.899033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83361a3d-55bb-482c-b011-81545372b00e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:11.899525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83361a3d-55bb-482c-b011-81545372b00e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:11.900326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83361a3d-55bb-482c-b011-81545372b00e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:11.900770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-83361a3d-55bb-482c-b011-81545372b00e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:11.965652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-83361a3d-55bb-482c-b011-81545372b00e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:11.974354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-83361a3d-55bb-482c-b011-81545372b00e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1242 microversion: 2.1 time: 0.089524 May 12 07:21:11.974997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1412/2921] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:11 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:12.361927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e7a7871c-3227-419c-abe9-6d63246f27cd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:12.362546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e7a7871c-3227-419c-abe9-6d63246f27cd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:12.368884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e7a7871c-3227-419c-abe9-6d63246f27cd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:12.369338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e7a7871c-3227-419c-abe9-6d63246f27cd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:12.370113 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e7a7871c-3227-419c-abe9-6d63246f27cd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:12.371217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e7a7871c-3227-419c-abe9-6d63246f27cd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:12.496713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e7a7871c-3227-419c-abe9-6d63246f27cd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:12.504520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e7a7871c-3227-419c-abe9-6d63246f27cd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146512 May 12 07:21:12.505098 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1510/2922] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:12 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:12.990778 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c76f3ace-37ef-48e2-bd31-d38de847f39f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:12.991388 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c76f3ace-37ef-48e2-bd31-d38de847f39f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:12.998674 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c76f3ace-37ef-48e2-bd31-d38de847f39f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:12.999124 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c76f3ace-37ef-48e2-bd31-d38de847f39f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:12.999924 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c76f3ace-37ef-48e2-bd31-d38de847f39f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:13.000360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c76f3ace-37ef-48e2-bd31-d38de847f39f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:13.064121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c76f3ace-37ef-48e2-bd31-d38de847f39f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:13.071419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c76f3ace-37ef-48e2-bd31-d38de847f39f tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1296 microversion: 2.1 time: 0.084429 May 12 07:21:13.072018 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1413/2923] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:12 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:13.521754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fefdf748-107d-4892-aeb6-cb837b261337 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:13.522381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fefdf748-107d-4892-aeb6-cb837b261337 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:13.528375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fefdf748-107d-4892-aeb6-cb837b261337 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:13.528764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fefdf748-107d-4892-aeb6-cb837b261337 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:13.529526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fefdf748-107d-4892-aeb6-cb837b261337 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:13.529960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fefdf748-107d-4892-aeb6-cb837b261337 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:13.669670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fefdf748-107d-4892-aeb6-cb837b261337 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:13.677876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fefdf748-107d-4892-aeb6-cb837b261337 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.159919 May 12 07:21:13.678446 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1511/2924] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:14.094943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e10ae4a8-8eae-4c19-899f-a59cc396aa71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:14.095488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e10ae4a8-8eae-4c19-899f-a59cc396aa71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:14.103158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e10ae4a8-8eae-4c19-899f-a59cc396aa71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:14.103612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e10ae4a8-8eae-4c19-899f-a59cc396aa71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:14.104417 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e10ae4a8-8eae-4c19-899f-a59cc396aa71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:14.104922 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e10ae4a8-8eae-4c19-899f-a59cc396aa71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:14.232572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e10ae4a8-8eae-4c19-899f-a59cc396aa71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:14.241037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e10ae4a8-8eae-4c19-899f-a59cc396aa71 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1363 microversion: 2.1 time: 0.150032 May 12 07:21:14.241814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1414/2925] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:14 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:14.356398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-8a712a74-b9fe-4d81-a9ec-348be33ec2f1 req-36d94d3b-88fe-4097-b2b1-b53dcdef43da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e764fc04-6610-4900-8353-39c895a25366", "tag": "4b943e79-d5b1-480e-9146-82b63a3d9fd4"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:21:14.366353 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-8a712a74-b9fe-4d81-a9ec-348be33ec2f1 req-36d94d3b-88fe-4097-b2b1-b53dcdef43da service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:14.366807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-8a712a74-b9fe-4d81-a9ec-348be33ec2f1 req-36d94d3b-88fe-4097-b2b1-b53dcdef43da service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:14.380403 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-8a712a74-b9fe-4d81-a9ec-348be33ec2f1 req-36d94d3b-88fe-4097-b2b1-b53dcdef43da service nova] Creating event network-changed:4b943e79-d5b1-480e-9146-82b63a3d9fd4 for instance e764fc04-6610-4900-8353-39c895a25366 on hv-cinder-76606 May 12 07:21:14.385841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-8a712a74-b9fe-4d81-a9ec-348be33ec2f1 req-36d94d3b-88fe-4097-b2b1-b53dcdef43da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095319 May 12 07:21:14.387257 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1512/2926] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:21:14.698364 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-70fda538-8e16-4541-8e92-0c2890232b11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:14.698974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-70fda538-8e16-4541-8e92-0c2890232b11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:14.704854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70fda538-8e16-4541-8e92-0c2890232b11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:14.705303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70fda538-8e16-4541-8e92-0c2890232b11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:14.706063 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70fda538-8e16-4541-8e92-0c2890232b11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:14.706497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-70fda538-8e16-4541-8e92-0c2890232b11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:14.834725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-70fda538-8e16-4541-8e92-0c2890232b11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:14.842776 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-70fda538-8e16-4541-8e92-0c2890232b11 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148415 May 12 07:21:14.843374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1415/2927] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:15.258340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-256aa7b3-1f7a-4dfd-a9d7-b127bfcdbc49 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:15.258968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-256aa7b3-1f7a-4dfd-a9d7-b127bfcdbc49 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:15.265603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-256aa7b3-1f7a-4dfd-a9d7-b127bfcdbc49 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:15.266055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-256aa7b3-1f7a-4dfd-a9d7-b127bfcdbc49 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:15.266823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-256aa7b3-1f7a-4dfd-a9d7-b127bfcdbc49 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:15.267263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-256aa7b3-1f7a-4dfd-a9d7-b127bfcdbc49 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:15.392217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-256aa7b3-1f7a-4dfd-a9d7-b127bfcdbc49 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:15.399581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-256aa7b3-1f7a-4dfd-a9d7-b127bfcdbc49 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1363 microversion: 2.1 time: 0.145571 May 12 07:21:15.400173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1513/2928] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:15 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:15.858926 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-793655a8-c907-43ea-82b9-261e38a9b907 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:15.859538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-793655a8-c907-43ea-82b9-261e38a9b907 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:15.865777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-793655a8-c907-43ea-82b9-261e38a9b907 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:15.866227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-793655a8-c907-43ea-82b9-261e38a9b907 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:15.867012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-793655a8-c907-43ea-82b9-261e38a9b907 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:15.867647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-793655a8-c907-43ea-82b9-261e38a9b907 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:15.997576 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-793655a8-c907-43ea-82b9-261e38a9b907 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:16.006016 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-793655a8-c907-43ea-82b9-261e38a9b907 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150892 May 12 07:21:16.006598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1416/2929] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:16.417552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8a2d41b0-57c1-4b9b-b7ea-17ab882b6789 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:16.418171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8a2d41b0-57c1-4b9b-b7ea-17ab882b6789 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:16.424887 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a2d41b0-57c1-4b9b-b7ea-17ab882b6789 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:16.425336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a2d41b0-57c1-4b9b-b7ea-17ab882b6789 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:16.426106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a2d41b0-57c1-4b9b-b7ea-17ab882b6789 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:16.426546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8a2d41b0-57c1-4b9b-b7ea-17ab882b6789 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:16.549814 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8a2d41b0-57c1-4b9b-b7ea-17ab882b6789 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:16.556982 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8a2d41b0-57c1-4b9b-b7ea-17ab882b6789 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1363 microversion: 2.1 time: 0.143856 May 12 07:21:16.557560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1514/2930] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:16 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:17.023822 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5dd80324-694f-49f0-abb4-1eae98b580cf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:17.024532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5dd80324-694f-49f0-abb4-1eae98b580cf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:17.030882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dd80324-694f-49f0-abb4-1eae98b580cf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:17.031334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dd80324-694f-49f0-abb4-1eae98b580cf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:17.032135 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dd80324-694f-49f0-abb4-1eae98b580cf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:17.032578 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dd80324-694f-49f0-abb4-1eae98b580cf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:17.158534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5dd80324-694f-49f0-abb4-1eae98b580cf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:17.166479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5dd80324-694f-49f0-abb4-1eae98b580cf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146624 May 12 07:21:17.167555 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1417/2931] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:17 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:17.574237 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d117d35c-df7f-4229-bd53-29dd998af4c9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:17.574839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d117d35c-df7f-4229-bd53-29dd998af4c9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:17.581186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d117d35c-df7f-4229-bd53-29dd998af4c9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:17.581636 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d117d35c-df7f-4229-bd53-29dd998af4c9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:17.582410 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d117d35c-df7f-4229-bd53-29dd998af4c9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:17.582848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d117d35c-df7f-4229-bd53-29dd998af4c9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:17.712141 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d117d35c-df7f-4229-bd53-29dd998af4c9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:17.719805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d117d35c-df7f-4229-bd53-29dd998af4c9 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1363 microversion: 2.1 time: 0.149550 May 12 07:21:17.720373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1515/2932] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:17 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:18.184718 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7751d095-8ef1-470d-b168-efa0b6b7eaa0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:18.185341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7751d095-8ef1-470d-b168-efa0b6b7eaa0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:18.191650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7751d095-8ef1-470d-b168-efa0b6b7eaa0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:18.192134 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7751d095-8ef1-470d-b168-efa0b6b7eaa0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:18.192901 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7751d095-8ef1-470d-b168-efa0b6b7eaa0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:18.193342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7751d095-8ef1-470d-b168-efa0b6b7eaa0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:18.319577 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7751d095-8ef1-470d-b168-efa0b6b7eaa0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:18.327934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7751d095-8ef1-470d-b168-efa0b6b7eaa0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147588 May 12 07:21:18.328507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1418/2933] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:18.736786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-247b0a33-a30e-442c-977d-388018eecd6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:18.737327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-247b0a33-a30e-442c-977d-388018eecd6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:18.743558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-247b0a33-a30e-442c-977d-388018eecd6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:18.744043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-247b0a33-a30e-442c-977d-388018eecd6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:18.744811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-247b0a33-a30e-442c-977d-388018eecd6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:18.745251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-247b0a33-a30e-442c-977d-388018eecd6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:18.873985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-247b0a33-a30e-442c-977d-388018eecd6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:18.881158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-247b0a33-a30e-442c-977d-388018eecd6a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1363 microversion: 2.1 time: 0.148361 May 12 07:21:18.881725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1516/2934] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:18 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:19.249100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-dac53626-54c8-42ea-ad3c-505fa35cad7b req-c65928e8-c7b8-4a2e-bb24-964684616535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e764fc04-6610-4900-8353-39c895a25366", "name": "network-vif-plugged", "status": "completed", "tag": "4b943e79-d5b1-480e-9146-82b63a3d9fd4"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:21:19.255481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-dac53626-54c8-42ea-ad3c-505fa35cad7b req-c65928e8-c7b8-4a2e-bb24-964684616535 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:19.255997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-dac53626-54c8-42ea-ad3c-505fa35cad7b req-c65928e8-c7b8-4a2e-bb24-964684616535 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:19.266979 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-dac53626-54c8-42ea-ad3c-505fa35cad7b req-c65928e8-c7b8-4a2e-bb24-964684616535 service nova] Creating event network-vif-plugged:4b943e79-d5b1-480e-9146-82b63a3d9fd4 for instance e764fc04-6610-4900-8353-39c895a25366 on hv-cinder-76606 May 12 07:21:19.272027 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-dac53626-54c8-42ea-ad3c-505fa35cad7b req-c65928e8-c7b8-4a2e-bb24-964684616535 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028366 May 12 07:21:19.272599 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1419/2935] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:21:19.344950 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5bba9ff4-5ca9-4642-a708-00fd11c12448 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:19.345743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5bba9ff4-5ca9-4642-a708-00fd11c12448 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:19.351749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bba9ff4-5ca9-4642-a708-00fd11c12448 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:19.352206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bba9ff4-5ca9-4642-a708-00fd11c12448 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:19.353344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bba9ff4-5ca9-4642-a708-00fd11c12448 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:19.353472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5bba9ff4-5ca9-4642-a708-00fd11c12448 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:19.482040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5bba9ff4-5ca9-4642-a708-00fd11c12448 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:19.489800 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5bba9ff4-5ca9-4642-a708-00fd11c12448 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148985 May 12 07:21:19.490372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1517/2936] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:19.898579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-521330c4-bb7a-4a52-9253-5ff616dd6f8b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:19.899198 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-521330c4-bb7a-4a52-9253-5ff616dd6f8b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:19.905250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-521330c4-bb7a-4a52-9253-5ff616dd6f8b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:19.905693 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-521330c4-bb7a-4a52-9253-5ff616dd6f8b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:19.906484 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-521330c4-bb7a-4a52-9253-5ff616dd6f8b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:19.906921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-521330c4-bb7a-4a52-9253-5ff616dd6f8b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:20.032929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-521330c4-bb7a-4a52-9253-5ff616dd6f8b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:20.040211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-521330c4-bb7a-4a52-9253-5ff616dd6f8b tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1363 microversion: 2.1 time: 0.146347 May 12 07:21:20.040791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1420/2937] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:19 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:20.507808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2c0eb9a6-ced8-42c6-9a5b-b30448ce4e67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:20.508462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2c0eb9a6-ced8-42c6-9a5b-b30448ce4e67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:20.514872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c0eb9a6-ced8-42c6-9a5b-b30448ce4e67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:20.515319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c0eb9a6-ced8-42c6-9a5b-b30448ce4e67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:20.516111 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c0eb9a6-ced8-42c6-9a5b-b30448ce4e67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:20.516546 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2c0eb9a6-ced8-42c6-9a5b-b30448ce4e67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:20.647841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2c0eb9a6-ced8-42c6-9a5b-b30448ce4e67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:20.656356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2c0eb9a6-ced8-42c6-9a5b-b30448ce4e67 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.152442 May 12 07:21:20.657260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1518/2938] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:20 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:21.057551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8fea06f7-f3a4-459c-a77b-e19ca253a66c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:21.058189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8fea06f7-f3a4-459c-a77b-e19ca253a66c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:21.064974 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fea06f7-f3a4-459c-a77b-e19ca253a66c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:21.065424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fea06f7-f3a4-459c-a77b-e19ca253a66c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:21.066183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fea06f7-f3a4-459c-a77b-e19ca253a66c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:21.066665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8fea06f7-f3a4-459c-a77b-e19ca253a66c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:21.191740 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8fea06f7-f3a4-459c-a77b-e19ca253a66c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:21.199129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8fea06f7-f3a4-459c-a77b-e19ca253a66c tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1550 microversion: 2.1 time: 0.145494 May 12 07:21:21.200349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1421/2939] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:21 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1550 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:21.215575 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-29d911ca-83e7-4037-b9f3-8be02b455205 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:21.216101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-29d911ca-83e7-4037-b9f3-8be02b455205 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:21.221860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29d911ca-83e7-4037-b9f3-8be02b455205 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:21.222316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29d911ca-83e7-4037-b9f3-8be02b455205 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:21.223087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29d911ca-83e7-4037-b9f3-8be02b455205 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:21.223526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-29d911ca-83e7-4037-b9f3-8be02b455205 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:21.300638 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-29d911ca-83e7-4037-b9f3-8be02b455205 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088845 May 12 07:21:21.301260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1519/2940] 10.222.0.25 () {58 vars in 1274 bytes} [Thu May 12 07:21:21 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:21:21.673681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9ef45446-1ea9-436b-aefc-ba5fc517ac2e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:21.674207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9ef45446-1ea9-436b-aefc-ba5fc517ac2e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:21.680068 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9ef45446-1ea9-436b-aefc-ba5fc517ac2e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:21.680520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9ef45446-1ea9-436b-aefc-ba5fc517ac2e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:21.681280 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9ef45446-1ea9-436b-aefc-ba5fc517ac2e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:21.681714 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9ef45446-1ea9-436b-aefc-ba5fc517ac2e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:21.870611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9ef45446-1ea9-436b-aefc-ba5fc517ac2e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:21.878593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9ef45446-1ea9-436b-aefc-ba5fc517ac2e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.209086 May 12 07:21:21.879680 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1422/2941] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:21 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:22.356238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-6bdb7704-8457-4443-9fc8-f39d49b47568 req-962d95b9-3523-4cb3-afba-fb61a4ec0ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e764fc04-6610-4900-8353-39c895a25366", "tag": "4b943e79-d5b1-480e-9146-82b63a3d9fd4"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:21:22.364191 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-6bdb7704-8457-4443-9fc8-f39d49b47568 req-962d95b9-3523-4cb3-afba-fb61a4ec0ff4 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:22.364645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-6bdb7704-8457-4443-9fc8-f39d49b47568 req-962d95b9-3523-4cb3-afba-fb61a4ec0ff4 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:22.375444 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-6bdb7704-8457-4443-9fc8-f39d49b47568 req-962d95b9-3523-4cb3-afba-fb61a4ec0ff4 service nova] Creating event network-changed:4b943e79-d5b1-480e-9146-82b63a3d9fd4 for instance e764fc04-6610-4900-8353-39c895a25366 on hv-cinder-76606 May 12 07:21:22.380553 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-6bdb7704-8457-4443-9fc8-f39d49b47568 req-962d95b9-3523-4cb3-afba-fb61a4ec0ff4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028436 May 12 07:21:22.381163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1520/2942] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:21:22.895874 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5e38fb1b-1e75-432b-a2b4-ee329ffd2fc6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:22.896494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5e38fb1b-1e75-432b-a2b4-ee329ffd2fc6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:22.903024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e38fb1b-1e75-432b-a2b4-ee329ffd2fc6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:22.903509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e38fb1b-1e75-432b-a2b4-ee329ffd2fc6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:22.904320 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e38fb1b-1e75-432b-a2b4-ee329ffd2fc6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:22.904763 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e38fb1b-1e75-432b-a2b4-ee329ffd2fc6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:23.047005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5e38fb1b-1e75-432b-a2b4-ee329ffd2fc6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:23.055181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5e38fb1b-1e75-432b-a2b4-ee329ffd2fc6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.163121 May 12 07:21:23.055975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1423/2943] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:24.073951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cc6eeb6c-c574-4618-8c84-cf455504827a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:24.075228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cc6eeb6c-c574-4618-8c84-cf455504827a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:24.081366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc6eeb6c-c574-4618-8c84-cf455504827a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:24.081823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc6eeb6c-c574-4618-8c84-cf455504827a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:24.082591 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc6eeb6c-c574-4618-8c84-cf455504827a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:24.083035 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cc6eeb6c-c574-4618-8c84-cf455504827a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:24.206525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cc6eeb6c-c574-4618-8c84-cf455504827a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:24.214197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cc6eeb6c-c574-4618-8c84-cf455504827a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144942 May 12 07:21:24.214765 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1521/2944] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:25.231741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c3381265-3a8a-444f-9e4a-3724a057d575 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:25.232336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c3381265-3a8a-444f-9e4a-3724a057d575 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:25.238605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3381265-3a8a-444f-9e4a-3724a057d575 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:25.239054 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3381265-3a8a-444f-9e4a-3724a057d575 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:25.239847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3381265-3a8a-444f-9e4a-3724a057d575 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:25.240282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3381265-3a8a-444f-9e4a-3724a057d575 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:25.367354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c3381265-3a8a-444f-9e4a-3724a057d575 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:25.375816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c3381265-3a8a-444f-9e4a-3724a057d575 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148448 May 12 07:21:25.376378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1424/2945] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:26.393864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-161c5b10-0ada-4922-932e-6733cd67d1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:26.394490 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-161c5b10-0ada-4922-932e-6733cd67d1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:26.400761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-161c5b10-0ada-4922-932e-6733cd67d1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:26.401208 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-161c5b10-0ada-4922-932e-6733cd67d1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:26.402005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-161c5b10-0ada-4922-932e-6733cd67d1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:26.402484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-161c5b10-0ada-4922-932e-6733cd67d1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:26.528856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-161c5b10-0ada-4922-932e-6733cd67d1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:26.536492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-161c5b10-0ada-4922-932e-6733cd67d1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146584 May 12 07:21:26.537055 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1522/2946] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:27.553636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5e456808-f3f1-40dd-941c-279e23ea740a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:27.554244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5e456808-f3f1-40dd-941c-279e23ea740a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:27.560557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e456808-f3f1-40dd-941c-279e23ea740a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:27.561004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e456808-f3f1-40dd-941c-279e23ea740a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:27.561762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e456808-f3f1-40dd-941c-279e23ea740a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:27.562195 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5e456808-f3f1-40dd-941c-279e23ea740a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:27.687518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5e456808-f3f1-40dd-941c-279e23ea740a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:27.695272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5e456808-f3f1-40dd-941c-279e23ea740a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145518 May 12 07:21:27.695871 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1425/2947] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:21:28.712927 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-daabe8ef-27e8-4b81-9515-d59e48a7f491 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:28.713458 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-daabe8ef-27e8-4b81-9515-d59e48a7f491 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:28.720271 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-daabe8ef-27e8-4b81-9515-d59e48a7f491 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:28.720730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-daabe8ef-27e8-4b81-9515-d59e48a7f491 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:28.721503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-daabe8ef-27e8-4b81-9515-d59e48a7f491 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:28.721948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-daabe8ef-27e8-4b81-9515-d59e48a7f491 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:28.849624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-daabe8ef-27e8-4b81-9515-d59e48a7f491 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:28.857745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-daabe8ef-27e8-4b81-9515-d59e48a7f491 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148771 May 12 07:21:28.858310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1523/2948] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:29.875265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c9e8b837-4916-40f1-9f90-d7838193733e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:29.875916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c9e8b837-4916-40f1-9f90-d7838193733e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:29.882204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9e8b837-4916-40f1-9f90-d7838193733e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:29.882652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9e8b837-4916-40f1-9f90-d7838193733e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:29.883415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9e8b837-4916-40f1-9f90-d7838193733e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:29.883892 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c9e8b837-4916-40f1-9f90-d7838193733e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:30.008610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c9e8b837-4916-40f1-9f90-d7838193733e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:30.016266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c9e8b837-4916-40f1-9f90-d7838193733e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145538 May 12 07:21:30.016828 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1426/2949] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:31.033747 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f7dfdcfb-8cee-4c57-b450-a2bdcc7ffa76 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:31.034358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f7dfdcfb-8cee-4c57-b450-a2bdcc7ffa76 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:31.040633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7dfdcfb-8cee-4c57-b450-a2bdcc7ffa76 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:31.041085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7dfdcfb-8cee-4c57-b450-a2bdcc7ffa76 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:31.041848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7dfdcfb-8cee-4c57-b450-a2bdcc7ffa76 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:31.042285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f7dfdcfb-8cee-4c57-b450-a2bdcc7ffa76 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:31.165898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f7dfdcfb-8cee-4c57-b450-a2bdcc7ffa76 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:31.173818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f7dfdcfb-8cee-4c57-b450-a2bdcc7ffa76 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143931 May 12 07:21:31.174381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1524/2950] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:32.190628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-46a616b2-6a22-480f-9dcb-4f792f31e5e0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:32.191241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-46a616b2-6a22-480f-9dcb-4f792f31e5e0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:32.197360 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46a616b2-6a22-480f-9dcb-4f792f31e5e0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:32.197807 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46a616b2-6a22-480f-9dcb-4f792f31e5e0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:32.198572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46a616b2-6a22-480f-9dcb-4f792f31e5e0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:32.199007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-46a616b2-6a22-480f-9dcb-4f792f31e5e0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:32.324085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-46a616b2-6a22-480f-9dcb-4f792f31e5e0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:32.331795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-46a616b2-6a22-480f-9dcb-4f792f31e5e0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145081 May 12 07:21:32.332359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1427/2951] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:33.349534 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b602b9b4-77bf-43fb-938b-93d31094f230 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:33.350071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b602b9b4-77bf-43fb-938b-93d31094f230 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:33.356603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b602b9b4-77bf-43fb-938b-93d31094f230 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:33.357037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b602b9b4-77bf-43fb-938b-93d31094f230 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:33.357811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b602b9b4-77bf-43fb-938b-93d31094f230 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:33.358256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b602b9b4-77bf-43fb-938b-93d31094f230 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:33.483793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b602b9b4-77bf-43fb-938b-93d31094f230 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:33.491456 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b602b9b4-77bf-43fb-938b-93d31094f230 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145979 May 12 07:21:33.492051 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1525/2952] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:33 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:34.508028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-79fc1fd2-0eef-41cf-beeb-20a18f61985f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:34.508668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-79fc1fd2-0eef-41cf-beeb-20a18f61985f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:34.514895 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79fc1fd2-0eef-41cf-beeb-20a18f61985f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:34.522333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79fc1fd2-0eef-41cf-beeb-20a18f61985f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:34.522333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79fc1fd2-0eef-41cf-beeb-20a18f61985f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:34.522333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-79fc1fd2-0eef-41cf-beeb-20a18f61985f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:34.643888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-79fc1fd2-0eef-41cf-beeb-20a18f61985f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:34.651537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-79fc1fd2-0eef-41cf-beeb-20a18f61985f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147351 May 12 07:21:34.652842 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1428/2953] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:35.670129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e56b1584-0e51-4f5d-8ec0-a9f23289a939 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:35.670926 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e56b1584-0e51-4f5d-8ec0-a9f23289a939 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:35.677189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e56b1584-0e51-4f5d-8ec0-a9f23289a939 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:35.677646 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e56b1584-0e51-4f5d-8ec0-a9f23289a939 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:35.678419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e56b1584-0e51-4f5d-8ec0-a9f23289a939 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:35.678859 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e56b1584-0e51-4f5d-8ec0-a9f23289a939 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:35.801062 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e56b1584-0e51-4f5d-8ec0-a9f23289a939 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:35.809414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e56b1584-0e51-4f5d-8ec0-a9f23289a939 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143744 May 12 07:21:35.809980 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1526/2954] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:35 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:36.826285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-493b24fe-740f-455d-ab03-b9c133a577e7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:36.826873 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-493b24fe-740f-455d-ab03-b9c133a577e7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:36.833169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-493b24fe-740f-455d-ab03-b9c133a577e7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:36.833615 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-493b24fe-740f-455d-ab03-b9c133a577e7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:36.834367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-493b24fe-740f-455d-ab03-b9c133a577e7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:36.834801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-493b24fe-740f-455d-ab03-b9c133a577e7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:36.963838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-493b24fe-740f-455d-ab03-b9c133a577e7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:36.972129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-493b24fe-740f-455d-ab03-b9c133a577e7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149636 May 12 07:21:36.979503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1429/2955] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:37.989790 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-55a7006d-bd8e-4ca2-8565-c002d7dfb034 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:37.990397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-55a7006d-bd8e-4ca2-8565-c002d7dfb034 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:37.997352 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55a7006d-bd8e-4ca2-8565-c002d7dfb034 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:37.997802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55a7006d-bd8e-4ca2-8565-c002d7dfb034 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:37.998563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55a7006d-bd8e-4ca2-8565-c002d7dfb034 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:37.998997 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-55a7006d-bd8e-4ca2-8565-c002d7dfb034 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:38.122473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-55a7006d-bd8e-4ca2-8565-c002d7dfb034 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:38.130085 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-55a7006d-bd8e-4ca2-8565-c002d7dfb034 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144195 May 12 07:21:38.130652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1527/2956] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:39.146860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-eae083d2-6849-4fde-bea0-55f4d0e381d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:39.147467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-eae083d2-6849-4fde-bea0-55f4d0e381d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:39.154290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eae083d2-6849-4fde-bea0-55f4d0e381d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:39.154735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eae083d2-6849-4fde-bea0-55f4d0e381d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:39.155491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eae083d2-6849-4fde-bea0-55f4d0e381d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:39.155955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eae083d2-6849-4fde-bea0-55f4d0e381d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:39.279278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eae083d2-6849-4fde-bea0-55f4d0e381d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:39.287042 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-eae083d2-6849-4fde-bea0-55f4d0e381d9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144030 May 12 07:21:39.287616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1430/2957] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:40.304933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d2ee7ffc-95b3-4f32-9168-950c906af380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:40.305552 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d2ee7ffc-95b3-4f32-9168-950c906af380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:40.312478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2ee7ffc-95b3-4f32-9168-950c906af380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:40.312930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2ee7ffc-95b3-4f32-9168-950c906af380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:40.313704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2ee7ffc-95b3-4f32-9168-950c906af380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:40.314147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2ee7ffc-95b3-4f32-9168-950c906af380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:40.444940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d2ee7ffc-95b3-4f32-9168-950c906af380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:40.452847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d2ee7ffc-95b3-4f32-9168-950c906af380 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.151838 May 12 07:21:40.453459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1528/2958] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:40 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:41.470072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1c9ea33b-2965-4068-8817-746595eee4ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:41.470692 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1c9ea33b-2965-4068-8817-746595eee4ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:41.477255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c9ea33b-2965-4068-8817-746595eee4ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:41.477714 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c9ea33b-2965-4068-8817-746595eee4ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:41.478487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c9ea33b-2965-4068-8817-746595eee4ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:41.478931 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1c9ea33b-2965-4068-8817-746595eee4ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:41.603290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1c9ea33b-2965-4068-8817-746595eee4ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:41.611711 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1c9ea33b-2965-4068-8817-746595eee4ab tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145488 May 12 07:21:41.612262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1431/2959] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:41 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:42.628671 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2e170226-7b99-414e-8abd-9c82ed3882f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:42.629305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2e170226-7b99-414e-8abd-9c82ed3882f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:42.635515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e170226-7b99-414e-8abd-9c82ed3882f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:42.635991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e170226-7b99-414e-8abd-9c82ed3882f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:42.636749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e170226-7b99-414e-8abd-9c82ed3882f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:42.637184 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2e170226-7b99-414e-8abd-9c82ed3882f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:42.762786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2e170226-7b99-414e-8abd-9c82ed3882f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:42.770453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2e170226-7b99-414e-8abd-9c82ed3882f4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145617 May 12 07:21:42.771018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1529/2960] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:42 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:43.788185 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5b12fd64-9fab-43eb-a3f8-e5507d954d49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:43.788802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5b12fd64-9fab-43eb-a3f8-e5507d954d49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:43.795960 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b12fd64-9fab-43eb-a3f8-e5507d954d49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:43.796413 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b12fd64-9fab-43eb-a3f8-e5507d954d49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:43.797181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b12fd64-9fab-43eb-a3f8-e5507d954d49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:43.797619 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5b12fd64-9fab-43eb-a3f8-e5507d954d49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:43.922442 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5b12fd64-9fab-43eb-a3f8-e5507d954d49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:43.930212 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5b12fd64-9fab-43eb-a3f8-e5507d954d49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145865 May 12 07:21:43.930789 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1432/2961] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:44.947931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1163f541-649a-4377-8de4-2549ed62575b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:44.948545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1163f541-649a-4377-8de4-2549ed62575b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:44.955451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1163f541-649a-4377-8de4-2549ed62575b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:44.955949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1163f541-649a-4377-8de4-2549ed62575b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:44.956724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1163f541-649a-4377-8de4-2549ed62575b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:44.957165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1163f541-649a-4377-8de4-2549ed62575b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:45.080678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1163f541-649a-4377-8de4-2549ed62575b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:45.088484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1163f541-649a-4377-8de4-2549ed62575b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144447 May 12 07:21:45.089052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1530/2962] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:46.105503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-84df1363-3839-4f4c-84a4-8dc3f64e878a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:46.106141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-84df1363-3839-4f4c-84a4-8dc3f64e878a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:46.112520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84df1363-3839-4f4c-84a4-8dc3f64e878a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:46.116019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84df1363-3839-4f4c-84a4-8dc3f64e878a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:46.116019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84df1363-3839-4f4c-84a4-8dc3f64e878a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:46.116019 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-84df1363-3839-4f4c-84a4-8dc3f64e878a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:46.242100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-84df1363-3839-4f4c-84a4-8dc3f64e878a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:46.249900 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-84df1363-3839-4f4c-84a4-8dc3f64e878a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148221 May 12 07:21:46.250412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1433/2963] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:46 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:47.266737 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-40931549-8300-464e-ad15-9619c048b1da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:47.267255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-40931549-8300-464e-ad15-9619c048b1da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:47.273605 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-40931549-8300-464e-ad15-9619c048b1da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:47.274063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-40931549-8300-464e-ad15-9619c048b1da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:47.274838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-40931549-8300-464e-ad15-9619c048b1da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:47.275289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-40931549-8300-464e-ad15-9619c048b1da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:47.399287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-40931549-8300-464e-ad15-9619c048b1da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:47.407582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-40931549-8300-464e-ad15-9619c048b1da tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144781 May 12 07:21:47.408172 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1531/2964] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:48.425339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-09809d53-bcd5-4662-8654-240bcf468b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:48.425904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-09809d53-bcd5-4662-8654-240bcf468b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:48.432202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09809d53-bcd5-4662-8654-240bcf468b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:48.432650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09809d53-bcd5-4662-8654-240bcf468b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:48.433411 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09809d53-bcd5-4662-8654-240bcf468b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:48.434449 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09809d53-bcd5-4662-8654-240bcf468b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:48.560267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-09809d53-bcd5-4662-8654-240bcf468b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:48.567947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-09809d53-bcd5-4662-8654-240bcf468b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146571 May 12 07:21:48.568516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1434/2965] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:48 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:49.584816 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-740cb0f1-41c2-4cce-acaf-3ca6382a3a13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:49.585440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-740cb0f1-41c2-4cce-acaf-3ca6382a3a13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:49.591715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-740cb0f1-41c2-4cce-acaf-3ca6382a3a13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:49.592186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-740cb0f1-41c2-4cce-acaf-3ca6382a3a13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:49.592958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-740cb0f1-41c2-4cce-acaf-3ca6382a3a13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:49.593402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-740cb0f1-41c2-4cce-acaf-3ca6382a3a13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:49.717872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-740cb0f1-41c2-4cce-acaf-3ca6382a3a13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:49.725556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-740cb0f1-41c2-4cce-acaf-3ca6382a3a13 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144633 May 12 07:21:49.726123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1532/2966] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:49 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:50.742474 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-acb329df-e29a-45bf-ae1e-0d7e1a66eeb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:50.743147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-acb329df-e29a-45bf-ae1e-0d7e1a66eeb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:50.749506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-acb329df-e29a-45bf-ae1e-0d7e1a66eeb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:50.749962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-acb329df-e29a-45bf-ae1e-0d7e1a66eeb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:50.750732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-acb329df-e29a-45bf-ae1e-0d7e1a66eeb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:50.751173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-acb329df-e29a-45bf-ae1e-0d7e1a66eeb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:50.882245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-acb329df-e29a-45bf-ae1e-0d7e1a66eeb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:50.890600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-acb329df-e29a-45bf-ae1e-0d7e1a66eeb7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.151965 May 12 07:21:50.891157 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1435/2967] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:51.908059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-874c8354-ce39-4d69-bdbd-d7e7eb310707 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:51.908689 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-874c8354-ce39-4d69-bdbd-d7e7eb310707 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:51.914723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-874c8354-ce39-4d69-bdbd-d7e7eb310707 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:51.918067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-874c8354-ce39-4d69-bdbd-d7e7eb310707 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:51.918067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-874c8354-ce39-4d69-bdbd-d7e7eb310707 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:51.918067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-874c8354-ce39-4d69-bdbd-d7e7eb310707 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:52.041543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-874c8354-ce39-4d69-bdbd-d7e7eb310707 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:52.049480 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-874c8354-ce39-4d69-bdbd-d7e7eb310707 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145474 May 12 07:21:52.050047 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1533/2968] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:53.066551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-551eaacb-9a94-471e-9a6b-66d13ba2a009 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:53.067186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-551eaacb-9a94-471e-9a6b-66d13ba2a009 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:53.073843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-551eaacb-9a94-471e-9a6b-66d13ba2a009 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:53.074292 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-551eaacb-9a94-471e-9a6b-66d13ba2a009 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:53.075062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-551eaacb-9a94-471e-9a6b-66d13ba2a009 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:53.075497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-551eaacb-9a94-471e-9a6b-66d13ba2a009 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:53.197470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-551eaacb-9a94-471e-9a6b-66d13ba2a009 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:53.205217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-551eaacb-9a94-471e-9a6b-66d13ba2a009 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.142847 May 12 07:21:53.205788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1436/2969] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:54.221876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5d6f5bb2-ed2a-40cb-9d87-3f1696dfb10d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:54.222513 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5d6f5bb2-ed2a-40cb-9d87-3f1696dfb10d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:54.228805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d6f5bb2-ed2a-40cb-9d87-3f1696dfb10d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:54.229261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d6f5bb2-ed2a-40cb-9d87-3f1696dfb10d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:54.230030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d6f5bb2-ed2a-40cb-9d87-3f1696dfb10d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:54.230466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5d6f5bb2-ed2a-40cb-9d87-3f1696dfb10d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:54.358007 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5d6f5bb2-ed2a-40cb-9d87-3f1696dfb10d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:54.365693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5d6f5bb2-ed2a-40cb-9d87-3f1696dfb10d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147660 May 12 07:21:54.366374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1534/2970] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:55.382276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fdfaf5fb-3e5a-4aa5-b59d-f9e989881300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:55.382887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fdfaf5fb-3e5a-4aa5-b59d-f9e989881300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:55.389501 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdfaf5fb-3e5a-4aa5-b59d-f9e989881300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:55.389944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdfaf5fb-3e5a-4aa5-b59d-f9e989881300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:55.390707 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdfaf5fb-3e5a-4aa5-b59d-f9e989881300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:55.391141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fdfaf5fb-3e5a-4aa5-b59d-f9e989881300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:55.513533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fdfaf5fb-3e5a-4aa5-b59d-f9e989881300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:55.521363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fdfaf5fb-3e5a-4aa5-b59d-f9e989881300 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.142960 May 12 07:21:55.521927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1437/2971] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:55 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:56.538977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-59978152-c4b9-4b46-a32a-7d3ced8107ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:56.539601 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-59978152-c4b9-4b46-a32a-7d3ced8107ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:56.546720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59978152-c4b9-4b46-a32a-7d3ced8107ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:56.547176 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59978152-c4b9-4b46-a32a-7d3ced8107ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:56.547974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59978152-c4b9-4b46-a32a-7d3ced8107ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:56.548421 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-59978152-c4b9-4b46-a32a-7d3ced8107ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:56.598903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:21:56.599474 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:21:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:21:56.674563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-59978152-c4b9-4b46-a32a-7d3ced8107ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:56.682383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-59978152-c4b9-4b46-a32a-7d3ced8107ea tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147275 May 12 07:21:56.682958 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1535/2972] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:57.182282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2c7a1e08-73b5-4645-99d7-e5f839b8dbd3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:57.182782 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2c7a1e08-73b5-4645-99d7-e5f839b8dbd3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:57.189227 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c7a1e08-73b5-4645-99d7-e5f839b8dbd3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:57.189676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c7a1e08-73b5-4645-99d7-e5f839b8dbd3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:57.190441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c7a1e08-73b5-4645-99d7-e5f839b8dbd3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:57.190876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2c7a1e08-73b5-4645-99d7-e5f839b8dbd3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:57.213365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2c7a1e08-73b5-4645-99d7-e5f839b8dbd3 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366/ips" status: 200 len: 146 microversion: 2.1 time: 0.034898 May 12 07:21:57.213914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1438/2973] 10.222.0.25 () {58 vars in 1247 bytes} [Thu May 12 07:21:57 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:21:57.700505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-25b49223-ebf8-4d2a-a5c2-b4e7d7501b38 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:57.701120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-25b49223-ebf8-4d2a-a5c2-b4e7d7501b38 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:57.707804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25b49223-ebf8-4d2a-a5c2-b4e7d7501b38 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:57.708261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25b49223-ebf8-4d2a-a5c2-b4e7d7501b38 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:57.709030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25b49223-ebf8-4d2a-a5c2-b4e7d7501b38 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:57.709471 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-25b49223-ebf8-4d2a-a5c2-b4e7d7501b38 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:57.833761 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-25b49223-ebf8-4d2a-a5c2-b4e7d7501b38 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:57.841571 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-25b49223-ebf8-4d2a-a5c2-b4e7d7501b38 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145551 May 12 07:21:57.842145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1536/2974] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:21:58.858167 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-df3555c2-9fbe-4b69-b0c7-6bc9ab512677 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:21:58.858790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-df3555c2-9fbe-4b69-b0c7-6bc9ab512677 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:21:58.865126 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-df3555c2-9fbe-4b69-b0c7-6bc9ab512677 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:58.865604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-df3555c2-9fbe-4b69-b0c7-6bc9ab512677 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:58.866372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-df3555c2-9fbe-4b69-b0c7-6bc9ab512677 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:21:58.866814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-df3555c2-9fbe-4b69-b0c7-6bc9ab512677 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:21:58.991171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-df3555c2-9fbe-4b69-b0c7-6bc9ab512677 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:21:58.999022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-df3555c2-9fbe-4b69-b0c7-6bc9ab512677 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144921 May 12 07:21:58.999585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1439/2975] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:21:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:00.016002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4da92e1a-a4df-49f0-aa6b-838a56782e2d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:00.016627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4da92e1a-a4df-49f0-aa6b-838a56782e2d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:00.022885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4da92e1a-a4df-49f0-aa6b-838a56782e2d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:00.023336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4da92e1a-a4df-49f0-aa6b-838a56782e2d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:00.024124 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4da92e1a-a4df-49f0-aa6b-838a56782e2d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:00.024557 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4da92e1a-a4df-49f0-aa6b-838a56782e2d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:00.150443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4da92e1a-a4df-49f0-aa6b-838a56782e2d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:00.158631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4da92e1a-a4df-49f0-aa6b-838a56782e2d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146527 May 12 07:22:00.159197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1537/2976] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:01.177241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-40b56755-96f9-4528-8e62-88bdabec502c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:01.177862 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-40b56755-96f9-4528-8e62-88bdabec502c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:01.184453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40b56755-96f9-4528-8e62-88bdabec502c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:01.184906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40b56755-96f9-4528-8e62-88bdabec502c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:01.185671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40b56755-96f9-4528-8e62-88bdabec502c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:01.186112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40b56755-96f9-4528-8e62-88bdabec502c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:01.310014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-40b56755-96f9-4528-8e62-88bdabec502c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:01.317739 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-40b56755-96f9-4528-8e62-88bdabec502c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144557 May 12 07:22:01.318306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1440/2977] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:02.333974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3854d9c9-5e99-4caa-b15f-fd9b4b8bf510 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:02.334505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3854d9c9-5e99-4caa-b15f-fd9b4b8bf510 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:02.340866 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3854d9c9-5e99-4caa-b15f-fd9b4b8bf510 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:02.341321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3854d9c9-5e99-4caa-b15f-fd9b4b8bf510 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:02.342117 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3854d9c9-5e99-4caa-b15f-fd9b4b8bf510 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:02.342558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3854d9c9-5e99-4caa-b15f-fd9b4b8bf510 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:02.469105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3854d9c9-5e99-4caa-b15f-fd9b4b8bf510 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:02.476840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3854d9c9-5e99-4caa-b15f-fd9b4b8bf510 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146815 May 12 07:22:02.477408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1538/2978] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:03.493893 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-54ed004e-43d7-4e24-a30c-58eb4d4a654d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:03.494530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-54ed004e-43d7-4e24-a30c-58eb4d4a654d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:03.500893 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54ed004e-43d7-4e24-a30c-58eb4d4a654d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:03.501344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54ed004e-43d7-4e24-a30c-58eb4d4a654d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:03.502101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54ed004e-43d7-4e24-a30c-58eb4d4a654d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:03.502534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-54ed004e-43d7-4e24-a30c-58eb4d4a654d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:03.631376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-54ed004e-43d7-4e24-a30c-58eb4d4a654d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:03.637471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-54ed004e-43d7-4e24-a30c-58eb4d4a654d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147421 May 12 07:22:03.638027 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1441/2979] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:04.654874 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3a6519b1-2803-4b9b-bd2b-317e2cc1ccae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:04.655495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3a6519b1-2803-4b9b-bd2b-317e2cc1ccae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:04.662026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a6519b1-2803-4b9b-bd2b-317e2cc1ccae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:04.662504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a6519b1-2803-4b9b-bd2b-317e2cc1ccae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:04.663285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a6519b1-2803-4b9b-bd2b-317e2cc1ccae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:04.663757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a6519b1-2803-4b9b-bd2b-317e2cc1ccae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:04.796624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3a6519b1-2803-4b9b-bd2b-317e2cc1ccae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:04.804603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3a6519b1-2803-4b9b-bd2b-317e2cc1ccae tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.154226 May 12 07:22:04.805193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1539/2980] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:05.821647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-232a9b63-2fd9-452e-8291-f09204b493d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:05.822269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-232a9b63-2fd9-452e-8291-f09204b493d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:05.828668 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-232a9b63-2fd9-452e-8291-f09204b493d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:05.829122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-232a9b63-2fd9-452e-8291-f09204b493d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:05.829927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-232a9b63-2fd9-452e-8291-f09204b493d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:05.830400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-232a9b63-2fd9-452e-8291-f09204b493d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:05.952868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-232a9b63-2fd9-452e-8291-f09204b493d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:05.960788 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-232a9b63-2fd9-452e-8291-f09204b493d4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.142999 May 12 07:22:05.961407 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1442/2981] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:06.978305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-46c2ca9a-575e-47d1-87b1-8c1f28986bf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:06.982146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-46c2ca9a-575e-47d1-87b1-8c1f28986bf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:06.985590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46c2ca9a-575e-47d1-87b1-8c1f28986bf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:06.986041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46c2ca9a-575e-47d1-87b1-8c1f28986bf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:06.986812 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46c2ca9a-575e-47d1-87b1-8c1f28986bf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:06.987250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-46c2ca9a-575e-47d1-87b1-8c1f28986bf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:07.111708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-46c2ca9a-575e-47d1-87b1-8c1f28986bf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:07.119359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-46c2ca9a-575e-47d1-87b1-8c1f28986bf2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144967 May 12 07:22:07.120114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1540/2982] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:08.137582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-739b6fd0-d2f2-4eb3-bc81-747d33c51050 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:08.138200 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-739b6fd0-d2f2-4eb3-bc81-747d33c51050 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:08.144730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-739b6fd0-d2f2-4eb3-bc81-747d33c51050 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:08.145179 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-739b6fd0-d2f2-4eb3-bc81-747d33c51050 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:08.145940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-739b6fd0-d2f2-4eb3-bc81-747d33c51050 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:08.146487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-739b6fd0-d2f2-4eb3-bc81-747d33c51050 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:08.520133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-739b6fd0-d2f2-4eb3-bc81-747d33c51050 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:08.527943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-739b6fd0-d2f2-4eb3-bc81-747d33c51050 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.394736 May 12 07:22:08.528505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1443/2983] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:09.545716 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0313f57f-b1c6-41ed-96af-f5cbd3786260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:09.546331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0313f57f-b1c6-41ed-96af-f5cbd3786260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:09.552760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0313f57f-b1c6-41ed-96af-f5cbd3786260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:09.553216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0313f57f-b1c6-41ed-96af-f5cbd3786260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:09.553989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0313f57f-b1c6-41ed-96af-f5cbd3786260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:09.554430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0313f57f-b1c6-41ed-96af-f5cbd3786260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:09.680801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0313f57f-b1c6-41ed-96af-f5cbd3786260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:09.689148 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0313f57f-b1c6-41ed-96af-f5cbd3786260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147582 May 12 07:22:09.689714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1541/2984] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:10.706639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-190c0390-a19c-4047-8b31-621b2b20615e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:10.707188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-190c0390-a19c-4047-8b31-621b2b20615e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:10.713940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-190c0390-a19c-4047-8b31-621b2b20615e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:10.714891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-190c0390-a19c-4047-8b31-621b2b20615e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:10.715712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-190c0390-a19c-4047-8b31-621b2b20615e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:10.716143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-190c0390-a19c-4047-8b31-621b2b20615e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:10.849622 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-190c0390-a19c-4047-8b31-621b2b20615e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:10.857701 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-190c0390-a19c-4047-8b31-621b2b20615e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.155031 May 12 07:22:10.858287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1444/2985] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:11.874978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fa67cd3a-2d9f-4ace-b7d1-3249e488aedb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:11.875582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fa67cd3a-2d9f-4ace-b7d1-3249e488aedb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:11.881885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa67cd3a-2d9f-4ace-b7d1-3249e488aedb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:11.882331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa67cd3a-2d9f-4ace-b7d1-3249e488aedb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:11.883093 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa67cd3a-2d9f-4ace-b7d1-3249e488aedb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:11.883529 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fa67cd3a-2d9f-4ace-b7d1-3249e488aedb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:12.009507 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fa67cd3a-2d9f-4ace-b7d1-3249e488aedb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:12.017703 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fa67cd3a-2d9f-4ace-b7d1-3249e488aedb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147257 May 12 07:22:12.024947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1542/2986] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:13.035447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-96719d11-0f6b-4b8c-9f7d-751993ffb688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:13.036086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-96719d11-0f6b-4b8c-9f7d-751993ffb688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:13.042848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96719d11-0f6b-4b8c-9f7d-751993ffb688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:13.043294 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96719d11-0f6b-4b8c-9f7d-751993ffb688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:13.044071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96719d11-0f6b-4b8c-9f7d-751993ffb688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:13.044505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-96719d11-0f6b-4b8c-9f7d-751993ffb688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:13.170073 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-96719d11-0f6b-4b8c-9f7d-751993ffb688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:13.178025 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-96719d11-0f6b-4b8c-9f7d-751993ffb688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146460 May 12 07:22:13.178587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1445/2987] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:14.195029 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2be5bc22-e0f3-452b-a730-c8b779c7a763 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:14.195637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2be5bc22-e0f3-452b-a730-c8b779c7a763 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:14.202505 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2be5bc22-e0f3-452b-a730-c8b779c7a763 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:14.202956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2be5bc22-e0f3-452b-a730-c8b779c7a763 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:14.203741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2be5bc22-e0f3-452b-a730-c8b779c7a763 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:14.204181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2be5bc22-e0f3-452b-a730-c8b779c7a763 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:14.326873 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2be5bc22-e0f3-452b-a730-c8b779c7a763 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:14.334539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2be5bc22-e0f3-452b-a730-c8b779c7a763 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143335 May 12 07:22:14.335100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1543/2988] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:15.351628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-85124e9f-eb9e-413d-9971-bbd8d667f2c2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:15.352270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-85124e9f-eb9e-413d-9971-bbd8d667f2c2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:15.358641 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85124e9f-eb9e-413d-9971-bbd8d667f2c2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:15.359094 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85124e9f-eb9e-413d-9971-bbd8d667f2c2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:15.359925 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85124e9f-eb9e-413d-9971-bbd8d667f2c2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:15.360367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85124e9f-eb9e-413d-9971-bbd8d667f2c2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:15.486663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-85124e9f-eb9e-413d-9971-bbd8d667f2c2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:15.494453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-85124e9f-eb9e-413d-9971-bbd8d667f2c2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146766 May 12 07:22:15.495024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1446/2989] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:16.511381 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5f6c9d02-e45a-4d4c-9b33-7ae9ff0aa661 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:16.512012 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5f6c9d02-e45a-4d4c-9b33-7ae9ff0aa661 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:16.518461 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5f6c9d02-e45a-4d4c-9b33-7ae9ff0aa661 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:16.518909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5f6c9d02-e45a-4d4c-9b33-7ae9ff0aa661 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:16.519670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5f6c9d02-e45a-4d4c-9b33-7ae9ff0aa661 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:16.520251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5f6c9d02-e45a-4d4c-9b33-7ae9ff0aa661 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:16.645993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5f6c9d02-e45a-4d4c-9b33-7ae9ff0aa661 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:16.654500 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5f6c9d02-e45a-4d4c-9b33-7ae9ff0aa661 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147040 May 12 07:22:16.655068 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1544/2990] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:17.672868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-50d90642-c807-4468-8038-f8c39984e463 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:17.673439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-50d90642-c807-4468-8038-f8c39984e463 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:17.679764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50d90642-c807-4468-8038-f8c39984e463 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:17.680219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50d90642-c807-4468-8038-f8c39984e463 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:17.680986 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50d90642-c807-4468-8038-f8c39984e463 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:17.681428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-50d90642-c807-4468-8038-f8c39984e463 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:17.804697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-50d90642-c807-4468-8038-f8c39984e463 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:17.813071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-50d90642-c807-4468-8038-f8c39984e463 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144959 May 12 07:22:17.813640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1447/2991] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:17 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:22:18.830290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8aa96dd2-5c84-40a2-a4f6-7b72022a0345 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:18.830916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8aa96dd2-5c84-40a2-a4f6-7b72022a0345 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:18.837189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8aa96dd2-5c84-40a2-a4f6-7b72022a0345 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:18.837640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8aa96dd2-5c84-40a2-a4f6-7b72022a0345 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:18.838414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8aa96dd2-5c84-40a2-a4f6-7b72022a0345 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:18.838851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8aa96dd2-5c84-40a2-a4f6-7b72022a0345 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:18.970344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8aa96dd2-5c84-40a2-a4f6-7b72022a0345 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:18.978219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8aa96dd2-5c84-40a2-a4f6-7b72022a0345 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.151778 May 12 07:22:18.978792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1545/2992] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:19.994666 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-514f15a6-2c28-4bb2-ac4b-3d5cc455da95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:19.995286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-514f15a6-2c28-4bb2-ac4b-3d5cc455da95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:20.001689 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-514f15a6-2c28-4bb2-ac4b-3d5cc455da95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:20.002141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-514f15a6-2c28-4bb2-ac4b-3d5cc455da95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:20.002907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-514f15a6-2c28-4bb2-ac4b-3d5cc455da95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:20.003347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-514f15a6-2c28-4bb2-ac4b-3d5cc455da95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:20.128887 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-514f15a6-2c28-4bb2-ac4b-3d5cc455da95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:20.137398 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-514f15a6-2c28-4bb2-ac4b-3d5cc455da95 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146003 May 12 07:22:20.137964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1448/2993] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:21.154798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-32cd17e3-dc01-4412-b463-7ffce081554a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:21.155402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-32cd17e3-dc01-4412-b463-7ffce081554a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:21.161648 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-32cd17e3-dc01-4412-b463-7ffce081554a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:21.162096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-32cd17e3-dc01-4412-b463-7ffce081554a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:21.162857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-32cd17e3-dc01-4412-b463-7ffce081554a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:21.163293 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-32cd17e3-dc01-4412-b463-7ffce081554a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:21.286807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-32cd17e3-dc01-4412-b463-7ffce081554a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:21.294534 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-32cd17e3-dc01-4412-b463-7ffce081554a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144112 May 12 07:22:21.295343 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1546/2994] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:21 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:22.312626 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-21534ac0-037e-4133-8e7a-98350bf64688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:22.313194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-21534ac0-037e-4133-8e7a-98350bf64688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:22.319482 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21534ac0-037e-4133-8e7a-98350bf64688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:22.319962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21534ac0-037e-4133-8e7a-98350bf64688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:22.320733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21534ac0-037e-4133-8e7a-98350bf64688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:22.321171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-21534ac0-037e-4133-8e7a-98350bf64688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:22.447735 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-21534ac0-037e-4133-8e7a-98350bf64688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:22.455450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-21534ac0-037e-4133-8e7a-98350bf64688 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147453 May 12 07:22:22.456050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1449/2995] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:23.473071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f847b339-15d2-4b31-9d70-bf60d21589d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:23.473684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f847b339-15d2-4b31-9d70-bf60d21589d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:23.479785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f847b339-15d2-4b31-9d70-bf60d21589d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:23.480394 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f847b339-15d2-4b31-9d70-bf60d21589d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:23.481192 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f847b339-15d2-4b31-9d70-bf60d21589d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:23.481633 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f847b339-15d2-4b31-9d70-bf60d21589d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:23.647406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f847b339-15d2-4b31-9d70-bf60d21589d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:23.655124 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f847b339-15d2-4b31-9d70-bf60d21589d8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.186081 May 12 07:22:23.655711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1547/2996] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:24.671710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-76d8b139-e786-4f7c-a55a-b2a7d98610de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:24.672347 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-76d8b139-e786-4f7c-a55a-b2a7d98610de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:24.678632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76d8b139-e786-4f7c-a55a-b2a7d98610de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:24.679090 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76d8b139-e786-4f7c-a55a-b2a7d98610de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:24.680007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76d8b139-e786-4f7c-a55a-b2a7d98610de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:24.680450 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76d8b139-e786-4f7c-a55a-b2a7d98610de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:24.851970 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-76d8b139-e786-4f7c-a55a-b2a7d98610de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:24.859750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-76d8b139-e786-4f7c-a55a-b2a7d98610de tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.192136 May 12 07:22:24.860321 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1450/2997] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:25.876900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d2b188da-9ff2-457d-aedf-85c9e963309f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:25.877516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d2b188da-9ff2-457d-aedf-85c9e963309f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:25.883791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2b188da-9ff2-457d-aedf-85c9e963309f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:25.884247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2b188da-9ff2-457d-aedf-85c9e963309f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:25.885022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2b188da-9ff2-457d-aedf-85c9e963309f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:25.885463 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d2b188da-9ff2-457d-aedf-85c9e963309f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:26.010527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d2b188da-9ff2-457d-aedf-85c9e963309f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:26.018869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d2b188da-9ff2-457d-aedf-85c9e963309f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145857 May 12 07:22:26.024362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1548/2998] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:27.040086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-372d491b-48a1-4a4c-b41c-d5987600913c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:27.040705 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-372d491b-48a1-4a4c-b41c-d5987600913c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:27.047334 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-372d491b-48a1-4a4c-b41c-d5987600913c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:27.047816 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-372d491b-48a1-4a4c-b41c-d5987600913c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:27.048590 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-372d491b-48a1-4a4c-b41c-d5987600913c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:27.049040 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-372d491b-48a1-4a4c-b41c-d5987600913c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:27.178874 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-372d491b-48a1-4a4c-b41c-d5987600913c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:27.187149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-372d491b-48a1-4a4c-b41c-d5987600913c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150944 May 12 07:22:27.187731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1451/2999] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:28.204652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c849c82f-a0ae-4b17-adc4-2ed0d09c9395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:28.205269 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c849c82f-a0ae-4b17-adc4-2ed0d09c9395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:28.211480 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c849c82f-a0ae-4b17-adc4-2ed0d09c9395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:28.211949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c849c82f-a0ae-4b17-adc4-2ed0d09c9395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:28.212728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c849c82f-a0ae-4b17-adc4-2ed0d09c9395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:28.213171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c849c82f-a0ae-4b17-adc4-2ed0d09c9395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:28.338688 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c849c82f-a0ae-4b17-adc4-2ed0d09c9395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:28.346993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c849c82f-a0ae-4b17-adc4-2ed0d09c9395 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146233 May 12 07:22:28.347565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1549/3000] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:29.365059 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5dbd49c2-22ea-461a-9e6c-98b66ee9dbbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:29.365634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5dbd49c2-22ea-461a-9e6c-98b66ee9dbbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:29.372459 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dbd49c2-22ea-461a-9e6c-98b66ee9dbbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:29.372916 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dbd49c2-22ea-461a-9e6c-98b66ee9dbbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:29.373679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dbd49c2-22ea-461a-9e6c-98b66ee9dbbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:29.374117 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dbd49c2-22ea-461a-9e6c-98b66ee9dbbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:29.500424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5dbd49c2-22ea-461a-9e6c-98b66ee9dbbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:29.508110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5dbd49c2-22ea-461a-9e6c-98b66ee9dbbe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147005 May 12 07:22:29.508669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1452/3001] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:30.525018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dc3ec5a3-362e-4bd8-b32d-7e240577f586 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:30.525609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dc3ec5a3-362e-4bd8-b32d-7e240577f586 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:30.532476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc3ec5a3-362e-4bd8-b32d-7e240577f586 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:30.532923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc3ec5a3-362e-4bd8-b32d-7e240577f586 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:30.533952 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc3ec5a3-362e-4bd8-b32d-7e240577f586 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:30.534390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dc3ec5a3-362e-4bd8-b32d-7e240577f586 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:30.661488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dc3ec5a3-362e-4bd8-b32d-7e240577f586 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:30.669127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dc3ec5a3-362e-4bd8-b32d-7e240577f586 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148012 May 12 07:22:30.669682 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1550/3002] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:31.687057 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-07916056-0dfd-4fc5-b2b5-beb1fef8ab43 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:31.687580 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-07916056-0dfd-4fc5-b2b5-beb1fef8ab43 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:31.693534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07916056-0dfd-4fc5-b2b5-beb1fef8ab43 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:31.693986 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07916056-0dfd-4fc5-b2b5-beb1fef8ab43 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:31.694755 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07916056-0dfd-4fc5-b2b5-beb1fef8ab43 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:31.695202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-07916056-0dfd-4fc5-b2b5-beb1fef8ab43 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:31.818914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-07916056-0dfd-4fc5-b2b5-beb1fef8ab43 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:31.826631 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-07916056-0dfd-4fc5-b2b5-beb1fef8ab43 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144265 May 12 07:22:31.827201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1453/3003] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:32.843596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c5ace312-dd3b-4043-9a75-e31b60b35bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:32.844243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c5ace312-dd3b-4043-9a75-e31b60b35bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:32.850516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5ace312-dd3b-4043-9a75-e31b60b35bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:32.850967 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5ace312-dd3b-4043-9a75-e31b60b35bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:32.851764 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5ace312-dd3b-4043-9a75-e31b60b35bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:32.852206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c5ace312-dd3b-4043-9a75-e31b60b35bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:32.980409 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c5ace312-dd3b-4043-9a75-e31b60b35bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:32.988170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c5ace312-dd3b-4043-9a75-e31b60b35bc5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148474 May 12 07:22:32.988743 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1551/3004] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:34.005367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3882fbe1-f979-472a-bc8f-7c463f4aa91e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:34.006102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3882fbe1-f979-472a-bc8f-7c463f4aa91e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:34.013228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3882fbe1-f979-472a-bc8f-7c463f4aa91e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:34.013683 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3882fbe1-f979-472a-bc8f-7c463f4aa91e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:34.014456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3882fbe1-f979-472a-bc8f-7c463f4aa91e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:34.014898 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3882fbe1-f979-472a-bc8f-7c463f4aa91e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:34.145279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3882fbe1-f979-472a-bc8f-7c463f4aa91e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:34.153303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3882fbe1-f979-472a-bc8f-7c463f4aa91e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.151858 May 12 07:22:34.154100 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1454/3005] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:35.171183 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-31f7273c-6345-4596-bcc2-20842ae65e8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:35.171842 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-31f7273c-6345-4596-bcc2-20842ae65e8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:35.178163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-31f7273c-6345-4596-bcc2-20842ae65e8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:35.178611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-31f7273c-6345-4596-bcc2-20842ae65e8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:35.179375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-31f7273c-6345-4596-bcc2-20842ae65e8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:35.179838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-31f7273c-6345-4596-bcc2-20842ae65e8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:35.305656 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-31f7273c-6345-4596-bcc2-20842ae65e8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:35.313361 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-31f7273c-6345-4596-bcc2-20842ae65e8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146868 May 12 07:22:35.313921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1552/3006] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:35 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:36.330896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7bafcff1-6d9e-4345-a43f-22158a44a948 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:36.331537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7bafcff1-6d9e-4345-a43f-22158a44a948 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:36.337785 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bafcff1-6d9e-4345-a43f-22158a44a948 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:36.338232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bafcff1-6d9e-4345-a43f-22158a44a948 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:36.338987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bafcff1-6d9e-4345-a43f-22158a44a948 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:36.339421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7bafcff1-6d9e-4345-a43f-22158a44a948 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:36.468050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7bafcff1-6d9e-4345-a43f-22158a44a948 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:36.475958 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7bafcff1-6d9e-4345-a43f-22158a44a948 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148897 May 12 07:22:36.476521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1455/3007] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:22:37.493524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b1f2e684-e323-4fc9-9ece-cfa225de2cc9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:37.494140 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b1f2e684-e323-4fc9-9ece-cfa225de2cc9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:37.500852 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1f2e684-e323-4fc9-9ece-cfa225de2cc9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:37.501301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1f2e684-e323-4fc9-9ece-cfa225de2cc9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:37.502070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1f2e684-e323-4fc9-9ece-cfa225de2cc9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:37.502512 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b1f2e684-e323-4fc9-9ece-cfa225de2cc9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:37.626581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b1f2e684-e323-4fc9-9ece-cfa225de2cc9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:37.634232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b1f2e684-e323-4fc9-9ece-cfa225de2cc9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144502 May 12 07:22:37.634798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1553/3008] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:38.651402 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f5aa340b-fe09-4c19-bd4b-f74c35436dcf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:38.651971 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f5aa340b-fe09-4c19-bd4b-f74c35436dcf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:38.658363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5aa340b-fe09-4c19-bd4b-f74c35436dcf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:38.658823 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5aa340b-fe09-4c19-bd4b-f74c35436dcf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:38.659595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5aa340b-fe09-4c19-bd4b-f74c35436dcf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:38.660071 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5aa340b-fe09-4c19-bd4b-f74c35436dcf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:38.787826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f5aa340b-fe09-4c19-bd4b-f74c35436dcf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:38.796372 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f5aa340b-fe09-4c19-bd4b-f74c35436dcf tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148998 May 12 07:22:38.796946 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1456/3009] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:38 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:39.813979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-283250d1-e973-4946-9f46-51f9d3d6fde0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:39.814589 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-283250d1-e973-4946-9f46-51f9d3d6fde0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:39.820970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-283250d1-e973-4946-9f46-51f9d3d6fde0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:39.821418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-283250d1-e973-4946-9f46-51f9d3d6fde0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:39.822186 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-283250d1-e973-4946-9f46-51f9d3d6fde0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:39.822621 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-283250d1-e973-4946-9f46-51f9d3d6fde0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:39.950545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-283250d1-e973-4946-9f46-51f9d3d6fde0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:39.958324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-283250d1-e973-4946-9f46-51f9d3d6fde0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148174 May 12 07:22:39.958903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1554/3010] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:40.975534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-40401c7d-d280-4f31-b03e-b4db1769d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:40.976314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-40401c7d-d280-4f31-b03e-b4db1769d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:40.983850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40401c7d-d280-4f31-b03e-b4db1769d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:40.984478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40401c7d-d280-4f31-b03e-b4db1769d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:40.985245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40401c7d-d280-4f31-b03e-b4db1769d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:40.985681 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40401c7d-d280-4f31-b03e-b4db1769d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:41.113435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-40401c7d-d280-4f31-b03e-b4db1769d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:41.121786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-40401c7d-d280-4f31-b03e-b4db1769d067 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150092 May 12 07:22:41.122342 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1457/3011] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:40 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:42.138693 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2ed67fee-b3ed-4304-86fa-fac926352fe2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:42.139332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2ed67fee-b3ed-4304-86fa-fac926352fe2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:42.145649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ed67fee-b3ed-4304-86fa-fac926352fe2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:42.146096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ed67fee-b3ed-4304-86fa-fac926352fe2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:42.146890 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ed67fee-b3ed-4304-86fa-fac926352fe2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:42.147323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2ed67fee-b3ed-4304-86fa-fac926352fe2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:42.271776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2ed67fee-b3ed-4304-86fa-fac926352fe2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:42.280112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2ed67fee-b3ed-4304-86fa-fac926352fe2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145289 May 12 07:22:42.280670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1555/3012] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:42 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:43.298014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-860caf7f-801d-4fb7-a98e-a5361107be64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:43.298594 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-860caf7f-801d-4fb7-a98e-a5361107be64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:43.304797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-860caf7f-801d-4fb7-a98e-a5361107be64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:43.305244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-860caf7f-801d-4fb7-a98e-a5361107be64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:43.306002 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-860caf7f-801d-4fb7-a98e-a5361107be64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:43.306438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-860caf7f-801d-4fb7-a98e-a5361107be64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:43.434061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-860caf7f-801d-4fb7-a98e-a5361107be64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:43.441692 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-860caf7f-801d-4fb7-a98e-a5361107be64 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147874 May 12 07:22:43.442257 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1458/3013] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:44.458317 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-22aeb493-676e-4832-92b3-06f10578d57a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:44.458872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-22aeb493-676e-4832-92b3-06f10578d57a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:44.466032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22aeb493-676e-4832-92b3-06f10578d57a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:44.466478 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22aeb493-676e-4832-92b3-06f10578d57a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:44.467239 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22aeb493-676e-4832-92b3-06f10578d57a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:44.467677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-22aeb493-676e-4832-92b3-06f10578d57a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:44.597064 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-22aeb493-676e-4832-92b3-06f10578d57a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:44.604920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-22aeb493-676e-4832-92b3-06f10578d57a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150493 May 12 07:22:44.606533 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1556/3014] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:45.622441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8598cc36-58ae-4b42-b7f8-8481639c87ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:45.623050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8598cc36-58ae-4b42-b7f8-8481639c87ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:45.629311 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8598cc36-58ae-4b42-b7f8-8481639c87ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:45.629761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8598cc36-58ae-4b42-b7f8-8481639c87ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:45.630528 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8598cc36-58ae-4b42-b7f8-8481639c87ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:45.630963 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8598cc36-58ae-4b42-b7f8-8481639c87ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:45.757141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8598cc36-58ae-4b42-b7f8-8481639c87ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:45.765529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8598cc36-58ae-4b42-b7f8-8481639c87ee tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147441 May 12 07:22:45.766091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1459/3015] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:45 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:46.782521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-56783b85-7297-4327-abe7-387cc4ed7bcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:46.783129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-56783b85-7297-4327-abe7-387cc4ed7bcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:46.789578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56783b85-7297-4327-abe7-387cc4ed7bcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:46.790030 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56783b85-7297-4327-abe7-387cc4ed7bcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:46.790798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56783b85-7297-4327-abe7-387cc4ed7bcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:46.791235 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-56783b85-7297-4327-abe7-387cc4ed7bcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:46.919801 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-56783b85-7297-4327-abe7-387cc4ed7bcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:46.927814 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-56783b85-7297-4327-abe7-387cc4ed7bcc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149165 May 12 07:22:46.928380 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1557/3016] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:46 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:47.945418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-13cbacd7-389b-45d7-9420-ba91594317b9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:47.946687 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-13cbacd7-389b-45d7-9420-ba91594317b9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:47.953014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13cbacd7-389b-45d7-9420-ba91594317b9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:47.953464 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13cbacd7-389b-45d7-9420-ba91594317b9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:47.954226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13cbacd7-389b-45d7-9420-ba91594317b9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:47.954660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-13cbacd7-389b-45d7-9420-ba91594317b9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:48.079562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-13cbacd7-389b-45d7-9420-ba91594317b9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:48.087165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-13cbacd7-389b-45d7-9420-ba91594317b9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145679 May 12 07:22:48.087751 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1460/3017] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:49.104931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-1719e915-3a4d-40bd-88a8-b50f72a1c342 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:49.105548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-1719e915-3a4d-40bd-88a8-b50f72a1c342 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:49.111989 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1719e915-3a4d-40bd-88a8-b50f72a1c342 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:49.112447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1719e915-3a4d-40bd-88a8-b50f72a1c342 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:49.113224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1719e915-3a4d-40bd-88a8-b50f72a1c342 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:49.113670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-1719e915-3a4d-40bd-88a8-b50f72a1c342 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:49.236261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-1719e915-3a4d-40bd-88a8-b50f72a1c342 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:49.244076 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-1719e915-3a4d-40bd-88a8-b50f72a1c342 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143427 May 12 07:22:49.245203 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1558/3018] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:49 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:50.262243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3845101c-895a-416b-9f55-2c6a8d180b54 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:50.262807 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3845101c-895a-416b-9f55-2c6a8d180b54 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:50.268965 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3845101c-895a-416b-9f55-2c6a8d180b54 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:50.269415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3845101c-895a-416b-9f55-2c6a8d180b54 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:50.270171 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3845101c-895a-416b-9f55-2c6a8d180b54 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:50.270602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3845101c-895a-416b-9f55-2c6a8d180b54 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:50.399283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3845101c-895a-416b-9f55-2c6a8d180b54 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:50.407608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3845101c-895a-416b-9f55-2c6a8d180b54 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149949 May 12 07:22:50.408206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1461/3019] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:51.425614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c18a63aa-a4dd-40ca-9179-3cdd25e0cf65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:51.426265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c18a63aa-a4dd-40ca-9179-3cdd25e0cf65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:51.432376 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c18a63aa-a4dd-40ca-9179-3cdd25e0cf65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:51.432828 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c18a63aa-a4dd-40ca-9179-3cdd25e0cf65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:51.433602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c18a63aa-a4dd-40ca-9179-3cdd25e0cf65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:51.434046 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c18a63aa-a4dd-40ca-9179-3cdd25e0cf65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:51.560104 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c18a63aa-a4dd-40ca-9179-3cdd25e0cf65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:51.567792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c18a63aa-a4dd-40ca-9179-3cdd25e0cf65 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146109 May 12 07:22:51.568360 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1559/3020] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:52.585358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5cc1f20e-0f5d-4c9c-99df-1dd03d494197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:52.586000 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5cc1f20e-0f5d-4c9c-99df-1dd03d494197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:52.592964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cc1f20e-0f5d-4c9c-99df-1dd03d494197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:52.593418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cc1f20e-0f5d-4c9c-99df-1dd03d494197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:52.594219 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cc1f20e-0f5d-4c9c-99df-1dd03d494197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:52.594663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5cc1f20e-0f5d-4c9c-99df-1dd03d494197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:52.721575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5cc1f20e-0f5d-4c9c-99df-1dd03d494197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:52.729985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5cc1f20e-0f5d-4c9c-99df-1dd03d494197 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148495 May 12 07:22:52.730540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1462/3021] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:53.747915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0886ad1a-13fa-436f-8d89-cd8327aed21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:53.748526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0886ad1a-13fa-436f-8d89-cd8327aed21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:53.754720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0886ad1a-13fa-436f-8d89-cd8327aed21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:53.755167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0886ad1a-13fa-436f-8d89-cd8327aed21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:53.755954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0886ad1a-13fa-436f-8d89-cd8327aed21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:53.756390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0886ad1a-13fa-436f-8d89-cd8327aed21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:53.879745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0886ad1a-13fa-436f-8d89-cd8327aed21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:53.887362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0886ad1a-13fa-436f-8d89-cd8327aed21d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143875 May 12 07:22:53.887954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1560/3022] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:54.904181 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-51a2706c-7998-4d99-8a37-f66fe5648da6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:54.904773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-51a2706c-7998-4d99-8a37-f66fe5648da6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:54.910994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51a2706c-7998-4d99-8a37-f66fe5648da6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:54.911444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51a2706c-7998-4d99-8a37-f66fe5648da6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:54.912224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51a2706c-7998-4d99-8a37-f66fe5648da6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:54.912660 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-51a2706c-7998-4d99-8a37-f66fe5648da6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:55.043065 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-51a2706c-7998-4d99-8a37-f66fe5648da6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:55.051170 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-51a2706c-7998-4d99-8a37-f66fe5648da6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150872 May 12 07:22:55.051768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1463/3023] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:56.069027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-16067b37-d155-41cc-8d8f-6c40694166d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:56.069637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-16067b37-d155-41cc-8d8f-6c40694166d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:56.076267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16067b37-d155-41cc-8d8f-6c40694166d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:56.076725 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16067b37-d155-41cc-8d8f-6c40694166d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:56.077510 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16067b37-d155-41cc-8d8f-6c40694166d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:56.077954 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-16067b37-d155-41cc-8d8f-6c40694166d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:56.202277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-16067b37-d155-41cc-8d8f-6c40694166d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:56.210411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-16067b37-d155-41cc-8d8f-6c40694166d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145454 May 12 07:22:56.211018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1561/3024] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:57.227152 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c4219bf2-906f-481b-bb27-52fe532e445b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:57.227802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c4219bf2-906f-481b-bb27-52fe532e445b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:57.234800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c4219bf2-906f-481b-bb27-52fe532e445b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:57.235256 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c4219bf2-906f-481b-bb27-52fe532e445b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:57.236049 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c4219bf2-906f-481b-bb27-52fe532e445b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:57.236481 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c4219bf2-906f-481b-bb27-52fe532e445b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:57.352923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3232858b-5846-453f-9f2a-7e5d3ad49e4e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:57.353481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3232858b-5846-453f-9f2a-7e5d3ad49e4e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:57.359324 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3232858b-5846-453f-9f2a-7e5d3ad49e4e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:57.359815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3232858b-5846-453f-9f2a-7e5d3ad49e4e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:57.360593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3232858b-5846-453f-9f2a-7e5d3ad49e4e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:57.361031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3232858b-5846-453f-9f2a-7e5d3ad49e4e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:57.362316 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c4219bf2-906f-481b-bb27-52fe532e445b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:57.370158 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c4219bf2-906f-481b-bb27-52fe532e445b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146820 May 12 07:22:57.370737 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1464/3025] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:57.386095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3232858b-5846-453f-9f2a-7e5d3ad49e4e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:22:57.657620 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3232858b-5846-453f-9f2a-7e5d3ad49e4e tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 204 len: 0 microversion: 2.1 time: 0.373642 May 12 07:22:57.658134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1562/3026] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:22:57 2022] DELETE /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 07:22:57.666825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2f6d06d0-47dd-447e-85b4-64abc763f7e5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:57.667444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2f6d06d0-47dd-447e-85b4-64abc763f7e5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:57.673605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f6d06d0-47dd-447e-85b4-64abc763f7e5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:57.674061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f6d06d0-47dd-447e-85b4-64abc763f7e5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:57.674831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f6d06d0-47dd-447e-85b4-64abc763f7e5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:57.675272 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2f6d06d0-47dd-447e-85b4-64abc763f7e5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:57.805151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2f6d06d0-47dd-447e-85b4-64abc763f7e5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:57.812379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2f6d06d0-47dd-447e-85b4-64abc763f7e5 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1674 microversion: 2.1 time: 0.150034 May 12 07:22:57.812954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1465/3027] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:57 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:58.388032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-497e2dff-33c0-40b7-84fa-573ec6789a00 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:58.388652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-497e2dff-33c0-40b7-84fa-573ec6789a00 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:58.394991 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-497e2dff-33c0-40b7-84fa-573ec6789a00 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:58.395447 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-497e2dff-33c0-40b7-84fa-573ec6789a00 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:58.396250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-497e2dff-33c0-40b7-84fa-573ec6789a00 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:58.396692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-497e2dff-33c0-40b7-84fa-573ec6789a00 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:58.521617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-497e2dff-33c0-40b7-84fa-573ec6789a00 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:58.529841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-497e2dff-33c0-40b7-84fa-573ec6789a00 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146226 May 12 07:22:58.530412 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1563/3028] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:58.829654 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d2e4304d-a358-4d6a-b8a2-ecae131ebf1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:58.831079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d2e4304d-a358-4d6a-b8a2-ecae131ebf1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:58.838432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d2e4304d-a358-4d6a-b8a2-ecae131ebf1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:58.838882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d2e4304d-a358-4d6a-b8a2-ecae131ebf1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:58.839647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d2e4304d-a358-4d6a-b8a2-ecae131ebf1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:58.840115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d2e4304d-a358-4d6a-b8a2-ecae131ebf1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:58.968385 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d2e4304d-a358-4d6a-b8a2-ecae131ebf1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:58.975667 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d2e4304d-a358-4d6a-b8a2-ecae131ebf1a tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1674 microversion: 2.1 time: 0.149920 May 12 07:22:58.976279 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1466/3029] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:58 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:59.547262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-50d18bc8-4348-4d39-b7bc-2242ba76d401 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:59.547918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-50d18bc8-4348-4d39-b7bc-2242ba76d401 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:59.554259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50d18bc8-4348-4d39-b7bc-2242ba76d401 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:59.554712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50d18bc8-4348-4d39-b7bc-2242ba76d401 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:59.555484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50d18bc8-4348-4d39-b7bc-2242ba76d401 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:59.555947 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-50d18bc8-4348-4d39-b7bc-2242ba76d401 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:59.687977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-50d18bc8-4348-4d39-b7bc-2242ba76d401 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:22:59.710724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-50d18bc8-4348-4d39-b7bc-2242ba76d401 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.159372 May 12 07:22:59.710724 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1564/3030] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:22:59.968144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-a31ec156-d37d-4e88-948a-1a84077cd7ac req-f7543e16-d033-43cf-9270-a96d85fbceb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e764fc04-6610-4900-8353-39c895a25366", "name": "network-vif-deleted", "tag": "4b943e79-d5b1-480e-9146-82b63a3d9fd4"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:22:59.976103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-a31ec156-d37d-4e88-948a-1a84077cd7ac req-f7543e16-d033-43cf-9270-a96d85fbceb1 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:22:59.981066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-a31ec156-d37d-4e88-948a-1a84077cd7ac req-f7543e16-d033-43cf-9270-a96d85fbceb1 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:22:59.991531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-a31ec156-d37d-4e88-948a-1a84077cd7ac req-f7543e16-d033-43cf-9270-a96d85fbceb1 service nova] Creating event network-vif-deleted:4b943e79-d5b1-480e-9146-82b63a3d9fd4 for instance e764fc04-6610-4900-8353-39c895a25366 on hv-cinder-76606 May 12 07:22:59.992431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c38f8d7e-8b65-4a41-a612-40931af5f7e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:22:59.994266 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c38f8d7e-8b65-4a41-a612-40931af5f7e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:22:59.997518 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-a31ec156-d37d-4e88-948a-1a84077cd7ac req-f7543e16-d033-43cf-9270-a96d85fbceb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032911 May 12 07:22:59.998178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1467/3031] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:23:00.002303 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c38f8d7e-8b65-4a41-a612-40931af5f7e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:00.002830 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c38f8d7e-8b65-4a41-a612-40931af5f7e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:00.015151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c38f8d7e-8b65-4a41-a612-40931af5f7e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:00.015812 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c38f8d7e-8b65-4a41-a612-40931af5f7e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:00.093363 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c38f8d7e-8b65-4a41-a612-40931af5f7e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11c63feb0740aeb5283907c8b61680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ccbfb303dc40a7a2313fe5e6ab3332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:00.107957 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c38f8d7e-8b65-4a41-a612-40931af5f7e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 200 len: 1607 microversion: 2.1 time: 0.119514 May 12 07:23:00.109161 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1565/3032] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:22:59 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 1607 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:00.720052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-db36b296-e5a3-4de4-b245-5b94121d1150 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:00.720791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-db36b296-e5a3-4de4-b245-5b94121d1150 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:00.727389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db36b296-e5a3-4de4-b245-5b94121d1150 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:00.727995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db36b296-e5a3-4de4-b245-5b94121d1150 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:00.728803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db36b296-e5a3-4de4-b245-5b94121d1150 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:00.729245 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-db36b296-e5a3-4de4-b245-5b94121d1150 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:00.866543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-db36b296-e5a3-4de4-b245-5b94121d1150 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:00.875378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-db36b296-e5a3-4de4-b245-5b94121d1150 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.159562 May 12 07:23:00.876258 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1468/3033] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:01.126080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9ffa68b6-f093-4745-a358-8fe6b54dd8fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:01.126810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9ffa68b6-f093-4745-a358-8fe6b54dd8fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:01.133597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ffa68b6-f093-4745-a358-8fe6b54dd8fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:01.134042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ffa68b6-f093-4745-a358-8fe6b54dd8fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:01.134923 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ffa68b6-f093-4745-a358-8fe6b54dd8fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:01.135632 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9ffa68b6-f093-4745-a358-8fe6b54dd8fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:01.149057 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-9ffa68b6-f093-4745-a358-8fe6b54dd8fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] HTTP exception thrown: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9ffa68b6-f093-4745-a358-8fe6b54dd8fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Request method failure captured: May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 HTTP/1.1 May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK6HRGYlYWXya91pIHFVjAOJYmWtY5MYyvZwnZXCpGZQzepfO3c5NJWQekHocxqSfxT8elJH9ruUtKdfHyZTPoHWcIRBOAcyLXayn_VKB1I6gvi1k8VtECvraaK2HuKMC_VgY_LLYMl3klBjcYGThTYZQRd5C0PPkOms3IAcJhz746w May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: 91ccbfb303dc40a7a2313fe5e6ab3332 May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-AttachVolumeTestJSON-1496827555 May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:23:01.150668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91ccbfb303dc40a7a2313fe5e6ab3332"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91ccbfb303dc40a7a2313fe5e6ab3332", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91ccbfb303dc40a7a2313fe5e6ab3332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91ccbfb303dc40a7a2313fe5e6ab3332"}]}] May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-AttachVolumeTestJSON-1496827555 May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: 91ccbfb303dc40a7a2313fe5e6ab3332 May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1496827555 May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-AttachVolumeTestJSON-1496827555-project May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 9f11c63feb0740aeb5283907c8b61680 May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-AttachVolumeTestJSON-1496827555-project May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:01.152531 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': 'e764fc04-6610-4900-8353-39c895a25366'} May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:23:01.153631 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:01.155310 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:23:01.156872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9ffa68b6-f093-4745-a358-8fe6b54dd8fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Returning 404 to user: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:23:01.156872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9ffa68b6-f093-4745-a358-8fe6b54dd8fa tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 404 len: 111 microversion: 2.1 time: 0.030757 May 12 07:23:01.156872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1566/3034] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:01 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:23:01.160915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5389a33c-c4dc-49f5-9fb0-b58ba48d6797 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '.version_select at 0x7f89da448790>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:01.241075 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5389a33c-c4dc-49f5-9fb0-b58ba48d6797 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062079306" status: 202 len: 0 microversion: 2.1 time: 0.083891 May 12 07:23:01.241676 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1469/3035] 10.222.0.25 () {58 vars in 1220 bytes} [Thu May 12 07:23:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062079306 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 07:23:01.898137 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0424665a-bb65-4fb1-8e6a-80a308222526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:01.898888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0424665a-bb65-4fb1-8e6a-80a308222526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:01.904977 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0424665a-bb65-4fb1-8e6a-80a308222526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:01.905525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0424665a-bb65-4fb1-8e6a-80a308222526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:01.906386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0424665a-bb65-4fb1-8e6a-80a308222526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:01.906904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0424665a-bb65-4fb1-8e6a-80a308222526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:01.994989 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-718637a8-2047-44a8-a272-a466d7078559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:01.995721 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-718637a8-2047-44a8-a272-a466d7078559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:02.001800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-718637a8-2047-44a8-a272-a466d7078559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:02.002489 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-718637a8-2047-44a8-a272-a466d7078559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:02.003282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-718637a8-2047-44a8-a272-a466d7078559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:02.003921 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-718637a8-2047-44a8-a272-a466d7078559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:02.018253 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-718637a8-2047-44a8-a272-a466d7078559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] HTTP exception thrown: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-718637a8-2047-44a8-a272-a466d7078559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Request method failure captured: May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 HTTP/1.1 May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6HRGYlYWXya91pIHFVjAOJYmWtY5MYyvZwnZXCpGZQzepfO3c5NJWQekHocxqSfxT8elJH9ruUtKdfHyZTPoHWcIRBOAcyLXayn_VKB1I6gvi1k8VtECvraaK2HuKMC_VgY_LLYMl3klBjcYGThTYZQRd5C0PPkOms3IAcJhz746w May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 91ccbfb303dc40a7a2313fe5e6ab3332 May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeTestJSON-1496827555 May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:23:02.019982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91ccbfb303dc40a7a2313fe5e6ab3332"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91ccbfb303dc40a7a2313fe5e6ab3332", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91ccbfb303dc40a7a2313fe5e6ab3332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91ccbfb303dc40a7a2313fe5e6ab3332"}]}] May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeTestJSON-1496827555 May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 91ccbfb303dc40a7a2313fe5e6ab3332 May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1496827555 May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeTestJSON-1496827555-project May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 9f11c63feb0740aeb5283907c8b61680 May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeTestJSON-1496827555-project May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:02.021726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': 'e764fc04-6610-4900-8353-39c895a25366'} May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:23:02.022987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:02.024421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:23:02.027471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-718637a8-2047-44a8-a272-a466d7078559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Returning 404 to user: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:23:02.027471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-718637a8-2047-44a8-a272-a466d7078559 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 404 len: 111 microversion: 2.1 time: 0.032731 May 12 07:23:02.027471 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1470/3036] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:23:01 2022] DELETE /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:23:02.030127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6e126f6d-4594-4b6f-b043-4c05923b1167 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:02.030744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6e126f6d-4594-4b6f-b043-4c05923b1167 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: e764fc04-6610-4900-8353-39c895a25366] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:02.036551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e126f6d-4594-4b6f-b043-4c05923b1167 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:02.037007 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e126f6d-4594-4b6f-b043-4c05923b1167 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:02.037775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e126f6d-4594-4b6f-b043-4c05923b1167 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:02.038216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6e126f6d-4594-4b6f-b043-4c05923b1167 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:02.046374 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0424665a-bb65-4fb1-8e6a-80a308222526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:02.052111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-6e126f6d-4594-4b6f-b043-4c05923b1167 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] HTTP exception thrown: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6e126f6d-4594-4b6f-b043-4c05923b1167 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Request method failure captured: May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 HTTP/1.1 May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6HRGYlYWXya91pIHFVjAOJYmWtY5MYyvZwnZXCpGZQzepfO3c5NJWQekHocxqSfxT8elJH9ruUtKdfHyZTPoHWcIRBOAcyLXayn_VKB1I6gvi1k8VtECvraaK2HuKMC_VgY_LLYMl3klBjcYGThTYZQRd5C0PPkOms3IAcJhz746w May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 91ccbfb303dc40a7a2313fe5e6ab3332 May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeTestJSON-1496827555 May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:23:02.053781 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91ccbfb303dc40a7a2313fe5e6ab3332"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91ccbfb303dc40a7a2313fe5e6ab3332", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91ccbfb303dc40a7a2313fe5e6ab3332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91ccbfb303dc40a7a2313fe5e6ab3332"}]}] May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeTestJSON-1496827555 May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 91ccbfb303dc40a7a2313fe5e6ab3332 May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1496827555 May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeTestJSON-1496827555-project May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 9f11c63feb0740aeb5283907c8b61680 May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeTestJSON-1496827555-project May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:02.057012 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': 'e764fc04-6610-4900-8353-39c895a25366'} May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:23:02.058712 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. May 12 07:23:02.061603 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:23:02.064024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6e126f6d-4594-4b6f-b043-4c05923b1167 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Returning 404 to user: Instance e764fc04-6610-4900-8353-39c895a25366 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:23:02.064136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0424665a-bb65-4fb1-8e6a-80a308222526 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.160120 May 12 07:23:02.064364 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6e126f6d-4594-4b6f-b043-4c05923b1167 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366" status: 404 len: 111 microversion: 2.1 time: 0.028693 May 12 07:23:02.064364 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1471/3037] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:02 2022] GET /compute/v2.1/servers/e764fc04-6610-4900-8353-39c895a25366 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:23:02.064569 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1567/3038] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:03.072488 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-94f0b0e5-fa18-4e91-9ccc-17c8d5b51e87 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:03.073102 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-94f0b0e5-fa18-4e91-9ccc-17c8d5b51e87 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:03.079396 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-94f0b0e5-fa18-4e91-9ccc-17c8d5b51e87 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:03.079890 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-94f0b0e5-fa18-4e91-9ccc-17c8d5b51e87 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:03.080652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-94f0b0e5-fa18-4e91-9ccc-17c8d5b51e87 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:03.081091 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-94f0b0e5-fa18-4e91-9ccc-17c8d5b51e87 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:03.208780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-94f0b0e5-fa18-4e91-9ccc-17c8d5b51e87 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:03.217217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-94f0b0e5-fa18-4e91-9ccc-17c8d5b51e87 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148686 May 12 07:23:03.217780 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1472/3039] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:04.233865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-07bad611-6ceb-4562-9121-8f1cf3ad2894 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:04.234482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-07bad611-6ceb-4562-9121-8f1cf3ad2894 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:04.240806 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-07bad611-6ceb-4562-9121-8f1cf3ad2894 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:04.241260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-07bad611-6ceb-4562-9121-8f1cf3ad2894 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:04.242031 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-07bad611-6ceb-4562-9121-8f1cf3ad2894 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:04.242521 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-07bad611-6ceb-4562-9121-8f1cf3ad2894 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:04.365013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-07bad611-6ceb-4562-9121-8f1cf3ad2894 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:04.373318 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-07bad611-6ceb-4562-9121-8f1cf3ad2894 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143435 May 12 07:23:04.373879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1568/3040] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:05.390341 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e6cf1932-6b74-4fd4-97ad-a8b2e4e59550 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:05.390951 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e6cf1932-6b74-4fd4-97ad-a8b2e4e59550 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:05.397773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6cf1932-6b74-4fd4-97ad-a8b2e4e59550 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:05.397940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6cf1932-6b74-4fd4-97ad-a8b2e4e59550 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:05.398708 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6cf1932-6b74-4fd4-97ad-a8b2e4e59550 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:05.399139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e6cf1932-6b74-4fd4-97ad-a8b2e4e59550 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:05.526239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e6cf1932-6b74-4fd4-97ad-a8b2e4e59550 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:05.533893 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e6cf1932-6b74-4fd4-97ad-a8b2e4e59550 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147429 May 12 07:23:05.534452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1473/3041] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:06.551393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-82050560-4a17-4568-a819-5bf76fe1186f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:06.552048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-82050560-4a17-4568-a819-5bf76fe1186f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:06.558341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-82050560-4a17-4568-a819-5bf76fe1186f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:06.558795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-82050560-4a17-4568-a819-5bf76fe1186f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:06.559568 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-82050560-4a17-4568-a819-5bf76fe1186f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:06.560035 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-82050560-4a17-4568-a819-5bf76fe1186f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:06.685081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-82050560-4a17-4568-a819-5bf76fe1186f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:06.692847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-82050560-4a17-4568-a819-5bf76fe1186f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145351 May 12 07:23:06.693413 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1569/3042] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:07.710424 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-45d266e4-3b55-40b1-9a11-fbb681faa252 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:07.711004 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-45d266e4-3b55-40b1-9a11-fbb681faa252 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:07.717923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45d266e4-3b55-40b1-9a11-fbb681faa252 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:07.718381 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45d266e4-3b55-40b1-9a11-fbb681faa252 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:07.719155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45d266e4-3b55-40b1-9a11-fbb681faa252 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:07.719598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-45d266e4-3b55-40b1-9a11-fbb681faa252 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:07.846455 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-45d266e4-3b55-40b1-9a11-fbb681faa252 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:07.854588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-45d266e4-3b55-40b1-9a11-fbb681faa252 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148156 May 12 07:23:07.855150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1474/3043] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:07 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:08.871501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d164f9e5-3eef-45ce-b75e-4a18fb273f73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:08.872144 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d164f9e5-3eef-45ce-b75e-4a18fb273f73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:08.878449 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d164f9e5-3eef-45ce-b75e-4a18fb273f73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:08.878895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d164f9e5-3eef-45ce-b75e-4a18fb273f73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:08.879668 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d164f9e5-3eef-45ce-b75e-4a18fb273f73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:08.880132 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d164f9e5-3eef-45ce-b75e-4a18fb273f73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:09.008858 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d164f9e5-3eef-45ce-b75e-4a18fb273f73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:09.017419 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d164f9e5-3eef-45ce-b75e-4a18fb273f73 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150255 May 12 07:23:09.017984 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1570/3044] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:10.034430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-00e4b37c-6514-4abf-81a4-a345cfe34431 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:10.035041 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-00e4b37c-6514-4abf-81a4-a345cfe34431 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:10.041416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00e4b37c-6514-4abf-81a4-a345cfe34431 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:10.041862 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00e4b37c-6514-4abf-81a4-a345cfe34431 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:10.042734 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00e4b37c-6514-4abf-81a4-a345cfe34431 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:10.043177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-00e4b37c-6514-4abf-81a4-a345cfe34431 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:10.169204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-00e4b37c-6514-4abf-81a4-a345cfe34431 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:10.177438 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-00e4b37c-6514-4abf-81a4-a345cfe34431 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146857 May 12 07:23:10.177998 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1475/3045] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:11.194416 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0b33083d-207b-41e1-8751-f5c7dfc7d315 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:11.195022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0b33083d-207b-41e1-8751-f5c7dfc7d315 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:11.201903 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b33083d-207b-41e1-8751-f5c7dfc7d315 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:11.202349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b33083d-207b-41e1-8751-f5c7dfc7d315 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:11.203116 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b33083d-207b-41e1-8751-f5c7dfc7d315 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:11.203592 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b33083d-207b-41e1-8751-f5c7dfc7d315 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:11.330375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0b33083d-207b-41e1-8751-f5c7dfc7d315 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:11.338261 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0b33083d-207b-41e1-8751-f5c7dfc7d315 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147853 May 12 07:23:11.338827 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1571/3046] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:12.355523 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a2185fdf-f602-4880-bd1b-62b13e4bdc98 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:12.356133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a2185fdf-f602-4880-bd1b-62b13e4bdc98 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:12.363035 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2185fdf-f602-4880-bd1b-62b13e4bdc98 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:12.363491 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2185fdf-f602-4880-bd1b-62b13e4bdc98 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:12.364303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2185fdf-f602-4880-bd1b-62b13e4bdc98 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:12.364747 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a2185fdf-f602-4880-bd1b-62b13e4bdc98 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:12.491517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a2185fdf-f602-4880-bd1b-62b13e4bdc98 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:12.499428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a2185fdf-f602-4880-bd1b-62b13e4bdc98 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147884 May 12 07:23:12.500031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1476/3047] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:12 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:13.516845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8f09de04-b5d6-4069-9cc3-5383bbbfbcc7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:13.517495 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8f09de04-b5d6-4069-9cc3-5383bbbfbcc7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:13.523843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f09de04-b5d6-4069-9cc3-5383bbbfbcc7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:13.524786 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f09de04-b5d6-4069-9cc3-5383bbbfbcc7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:13.525565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f09de04-b5d6-4069-9cc3-5383bbbfbcc7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:13.526005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f09de04-b5d6-4069-9cc3-5383bbbfbcc7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:13.652775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8f09de04-b5d6-4069-9cc3-5383bbbfbcc7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:13.660466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8f09de04-b5d6-4069-9cc3-5383bbbfbcc7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147531 May 12 07:23:13.661044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1572/3048] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:14.678521 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1d25ac8f-691e-458b-8bab-97a02c232f88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:14.679154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1d25ac8f-691e-458b-8bab-97a02c232f88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:14.685920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d25ac8f-691e-458b-8bab-97a02c232f88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:14.686366 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d25ac8f-691e-458b-8bab-97a02c232f88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:14.687125 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d25ac8f-691e-458b-8bab-97a02c232f88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:14.687562 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1d25ac8f-691e-458b-8bab-97a02c232f88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:14.816154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1d25ac8f-691e-458b-8bab-97a02c232f88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:14.823988 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1d25ac8f-691e-458b-8bab-97a02c232f88 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149318 May 12 07:23:14.824548 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1477/3049] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:15.840878 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2891cfe4-e327-48dd-948d-4aa55019463b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:15.841491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2891cfe4-e327-48dd-948d-4aa55019463b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:15.847877 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2891cfe4-e327-48dd-948d-4aa55019463b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:15.848336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2891cfe4-e327-48dd-948d-4aa55019463b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:15.849106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2891cfe4-e327-48dd-948d-4aa55019463b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:15.849547 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2891cfe4-e327-48dd-948d-4aa55019463b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:15.974944 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2891cfe4-e327-48dd-948d-4aa55019463b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:15.983049 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2891cfe4-e327-48dd-948d-4aa55019463b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146055 May 12 07:23:15.983922 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1573/3050] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:17.001693 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-01a08895-88d7-4217-b985-1a925d62403c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:17.002337 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-01a08895-88d7-4217-b985-1a925d62403c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:17.008716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-01a08895-88d7-4217-b985-1a925d62403c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:17.009163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-01a08895-88d7-4217-b985-1a925d62403c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:17.009923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-01a08895-88d7-4217-b985-1a925d62403c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:17.010359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-01a08895-88d7-4217-b985-1a925d62403c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:17.136080 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-01a08895-88d7-4217-b985-1a925d62403c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:17.143790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-01a08895-88d7-4217-b985-1a925d62403c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145969 May 12 07:23:17.144344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1478/3051] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:18.160875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-abfefc48-c209-42f0-ba11-d75a2772e323 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:18.161491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-abfefc48-c209-42f0-ba11-d75a2772e323 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:18.167802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abfefc48-c209-42f0-ba11-d75a2772e323 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:18.168258 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abfefc48-c209-42f0-ba11-d75a2772e323 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:18.169028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abfefc48-c209-42f0-ba11-d75a2772e323 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:18.169470 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-abfefc48-c209-42f0-ba11-d75a2772e323 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:18.292395 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-abfefc48-c209-42f0-ba11-d75a2772e323 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:18.300402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-abfefc48-c209-42f0-ba11-d75a2772e323 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143377 May 12 07:23:18.300970 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1574/3052] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:19.317405 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b565b7b3-12dd-4af4-83cf-011aa796fcb1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:19.317955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b565b7b3-12dd-4af4-83cf-011aa796fcb1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:19.324415 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b565b7b3-12dd-4af4-83cf-011aa796fcb1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:19.324864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b565b7b3-12dd-4af4-83cf-011aa796fcb1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:19.325623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b565b7b3-12dd-4af4-83cf-011aa796fcb1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:19.326058 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b565b7b3-12dd-4af4-83cf-011aa796fcb1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:19.454742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b565b7b3-12dd-4af4-83cf-011aa796fcb1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:19.463217 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b565b7b3-12dd-4af4-83cf-011aa796fcb1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149825 May 12 07:23:19.463803 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1479/3053] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:19 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:20.480931 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0d46084b-23e4-4f3a-a16f-4359b4d244ba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:20.481482 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0d46084b-23e4-4f3a-a16f-4359b4d244ba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:20.487901 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d46084b-23e4-4f3a-a16f-4359b4d244ba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:20.488349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d46084b-23e4-4f3a-a16f-4359b4d244ba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:20.489112 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d46084b-23e4-4f3a-a16f-4359b4d244ba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:20.489544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0d46084b-23e4-4f3a-a16f-4359b4d244ba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:20.614342 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0d46084b-23e4-4f3a-a16f-4359b4d244ba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:20.622158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0d46084b-23e4-4f3a-a16f-4359b4d244ba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145806 May 12 07:23:20.622733 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1575/3054] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:20 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:21.638487 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-40c6e3e4-63b0-4bcd-8528-0f4b3fda2e9d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:21.639105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-40c6e3e4-63b0-4bcd-8528-0f4b3fda2e9d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:21.645556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40c6e3e4-63b0-4bcd-8528-0f4b3fda2e9d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:21.646015 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40c6e3e4-63b0-4bcd-8528-0f4b3fda2e9d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:21.646836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40c6e3e4-63b0-4bcd-8528-0f4b3fda2e9d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:21.647278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-40c6e3e4-63b0-4bcd-8528-0f4b3fda2e9d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:21.773020 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-40c6e3e4-63b0-4bcd-8528-0f4b3fda2e9d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:21.781261 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-40c6e3e4-63b0-4bcd-8528-0f4b3fda2e9d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146700 May 12 07:23:21.781837 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1480/3055] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:21 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:22.799201 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c03204c6-82f7-4566-8aa8-7ff50ca11b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:22.799843 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c03204c6-82f7-4566-8aa8-7ff50ca11b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:22.805769 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c03204c6-82f7-4566-8aa8-7ff50ca11b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:22.806217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c03204c6-82f7-4566-8aa8-7ff50ca11b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:22.808022 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c03204c6-82f7-4566-8aa8-7ff50ca11b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:22.808465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c03204c6-82f7-4566-8aa8-7ff50ca11b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:22.933196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c03204c6-82f7-4566-8aa8-7ff50ca11b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:22.940942 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c03204c6-82f7-4566-8aa8-7ff50ca11b36 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146107 May 12 07:23:22.941523 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1576/3056] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:23.958679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6bf52172-cc23-4660-b827-43cbdb6d4874 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:23.959299 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6bf52172-cc23-4660-b827-43cbdb6d4874 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:23.966106 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bf52172-cc23-4660-b827-43cbdb6d4874 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:23.966552 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bf52172-cc23-4660-b827-43cbdb6d4874 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:23.967318 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bf52172-cc23-4660-b827-43cbdb6d4874 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:23.967777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6bf52172-cc23-4660-b827-43cbdb6d4874 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:24.091081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6bf52172-cc23-4660-b827-43cbdb6d4874 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:24.098723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6bf52172-cc23-4660-b827-43cbdb6d4874 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143942 May 12 07:23:24.099286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1481/3057] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:25.116285 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8bfd247a-e969-4b14-b37c-6f57a6773283 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:25.116897 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8bfd247a-e969-4b14-b37c-6f57a6773283 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:25.123771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8bfd247a-e969-4b14-b37c-6f57a6773283 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:25.124223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8bfd247a-e969-4b14-b37c-6f57a6773283 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:25.124993 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8bfd247a-e969-4b14-b37c-6f57a6773283 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:25.125428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8bfd247a-e969-4b14-b37c-6f57a6773283 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:25.251573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8bfd247a-e969-4b14-b37c-6f57a6773283 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:25.259287 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8bfd247a-e969-4b14-b37c-6f57a6773283 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146832 May 12 07:23:25.259896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1577/3058] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:26.276540 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3d569de6-7471-4947-a8ee-766f7abfc6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:26.277070 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3d569de6-7471-4947-a8ee-766f7abfc6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:26.283367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d569de6-7471-4947-a8ee-766f7abfc6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:26.283853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d569de6-7471-4947-a8ee-766f7abfc6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:26.284620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d569de6-7471-4947-a8ee-766f7abfc6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:26.285062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3d569de6-7471-4947-a8ee-766f7abfc6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:26.409176 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3d569de6-7471-4947-a8ee-766f7abfc6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:26.416902 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3d569de6-7471-4947-a8ee-766f7abfc6a8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144342 May 12 07:23:26.417475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1482/3059] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:27.435114 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c292f9a5-2043-41f8-a2b1-fdd2e8c81cdc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:27.435758 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c292f9a5-2043-41f8-a2b1-fdd2e8c81cdc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:27.442079 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c292f9a5-2043-41f8-a2b1-fdd2e8c81cdc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:27.442809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c292f9a5-2043-41f8-a2b1-fdd2e8c81cdc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:27.443579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c292f9a5-2043-41f8-a2b1-fdd2e8c81cdc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:27.444040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c292f9a5-2043-41f8-a2b1-fdd2e8c81cdc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:27.567402 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c292f9a5-2043-41f8-a2b1-fdd2e8c81cdc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:27.575218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c292f9a5-2043-41f8-a2b1-fdd2e8c81cdc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144482 May 12 07:23:27.575809 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1578/3060] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:27 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:28.592766 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6b65086f-7b4a-4ed4-89c9-90748b31c0b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:28.593363 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6b65086f-7b4a-4ed4-89c9-90748b31c0b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:28.599636 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b65086f-7b4a-4ed4-89c9-90748b31c0b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:28.600115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b65086f-7b4a-4ed4-89c9-90748b31c0b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:28.600869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b65086f-7b4a-4ed4-89c9-90748b31c0b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:28.601303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6b65086f-7b4a-4ed4-89c9-90748b31c0b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:28.727146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6b65086f-7b4a-4ed4-89c9-90748b31c0b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:28.735355 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6b65086f-7b4a-4ed4-89c9-90748b31c0b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146465 May 12 07:23:28.735940 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1483/3061] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:23:29.753260 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9aae4978-ae4a-4105-a74c-f288ec46a8fe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:29.753876 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9aae4978-ae4a-4105-a74c-f288ec46a8fe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:29.760713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9aae4978-ae4a-4105-a74c-f288ec46a8fe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:29.761167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9aae4978-ae4a-4105-a74c-f288ec46a8fe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:29.761940 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9aae4978-ae4a-4105-a74c-f288ec46a8fe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:29.762383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9aae4978-ae4a-4105-a74c-f288ec46a8fe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:29.887978 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9aae4978-ae4a-4105-a74c-f288ec46a8fe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:29.895823 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9aae4978-ae4a-4105-a74c-f288ec46a8fe tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146418 May 12 07:23:29.896393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1579/3062] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:30.912798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1cf6af71-8f35-4b59-9cab-8508bedc6dc0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:30.913400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1cf6af71-8f35-4b59-9cab-8508bedc6dc0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:30.920062 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cf6af71-8f35-4b59-9cab-8508bedc6dc0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:30.920526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cf6af71-8f35-4b59-9cab-8508bedc6dc0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:30.921302 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cf6af71-8f35-4b59-9cab-8508bedc6dc0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:30.921743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1cf6af71-8f35-4b59-9cab-8508bedc6dc0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:31.048250 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1cf6af71-8f35-4b59-9cab-8508bedc6dc0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:31.055993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1cf6af71-8f35-4b59-9cab-8508bedc6dc0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147086 May 12 07:23:31.057168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1484/3063] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:32.073933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8ffdedb6-b0ca-44e7-837e-947901838fb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:32.074542 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8ffdedb6-b0ca-44e7-837e-947901838fb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:32.080804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8ffdedb6-b0ca-44e7-837e-947901838fb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:32.081250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8ffdedb6-b0ca-44e7-837e-947901838fb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:32.082014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8ffdedb6-b0ca-44e7-837e-947901838fb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:32.082451 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8ffdedb6-b0ca-44e7-837e-947901838fb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:32.206165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8ffdedb6-b0ca-44e7-837e-947901838fb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:32.214308 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8ffdedb6-b0ca-44e7-837e-947901838fb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144262 May 12 07:23:32.214871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1580/3064] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:32.666207 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:23:32.666467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:23:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:23:33.231814 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-92753abe-8e69-45f5-8053-b256261b303a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:33.232428 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-92753abe-8e69-45f5-8053-b256261b303a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:33.238692 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92753abe-8e69-45f5-8053-b256261b303a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:33.239139 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92753abe-8e69-45f5-8053-b256261b303a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:33.239919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92753abe-8e69-45f5-8053-b256261b303a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:33.240352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-92753abe-8e69-45f5-8053-b256261b303a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:33.367289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-92753abe-8e69-45f5-8053-b256261b303a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:33.375565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-92753abe-8e69-45f5-8053-b256261b303a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148156 May 12 07:23:33.376154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1485/3065] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:33 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:34.393081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b210ed01-f9b6-4947-ab8f-79b794a88954 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:34.393623 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b210ed01-f9b6-4947-ab8f-79b794a88954 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:34.400506 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b210ed01-f9b6-4947-ab8f-79b794a88954 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:34.400953 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b210ed01-f9b6-4947-ab8f-79b794a88954 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:34.401726 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b210ed01-f9b6-4947-ab8f-79b794a88954 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:34.402163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b210ed01-f9b6-4947-ab8f-79b794a88954 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:34.530487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b210ed01-f9b6-4947-ab8f-79b794a88954 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:34.538237 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b210ed01-f9b6-4947-ab8f-79b794a88954 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149097 May 12 07:23:34.544282 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1581/3066] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:34 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:35.556734 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-09702e9c-de7c-4f9d-a7e7-fb7feaa39802 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:35.557354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-09702e9c-de7c-4f9d-a7e7-fb7feaa39802 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:35.563743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09702e9c-de7c-4f9d-a7e7-fb7feaa39802 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:35.564207 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09702e9c-de7c-4f9d-a7e7-fb7feaa39802 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:35.564980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09702e9c-de7c-4f9d-a7e7-fb7feaa39802 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:35.565423 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-09702e9c-de7c-4f9d-a7e7-fb7feaa39802 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:35.688738 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-09702e9c-de7c-4f9d-a7e7-fb7feaa39802 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:35.697119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-09702e9c-de7c-4f9d-a7e7-fb7feaa39802 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144349 May 12 07:23:35.697730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1486/3067] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:35 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:36.714002 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-34d8c215-b628-4f4d-88a4-d02092fa8b1c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:36.714637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-34d8c215-b628-4f4d-88a4-d02092fa8b1c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:36.721065 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34d8c215-b628-4f4d-88a4-d02092fa8b1c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:36.721508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34d8c215-b628-4f4d-88a4-d02092fa8b1c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:36.722276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34d8c215-b628-4f4d-88a4-d02092fa8b1c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:36.722706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-34d8c215-b628-4f4d-88a4-d02092fa8b1c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:36.849965 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-34d8c215-b628-4f4d-88a4-d02092fa8b1c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:36.857838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-34d8c215-b628-4f4d-88a4-d02092fa8b1c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147749 May 12 07:23:36.858396 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1582/3068] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:37.874964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7be16adb-9b2b-4011-811f-d7dc5be77ad0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:37.875557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7be16adb-9b2b-4011-811f-d7dc5be77ad0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:37.881842 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7be16adb-9b2b-4011-811f-d7dc5be77ad0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:37.882287 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7be16adb-9b2b-4011-811f-d7dc5be77ad0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:37.883043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7be16adb-9b2b-4011-811f-d7dc5be77ad0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:37.883475 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7be16adb-9b2b-4011-811f-d7dc5be77ad0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:38.010808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7be16adb-9b2b-4011-811f-d7dc5be77ad0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:38.018591 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7be16adb-9b2b-4011-811f-d7dc5be77ad0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147516 May 12 07:23:38.019147 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1487/3069] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:39.036788 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-73631187-dcb4-4a62-a696-3bbe608e7a3a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:39.037398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-73631187-dcb4-4a62-a696-3bbe608e7a3a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:39.043711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73631187-dcb4-4a62-a696-3bbe608e7a3a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:39.044236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73631187-dcb4-4a62-a696-3bbe608e7a3a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:39.045255 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73631187-dcb4-4a62-a696-3bbe608e7a3a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:39.045689 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-73631187-dcb4-4a62-a696-3bbe608e7a3a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:39.172791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-73631187-dcb4-4a62-a696-3bbe608e7a3a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:39.180504 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-73631187-dcb4-4a62-a696-3bbe608e7a3a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147563 May 12 07:23:39.181567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1583/3070] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:40.198116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-909312a4-7045-4441-9e90-9566a00a55ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:40.198725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-909312a4-7045-4441-9e90-9566a00a55ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:40.205086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-909312a4-7045-4441-9e90-9566a00a55ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:40.205532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-909312a4-7045-4441-9e90-9566a00a55ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:40.206290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-909312a4-7045-4441-9e90-9566a00a55ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:40.206722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-909312a4-7045-4441-9e90-9566a00a55ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:40.331880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-909312a4-7045-4441-9e90-9566a00a55ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:40.340069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-909312a4-7045-4441-9e90-9566a00a55ff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145849 May 12 07:23:40.340634 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1488/3071] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:40 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:41.357040 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4759fed5-7a14-4259-9b58-532ee26b5791 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:41.357658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4759fed5-7a14-4259-9b58-532ee26b5791 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:41.363995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4759fed5-7a14-4259-9b58-532ee26b5791 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:41.364460 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4759fed5-7a14-4259-9b58-532ee26b5791 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:41.365231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4759fed5-7a14-4259-9b58-532ee26b5791 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:41.365677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4759fed5-7a14-4259-9b58-532ee26b5791 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:41.491529 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4759fed5-7a14-4259-9b58-532ee26b5791 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:41.500026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4759fed5-7a14-4259-9b58-532ee26b5791 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146848 May 12 07:23:41.500595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1584/3072] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:41 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:42.517199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-710b3c54-633a-494e-aad4-a891e9aa2879 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:42.517819 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-710b3c54-633a-494e-aad4-a891e9aa2879 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:42.524119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-710b3c54-633a-494e-aad4-a891e9aa2879 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:42.524592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-710b3c54-633a-494e-aad4-a891e9aa2879 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:42.525362 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-710b3c54-633a-494e-aad4-a891e9aa2879 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:42.525802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-710b3c54-633a-494e-aad4-a891e9aa2879 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:42.652188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-710b3c54-633a-494e-aad4-a891e9aa2879 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:42.659961 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-710b3c54-633a-494e-aad4-a891e9aa2879 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146662 May 12 07:23:42.660526 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1489/3073] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:42 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:43.677540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e3f07687-5ab3-4007-9f5e-5566299e5ef5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:43.678090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e3f07687-5ab3-4007-9f5e-5566299e5ef5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:43.684498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3f07687-5ab3-4007-9f5e-5566299e5ef5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:43.684995 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3f07687-5ab3-4007-9f5e-5566299e5ef5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:43.685781 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3f07687-5ab3-4007-9f5e-5566299e5ef5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:43.686229 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3f07687-5ab3-4007-9f5e-5566299e5ef5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:43.812143 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e3f07687-5ab3-4007-9f5e-5566299e5ef5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:43.819920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e3f07687-5ab3-4007-9f5e-5566299e5ef5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146292 May 12 07:23:43.820501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1585/3074] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:44.838731 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8253cd7c-a7cd-4373-bb72-20ec8f06e1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:44.839551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8253cd7c-a7cd-4373-bb72-20ec8f06e1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:44.845920 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8253cd7c-a7cd-4373-bb72-20ec8f06e1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:44.846426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8253cd7c-a7cd-4373-bb72-20ec8f06e1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:44.847188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8253cd7c-a7cd-4373-bb72-20ec8f06e1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:44.847620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8253cd7c-a7cd-4373-bb72-20ec8f06e1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:44.974896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8253cd7c-a7cd-4373-bb72-20ec8f06e1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:44.983572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8253cd7c-a7cd-4373-bb72-20ec8f06e1f9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149836 May 12 07:23:44.984161 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1490/3075] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:46.001206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3597507b-05d4-47b0-88a6-59d854bfaf61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:46.001837 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3597507b-05d4-47b0-88a6-59d854bfaf61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:46.008378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3597507b-05d4-47b0-88a6-59d854bfaf61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:46.009406 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3597507b-05d4-47b0-88a6-59d854bfaf61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:46.010196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3597507b-05d4-47b0-88a6-59d854bfaf61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:46.010640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3597507b-05d4-47b0-88a6-59d854bfaf61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:46.134612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3597507b-05d4-47b0-88a6-59d854bfaf61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:46.142359 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3597507b-05d4-47b0-88a6-59d854bfaf61 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145077 May 12 07:23:46.142933 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1586/3076] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:45 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:23:47.159968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-dddf9498-405b-4805-b316-9226b5b23c48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:47.160584 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-dddf9498-405b-4805-b316-9226b5b23c48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:47.166891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dddf9498-405b-4805-b316-9226b5b23c48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:47.167345 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dddf9498-405b-4805-b316-9226b5b23c48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:47.168146 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dddf9498-405b-4805-b316-9226b5b23c48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:47.168587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-dddf9498-405b-4805-b316-9226b5b23c48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:47.295665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-dddf9498-405b-4805-b316-9226b5b23c48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:47.303343 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-dddf9498-405b-4805-b316-9226b5b23c48 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147320 May 12 07:23:47.303938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1491/3077] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:48.320939 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8790b5cb-dd27-4e9a-bc0f-d98611cc5b97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:48.321491 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8790b5cb-dd27-4e9a-bc0f-d98611cc5b97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:48.327835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8790b5cb-dd27-4e9a-bc0f-d98611cc5b97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:48.328294 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8790b5cb-dd27-4e9a-bc0f-d98611cc5b97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:48.329067 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8790b5cb-dd27-4e9a-bc0f-d98611cc5b97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:48.329508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8790b5cb-dd27-4e9a-bc0f-d98611cc5b97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:48.453174 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8790b5cb-dd27-4e9a-bc0f-d98611cc5b97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:48.461019 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8790b5cb-dd27-4e9a-bc0f-d98611cc5b97 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144057 May 12 07:23:48.461593 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1587/3078] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:48 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:49.477561 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b6fd682a-9f7d-4a06-9624-52b35c179b53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:49.478183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b6fd682a-9f7d-4a06-9624-52b35c179b53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:49.484470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6fd682a-9f7d-4a06-9624-52b35c179b53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:49.484915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6fd682a-9f7d-4a06-9624-52b35c179b53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:49.485671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6fd682a-9f7d-4a06-9624-52b35c179b53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:49.486105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b6fd682a-9f7d-4a06-9624-52b35c179b53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:49.609598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b6fd682a-9f7d-4a06-9624-52b35c179b53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:49.617263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b6fd682a-9f7d-4a06-9624-52b35c179b53 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143546 May 12 07:23:49.618329 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1492/3079] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:49 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:23:50.634792 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b0fbf183-a4b0-42e3-aae3-27be3dec3338 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:50.635408 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-b0fbf183-a4b0-42e3-aae3-27be3dec3338 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:50.641749 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b0fbf183-a4b0-42e3-aae3-27be3dec3338 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:50.642212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b0fbf183-a4b0-42e3-aae3-27be3dec3338 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:50.642988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b0fbf183-a4b0-42e3-aae3-27be3dec3338 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:50.643431 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-b0fbf183-a4b0-42e3-aae3-27be3dec3338 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:50.769595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-b0fbf183-a4b0-42e3-aae3-27be3dec3338 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:50.778262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b0fbf183-a4b0-42e3-aae3-27be3dec3338 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147869 May 12 07:23:50.778835 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1588/3080] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:51.795651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-08d32823-799f-423a-8bc0-3507f1749edb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:51.796289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-08d32823-799f-423a-8bc0-3507f1749edb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:51.802542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08d32823-799f-423a-8bc0-3507f1749edb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:51.802985 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08d32823-799f-423a-8bc0-3507f1749edb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:51.803761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08d32823-799f-423a-8bc0-3507f1749edb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:51.804199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-08d32823-799f-423a-8bc0-3507f1749edb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:51.931784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-08d32823-799f-423a-8bc0-3507f1749edb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:51.940112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-08d32823-799f-423a-8bc0-3507f1749edb tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148125 May 12 07:23:51.940957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1493/3081] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:52.958267 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4f8b1385-1e08-4bb4-8b10-b0ce6a2b8d8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:52.958914 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4f8b1385-1e08-4bb4-8b10-b0ce6a2b8d8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:52.965959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f8b1385-1e08-4bb4-8b10-b0ce6a2b8d8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:52.966415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f8b1385-1e08-4bb4-8b10-b0ce6a2b8d8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:52.967206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f8b1385-1e08-4bb4-8b10-b0ce6a2b8d8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:52.967652 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4f8b1385-1e08-4bb4-8b10-b0ce6a2b8d8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:53.093872 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4f8b1385-1e08-4bb4-8b10-b0ce6a2b8d8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:53.101624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4f8b1385-1e08-4bb4-8b10-b0ce6a2b8d8e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147266 May 12 07:23:53.102236 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1589/3082] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:54.118930 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9f61fa7d-d54a-4a42-b6b8-404edbe384f1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:54.119550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9f61fa7d-d54a-4a42-b6b8-404edbe384f1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:54.125966 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f61fa7d-d54a-4a42-b6b8-404edbe384f1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:54.126425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f61fa7d-d54a-4a42-b6b8-404edbe384f1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:54.127194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f61fa7d-d54a-4a42-b6b8-404edbe384f1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:54.127635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9f61fa7d-d54a-4a42-b6b8-404edbe384f1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:54.254210 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9f61fa7d-d54a-4a42-b6b8-404edbe384f1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:54.262382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9f61fa7d-d54a-4a42-b6b8-404edbe384f1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147375 May 12 07:23:54.262938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1494/3083] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:55.279338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ed26649b-0f81-4501-b5b6-8f17c202ee7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:55.279921 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ed26649b-0f81-4501-b5b6-8f17c202ee7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:55.286164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed26649b-0f81-4501-b5b6-8f17c202ee7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:55.286617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed26649b-0f81-4501-b5b6-8f17c202ee7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:55.287387 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed26649b-0f81-4501-b5b6-8f17c202ee7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:55.287865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ed26649b-0f81-4501-b5b6-8f17c202ee7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:55.410501 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ed26649b-0f81-4501-b5b6-8f17c202ee7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:55.418840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ed26649b-0f81-4501-b5b6-8f17c202ee7c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143455 May 12 07:23:55.419409 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1590/3084] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:55 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:56.437092 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6f5e6a75-6ec7-47a6-b0a3-5a191c63d4d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:56.437723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6f5e6a75-6ec7-47a6-b0a3-5a191c63d4d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:56.444079 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f5e6a75-6ec7-47a6-b0a3-5a191c63d4d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:56.444530 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f5e6a75-6ec7-47a6-b0a3-5a191c63d4d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:56.445298 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f5e6a75-6ec7-47a6-b0a3-5a191c63d4d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:56.446365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6f5e6a75-6ec7-47a6-b0a3-5a191c63d4d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:56.571880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6f5e6a75-6ec7-47a6-b0a3-5a191c63d4d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:56.579531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6f5e6a75-6ec7-47a6-b0a3-5a191c63d4d7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146663 May 12 07:23:56.580132 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1495/3085] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:57.595595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-af6fbcb7-e006-477a-a16c-7ae7f7567035 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:57.596254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-af6fbcb7-e006-477a-a16c-7ae7f7567035 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:57.603231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af6fbcb7-e006-477a-a16c-7ae7f7567035 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:57.603700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af6fbcb7-e006-477a-a16c-7ae7f7567035 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:57.604473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af6fbcb7-e006-477a-a16c-7ae7f7567035 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:57.604915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-af6fbcb7-e006-477a-a16c-7ae7f7567035 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:57.728300 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-af6fbcb7-e006-477a-a16c-7ae7f7567035 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:57.736088 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-af6fbcb7-e006-477a-a16c-7ae7f7567035 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144311 May 12 07:23:57.736664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1591/3086] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:58.753150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-eb07c149-0aee-4e7e-8aa6-d384872d41a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:58.753771 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-eb07c149-0aee-4e7e-8aa6-d384872d41a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:58.760155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb07c149-0aee-4e7e-8aa6-d384872d41a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:58.760611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb07c149-0aee-4e7e-8aa6-d384872d41a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:58.761383 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb07c149-0aee-4e7e-8aa6-d384872d41a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:58.761825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb07c149-0aee-4e7e-8aa6-d384872d41a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:58.887376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eb07c149-0aee-4e7e-8aa6-d384872d41a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:23:58.895131 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-eb07c149-0aee-4e7e-8aa6-d384872d41a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145869 May 12 07:23:58.897513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1496/3087] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:23:59.912751 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6475d77e-fab3-4057-bd30-3fe4a461b57d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:23:59.913366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6475d77e-fab3-4057-bd30-3fe4a461b57d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:23:59.920634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6475d77e-fab3-4057-bd30-3fe4a461b57d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:59.921084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6475d77e-fab3-4057-bd30-3fe4a461b57d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:23:59.921888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6475d77e-fab3-4057-bd30-3fe4a461b57d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:23:59.922332 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6475d77e-fab3-4057-bd30-3fe4a461b57d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:00.051089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6475d77e-fab3-4057-bd30-3fe4a461b57d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:00.058918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6475d77e-fab3-4057-bd30-3fe4a461b57d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150023 May 12 07:24:00.059484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1592/3088] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:23:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:01.076169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-fbc49ef2-407a-40fe-92a2-84ef9c28d228 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:01.076784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-fbc49ef2-407a-40fe-92a2-84ef9c28d228 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:01.082768 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fbc49ef2-407a-40fe-92a2-84ef9c28d228 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:01.083229 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fbc49ef2-407a-40fe-92a2-84ef9c28d228 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:01.084022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fbc49ef2-407a-40fe-92a2-84ef9c28d228 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:01.084467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-fbc49ef2-407a-40fe-92a2-84ef9c28d228 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:01.210206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-fbc49ef2-407a-40fe-92a2-84ef9c28d228 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:01.217919 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-fbc49ef2-407a-40fe-92a2-84ef9c28d228 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145648 May 12 07:24:01.218486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1497/3089] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:02.234804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8689fa7c-29eb-4a13-9887-f31164b5380f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:02.235425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8689fa7c-29eb-4a13-9887-f31164b5380f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:02.241730 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8689fa7c-29eb-4a13-9887-f31164b5380f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:02.242181 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8689fa7c-29eb-4a13-9887-f31164b5380f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:02.242951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8689fa7c-29eb-4a13-9887-f31164b5380f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:02.243442 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8689fa7c-29eb-4a13-9887-f31164b5380f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:02.603256 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8689fa7c-29eb-4a13-9887-f31164b5380f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:02.610986 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8689fa7c-29eb-4a13-9887-f31164b5380f tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.380036 May 12 07:24:02.611561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1593/3090] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:03.628204 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3e0ed2e8-c743-45bb-940a-6b3fb691c7a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:03.628831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3e0ed2e8-c743-45bb-940a-6b3fb691c7a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:03.635211 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e0ed2e8-c743-45bb-940a-6b3fb691c7a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:03.641864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e0ed2e8-c743-45bb-940a-6b3fb691c7a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:03.641864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e0ed2e8-c743-45bb-940a-6b3fb691c7a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:03.641864 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3e0ed2e8-c743-45bb-940a-6b3fb691c7a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:03.761987 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3e0ed2e8-c743-45bb-940a-6b3fb691c7a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:03.769743 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3e0ed2e8-c743-45bb-940a-6b3fb691c7a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145552 May 12 07:24:03.770308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1498/3091] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:03 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:04.786334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-04190f33-f17a-4d8d-b5bf-c4e6456ba5f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:04.786951 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-04190f33-f17a-4d8d-b5bf-c4e6456ba5f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:04.793832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04190f33-f17a-4d8d-b5bf-c4e6456ba5f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:04.794286 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04190f33-f17a-4d8d-b5bf-c4e6456ba5f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:04.795372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04190f33-f17a-4d8d-b5bf-c4e6456ba5f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:04.795856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-04190f33-f17a-4d8d-b5bf-c4e6456ba5f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:04.922728 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-04190f33-f17a-4d8d-b5bf-c4e6456ba5f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:04.932102 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-04190f33-f17a-4d8d-b5bf-c4e6456ba5f2 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149646 May 12 07:24:04.932690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1594/3092] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:05.950904 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-564c0fd7-a4ad-4764-830c-ca88363dc135 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:05.951507 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-564c0fd7-a4ad-4764-830c-ca88363dc135 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:06.012087 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-564c0fd7-a4ad-4764-830c-ca88363dc135 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:06.012541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-564c0fd7-a4ad-4764-830c-ca88363dc135 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:06.013338 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-564c0fd7-a4ad-4764-830c-ca88363dc135 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:06.013779 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-564c0fd7-a4ad-4764-830c-ca88363dc135 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:06.200851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-564c0fd7-a4ad-4764-830c-ca88363dc135 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:06.208723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-564c0fd7-a4ad-4764-830c-ca88363dc135 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.261777 May 12 07:24:06.209228 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1499/3093] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:07.225775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0b027a39-ef91-4093-a27a-63d39952ccd0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:07.226433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0b027a39-ef91-4093-a27a-63d39952ccd0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:07.232808 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b027a39-ef91-4093-a27a-63d39952ccd0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:07.233265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b027a39-ef91-4093-a27a-63d39952ccd0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:07.234033 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b027a39-ef91-4093-a27a-63d39952ccd0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:07.234472 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0b027a39-ef91-4093-a27a-63d39952ccd0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:07.360217 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-0b027a39-ef91-4093-a27a-63d39952ccd0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:07.368479 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0b027a39-ef91-4093-a27a-63d39952ccd0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146553 May 12 07:24:07.369052 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1595/3094] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:07 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:08.385328 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ea358580-e638-42dc-9550-31723261e750 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:08.385962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ea358580-e638-42dc-9550-31723261e750 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:08.392430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea358580-e638-42dc-9550-31723261e750 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:08.392877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea358580-e638-42dc-9550-31723261e750 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:08.393637 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea358580-e638-42dc-9550-31723261e750 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:08.394154 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea358580-e638-42dc-9550-31723261e750 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:08.522033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ea358580-e638-42dc-9550-31723261e750 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:08.530496 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ea358580-e638-42dc-9550-31723261e750 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149112 May 12 07:24:08.531069 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1500/3095] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:09.547794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-18f91b43-0333-4a0f-bf9e-4be4da955260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:09.548433 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-18f91b43-0333-4a0f-bf9e-4be4da955260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:09.555339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18f91b43-0333-4a0f-bf9e-4be4da955260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:09.555820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18f91b43-0333-4a0f-bf9e-4be4da955260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:09.556594 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18f91b43-0333-4a0f-bf9e-4be4da955260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:09.557042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-18f91b43-0333-4a0f-bf9e-4be4da955260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:09.682563 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-18f91b43-0333-4a0f-bf9e-4be4da955260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:09.690263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-18f91b43-0333-4a0f-bf9e-4be4da955260 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146615 May 12 07:24:09.690838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1596/3096] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:10.707236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d11987d9-d600-4dfe-ac36-6d25f9cbaecd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:10.707889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d11987d9-d600-4dfe-ac36-6d25f9cbaecd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:10.714359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d11987d9-d600-4dfe-ac36-6d25f9cbaecd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:10.714815 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d11987d9-d600-4dfe-ac36-6d25f9cbaecd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:10.715730 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d11987d9-d600-4dfe-ac36-6d25f9cbaecd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:10.716182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d11987d9-d600-4dfe-ac36-6d25f9cbaecd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:10.840014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d11987d9-d600-4dfe-ac36-6d25f9cbaecd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:10.847786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d11987d9-d600-4dfe-ac36-6d25f9cbaecd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144552 May 12 07:24:10.848358 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1501/3097] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:10 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:11.865241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a5561114-0ade-4029-a57d-a5bdb7db312b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:11.865889 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a5561114-0ade-4029-a57d-a5bdb7db312b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:11.872739 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5561114-0ade-4029-a57d-a5bdb7db312b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:11.873200 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5561114-0ade-4029-a57d-a5bdb7db312b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:11.873968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5561114-0ade-4029-a57d-a5bdb7db312b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:11.874411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5561114-0ade-4029-a57d-a5bdb7db312b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:12.001423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a5561114-0ade-4029-a57d-a5bdb7db312b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:12.009968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a5561114-0ade-4029-a57d-a5bdb7db312b tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148595 May 12 07:24:12.010539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1597/3098] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:11 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:13.027206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-76b578d4-58c4-486b-9ae3-5aa86c5c7886 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:13.027867 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-76b578d4-58c4-486b-9ae3-5aa86c5c7886 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:13.034205 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76b578d4-58c4-486b-9ae3-5aa86c5c7886 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:13.034661 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76b578d4-58c4-486b-9ae3-5aa86c5c7886 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:13.035435 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76b578d4-58c4-486b-9ae3-5aa86c5c7886 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:13.035910 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-76b578d4-58c4-486b-9ae3-5aa86c5c7886 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:13.163976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-76b578d4-58c4-486b-9ae3-5aa86c5c7886 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:13.171956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-76b578d4-58c4-486b-9ae3-5aa86c5c7886 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149214 May 12 07:24:13.172516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1502/3099] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:13 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:14.189759 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e3e17280-fd86-4106-b7a9-a841da4a9bf9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:14.190371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e3e17280-fd86-4106-b7a9-a841da4a9bf9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:14.197209 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3e17280-fd86-4106-b7a9-a841da4a9bf9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:14.197653 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3e17280-fd86-4106-b7a9-a841da4a9bf9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:14.198420 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3e17280-fd86-4106-b7a9-a841da4a9bf9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:14.198856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e3e17280-fd86-4106-b7a9-a841da4a9bf9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:14.322774 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e3e17280-fd86-4106-b7a9-a841da4a9bf9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:14.330526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e3e17280-fd86-4106-b7a9-a841da4a9bf9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144651 May 12 07:24:14.331094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1598/3100] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:14 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:15.347877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-abdfe392-684b-4e2c-95b4-5f3917ff3df3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:15.348454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-abdfe392-684b-4e2c-95b4-5f3917ff3df3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:15.354732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-abdfe392-684b-4e2c-95b4-5f3917ff3df3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:15.355183 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-abdfe392-684b-4e2c-95b4-5f3917ff3df3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:15.355967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-abdfe392-684b-4e2c-95b4-5f3917ff3df3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:15.356403 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-abdfe392-684b-4e2c-95b4-5f3917ff3df3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:15.497829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-abdfe392-684b-4e2c-95b4-5f3917ff3df3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:15.505995 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-abdfe392-684b-4e2c-95b4-5f3917ff3df3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.162118 May 12 07:24:15.506554 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1503/3101] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:15 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:16.524090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7bb3d925-a009-4c77-8dea-174ee73d36a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:16.524704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7bb3d925-a009-4c77-8dea-174ee73d36a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:16.531013 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bb3d925-a009-4c77-8dea-174ee73d36a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:16.531465 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bb3d925-a009-4c77-8dea-174ee73d36a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:16.532265 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bb3d925-a009-4c77-8dea-174ee73d36a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:16.532710 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7bb3d925-a009-4c77-8dea-174ee73d36a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:16.658538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7bb3d925-a009-4c77-8dea-174ee73d36a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:16.666712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7bb3d925-a009-4c77-8dea-174ee73d36a5 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146494 May 12 07:24:16.667276 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1599/3102] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:16 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:17.683994 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8cf2abfb-3299-4ccc-893a-6c8b5143f313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:17.684571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8cf2abfb-3299-4ccc-893a-6c8b5143f313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:17.690791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8cf2abfb-3299-4ccc-893a-6c8b5143f313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:17.691241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8cf2abfb-3299-4ccc-893a-6c8b5143f313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:17.692024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8cf2abfb-3299-4ccc-893a-6c8b5143f313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:17.692461 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8cf2abfb-3299-4ccc-893a-6c8b5143f313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:17.817022 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8cf2abfb-3299-4ccc-893a-6c8b5143f313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:17.825239 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8cf2abfb-3299-4ccc-893a-6c8b5143f313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145177 May 12 07:24:17.825795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1504/3103] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:17 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:18.842637 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-85dd9686-6937-46ba-b3b0-9c34c5ce0a16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:18.843289 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-85dd9686-6937-46ba-b3b0-9c34c5ce0a16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:18.849909 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85dd9686-6937-46ba-b3b0-9c34c5ce0a16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:18.850392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85dd9686-6937-46ba-b3b0-9c34c5ce0a16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:18.851173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85dd9686-6937-46ba-b3b0-9c34c5ce0a16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:18.851613 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-85dd9686-6937-46ba-b3b0-9c34c5ce0a16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:18.981885 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-85dd9686-6937-46ba-b3b0-9c34c5ce0a16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:18.989754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-85dd9686-6937-46ba-b3b0-9c34c5ce0a16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150964 May 12 07:24:18.990577 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1600/3104] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:18 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:20.007667 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-918bcb97-8850-4acb-ad89-2970a3896950 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:20.008306 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-918bcb97-8850-4acb-ad89-2970a3896950 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:20.015046 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-918bcb97-8850-4acb-ad89-2970a3896950 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:20.015492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-918bcb97-8850-4acb-ad89-2970a3896950 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:20.016282 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-918bcb97-8850-4acb-ad89-2970a3896950 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:20.016719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-918bcb97-8850-4acb-ad89-2970a3896950 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:20.142736 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-918bcb97-8850-4acb-ad89-2970a3896950 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:20.150975 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-918bcb97-8850-4acb-ad89-2970a3896950 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147365 May 12 07:24:20.151546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1505/3105] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:20 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:21.169559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bd8d327b-2175-458a-ad9c-30382f703c0a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:21.170180 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bd8d327b-2175-458a-ad9c-30382f703c0a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:21.176524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd8d327b-2175-458a-ad9c-30382f703c0a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:21.176979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd8d327b-2175-458a-ad9c-30382f703c0a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:21.177750 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd8d327b-2175-458a-ad9c-30382f703c0a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:21.178193 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bd8d327b-2175-458a-ad9c-30382f703c0a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:21.303313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bd8d327b-2175-458a-ad9c-30382f703c0a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:21.311647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bd8d327b-2175-458a-ad9c-30382f703c0a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146254 May 12 07:24:21.312245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1601/3106] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:21 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:22.328932 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cd1c4ec9-27ea-4386-b91b-b6d79469e0e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:22.329478 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cd1c4ec9-27ea-4386-b91b-b6d79469e0e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:22.335679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd1c4ec9-27ea-4386-b91b-b6d79469e0e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:22.336153 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd1c4ec9-27ea-4386-b91b-b6d79469e0e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:22.336907 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd1c4ec9-27ea-4386-b91b-b6d79469e0e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:22.337344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cd1c4ec9-27ea-4386-b91b-b6d79469e0e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:22.461220 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cd1c4ec9-27ea-4386-b91b-b6d79469e0e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:22.469076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cd1c4ec9-27ea-4386-b91b-b6d79469e0e3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144083 May 12 07:24:22.469635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1506/3107] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:22 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:23.486934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-609f53a1-e260-42ad-888e-063e89b66bb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:23.487543 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-609f53a1-e260-42ad-888e-063e89b66bb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:23.493473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-609f53a1-e260-42ad-888e-063e89b66bb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:23.493919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-609f53a1-e260-42ad-888e-063e89b66bb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:23.494681 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-609f53a1-e260-42ad-888e-063e89b66bb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:23.495119 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-609f53a1-e260-42ad-888e-063e89b66bb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:23.620780 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-609f53a1-e260-42ad-888e-063e89b66bb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:23.630345 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-609f53a1-e260-42ad-888e-063e89b66bb9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147391 May 12 07:24:23.630919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1602/3108] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:23 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:24.647831 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-85149a98-715f-4724-9c08-9ed98e73f1bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:24.677795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-85149a98-715f-4724-9c08-9ed98e73f1bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:24.677795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85149a98-715f-4724-9c08-9ed98e73f1bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:24.677795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85149a98-715f-4724-9c08-9ed98e73f1bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:24.677795 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85149a98-715f-4724-9c08-9ed98e73f1bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:24.678226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-85149a98-715f-4724-9c08-9ed98e73f1bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:24.785770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-85149a98-715f-4724-9c08-9ed98e73f1bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:24.794541 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-85149a98-715f-4724-9c08-9ed98e73f1bd tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150167 May 12 07:24:24.795121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1507/3109] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:24 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:25.812042 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9b1cdc0c-9d5f-47f9-960a-b58ab157077c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:25.812658 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9b1cdc0c-9d5f-47f9-960a-b58ab157077c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:25.819121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b1cdc0c-9d5f-47f9-960a-b58ab157077c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:25.819582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b1cdc0c-9d5f-47f9-960a-b58ab157077c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:25.820377 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b1cdc0c-9d5f-47f9-960a-b58ab157077c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:25.820820 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9b1cdc0c-9d5f-47f9-960a-b58ab157077c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:25.945037 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9b1cdc0c-9d5f-47f9-960a-b58ab157077c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:25.953135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9b1cdc0c-9d5f-47f9-960a-b58ab157077c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144957 May 12 07:24:25.953713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1603/3110] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:25 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:27.031382 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-b13d016d-f077-4279-aaa0-582015a88381 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:27.032028 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-b13d016d-f077-4279-aaa0-582015a88381 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:27.037899 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b13d016d-f077-4279-aaa0-582015a88381 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:27.038350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b13d016d-f077-4279-aaa0-582015a88381 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:27.039112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b13d016d-f077-4279-aaa0-582015a88381 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:27.039551 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-b13d016d-f077-4279-aaa0-582015a88381 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:27.166882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-b13d016d-f077-4279-aaa0-582015a88381 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:27.174851 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-b13d016d-f077-4279-aaa0-582015a88381 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.209015 May 12 07:24:27.175418 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1508/3111] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:26 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:28.191714 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f56e0d25-cdd4-460f-a0fa-f4ca1f13e544 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:28.192327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f56e0d25-cdd4-460f-a0fa-f4ca1f13e544 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:28.199081 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f56e0d25-cdd4-460f-a0fa-f4ca1f13e544 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:28.199528 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f56e0d25-cdd4-460f-a0fa-f4ca1f13e544 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:28.200309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f56e0d25-cdd4-460f-a0fa-f4ca1f13e544 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:28.200748 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f56e0d25-cdd4-460f-a0fa-f4ca1f13e544 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:28.323910 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f56e0d25-cdd4-460f-a0fa-f4ca1f13e544 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:28.331519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f56e0d25-cdd4-460f-a0fa-f4ca1f13e544 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143658 May 12 07:24:28.332123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1604/3112] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:28 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:29.348516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c0498caf-e840-4ed7-8e11-188a2ef62c72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:29.349082 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c0498caf-e840-4ed7-8e11-188a2ef62c72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:29.355953 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c0498caf-e840-4ed7-8e11-188a2ef62c72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:29.356416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c0498caf-e840-4ed7-8e11-188a2ef62c72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:29.357186 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c0498caf-e840-4ed7-8e11-188a2ef62c72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:29.357627 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c0498caf-e840-4ed7-8e11-188a2ef62c72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:29.484885 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c0498caf-e840-4ed7-8e11-188a2ef62c72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:29.492572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c0498caf-e840-4ed7-8e11-188a2ef62c72 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.148110 May 12 07:24:29.493151 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1509/3113] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:29 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:30.508831 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6797fd79-13be-4c55-8acd-9975fb8b4427 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:30.509439 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-6797fd79-13be-4c55-8acd-9975fb8b4427 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:30.515680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6797fd79-13be-4c55-8acd-9975fb8b4427 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:30.516154 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6797fd79-13be-4c55-8acd-9975fb8b4427 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:30.516918 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6797fd79-13be-4c55-8acd-9975fb8b4427 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:30.517355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-6797fd79-13be-4c55-8acd-9975fb8b4427 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:30.646905 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-6797fd79-13be-4c55-8acd-9975fb8b4427 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:30.655096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6797fd79-13be-4c55-8acd-9975fb8b4427 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150128 May 12 07:24:30.655657 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1605/3114] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:30 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:31.672443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7cd9d95f-ed4a-4302-9d42-9d979fbf6e05 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:31.673058 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7cd9d95f-ed4a-4302-9d42-9d979fbf6e05 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:31.679262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7cd9d95f-ed4a-4302-9d42-9d979fbf6e05 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:31.679744 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7cd9d95f-ed4a-4302-9d42-9d979fbf6e05 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:31.680532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7cd9d95f-ed4a-4302-9d42-9d979fbf6e05 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:31.681632 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7cd9d95f-ed4a-4302-9d42-9d979fbf6e05 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:31.803565 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7cd9d95f-ed4a-4302-9d42-9d979fbf6e05 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:31.811977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7cd9d95f-ed4a-4302-9d42-9d979fbf6e05 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143791 May 12 07:24:31.812544 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1510/3115] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:31 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:32.828816 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-67f4ef86-644f-4c77-ab91-5f8e41e792f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:32.829426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-67f4ef86-644f-4c77-ab91-5f8e41e792f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:32.835680 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67f4ef86-644f-4c77-ab91-5f8e41e792f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:32.836226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67f4ef86-644f-4c77-ab91-5f8e41e792f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:32.836992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67f4ef86-644f-4c77-ab91-5f8e41e792f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:32.837427 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-67f4ef86-644f-4c77-ab91-5f8e41e792f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:32.966371 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-67f4ef86-644f-4c77-ab91-5f8e41e792f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:32.974120 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-67f4ef86-644f-4c77-ab91-5f8e41e792f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149162 May 12 07:24:32.974721 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1606/3116] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:32 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:33.990226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d0e24ae5-0017-45b6-b1b6-1affdbaf34c1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:33.990843 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d0e24ae5-0017-45b6-b1b6-1affdbaf34c1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:33.997140 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0e24ae5-0017-45b6-b1b6-1affdbaf34c1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:33.997588 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0e24ae5-0017-45b6-b1b6-1affdbaf34c1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:33.998354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0e24ae5-0017-45b6-b1b6-1affdbaf34c1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:33.998786 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d0e24ae5-0017-45b6-b1b6-1affdbaf34c1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:34.122609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d0e24ae5-0017-45b6-b1b6-1affdbaf34c1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:34.133308 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d0e24ae5-0017-45b6-b1b6-1affdbaf34c1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146653 May 12 07:24:34.134353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1511/3117] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:33 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:35.150734 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f8c3ae52-5494-4c5e-ac8b-2fa8af81d78d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:35.151347 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f8c3ae52-5494-4c5e-ac8b-2fa8af81d78d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:35.157603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8c3ae52-5494-4c5e-ac8b-2fa8af81d78d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:35.158054 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8c3ae52-5494-4c5e-ac8b-2fa8af81d78d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:35.158818 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8c3ae52-5494-4c5e-ac8b-2fa8af81d78d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:35.159259 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f8c3ae52-5494-4c5e-ac8b-2fa8af81d78d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:35.286021 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f8c3ae52-5494-4c5e-ac8b-2fa8af81d78d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:35.293667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f8c3ae52-5494-4c5e-ac8b-2fa8af81d78d tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146761 May 12 07:24:35.294480 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1607/3118] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:35 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:36.310364 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-199c5580-8a98-4c21-a5db-be40236140ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:36.310980 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-199c5580-8a98-4c21-a5db-be40236140ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:36.317357 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-199c5580-8a98-4c21-a5db-be40236140ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:36.317808 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-199c5580-8a98-4c21-a5db-be40236140ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:36.318605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-199c5580-8a98-4c21-a5db-be40236140ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:36.319043 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-199c5580-8a98-4c21-a5db-be40236140ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:36.442572 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-199c5580-8a98-4c21-a5db-be40236140ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:36.450704 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-199c5580-8a98-4c21-a5db-be40236140ec tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144222 May 12 07:24:36.451262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1512/3119] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:36 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:37.467123 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-399c7ce8-ee3b-4193-aedd-994711e7a9f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:37.467768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-399c7ce8-ee3b-4193-aedd-994711e7a9f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:37.474070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-399c7ce8-ee3b-4193-aedd-994711e7a9f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:37.474520 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-399c7ce8-ee3b-4193-aedd-994711e7a9f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:37.475295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-399c7ce8-ee3b-4193-aedd-994711e7a9f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:37.475760 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-399c7ce8-ee3b-4193-aedd-994711e7a9f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:37.603195 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-399c7ce8-ee3b-4193-aedd-994711e7a9f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:37.610864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-399c7ce8-ee3b-4193-aedd-994711e7a9f3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.147575 May 12 07:24:37.611430 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1608/3120] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:37 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:38.628437 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-723716cc-bc0c-4a9e-a2a3-38930f971f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:38.628982 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-723716cc-bc0c-4a9e-a2a3-38930f971f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:38.635877 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-723716cc-bc0c-4a9e-a2a3-38930f971f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:38.636336 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-723716cc-bc0c-4a9e-a2a3-38930f971f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:38.637109 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-723716cc-bc0c-4a9e-a2a3-38930f971f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:38.637550 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-723716cc-bc0c-4a9e-a2a3-38930f971f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:38.761964 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-723716cc-bc0c-4a9e-a2a3-38930f971f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:38.769722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-723716cc-bc0c-4a9e-a2a3-38930f971f06 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145338 May 12 07:24:38.770301 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1513/3121] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:38 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:39.787199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fb152a68-38a0-4d6e-a93a-467dbf1e58a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:39.787840 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fb152a68-38a0-4d6e-a93a-467dbf1e58a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:39.794151 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb152a68-38a0-4d6e-a93a-467dbf1e58a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:39.794848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb152a68-38a0-4d6e-a93a-467dbf1e58a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:39.795610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb152a68-38a0-4d6e-a93a-467dbf1e58a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:39.796071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb152a68-38a0-4d6e-a93a-467dbf1e58a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:39.931640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fb152a68-38a0-4d6e-a93a-467dbf1e58a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:39.939467 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fb152a68-38a0-4d6e-a93a-467dbf1e58a3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.156073 May 12 07:24:39.940070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1609/3122] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:39 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:40.957529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a9d22cb6-e987-4bb9-9880-8cbb1f0f8cff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:40.958168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a9d22cb6-e987-4bb9-9880-8cbb1f0f8cff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:40.965300 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9d22cb6-e987-4bb9-9880-8cbb1f0f8cff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:40.965754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9d22cb6-e987-4bb9-9880-8cbb1f0f8cff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:40.966531 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9d22cb6-e987-4bb9-9880-8cbb1f0f8cff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:40.966968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a9d22cb6-e987-4bb9-9880-8cbb1f0f8cff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:41.098283 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a9d22cb6-e987-4bb9-9880-8cbb1f0f8cff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:41.106222 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a9d22cb6-e987-4bb9-9880-8cbb1f0f8cff tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.152677 May 12 07:24:41.108036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1514/3123] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:40 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:42.123869 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dafa4ebe-8576-4337-87bb-f8cf66569f49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:42.124480 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dafa4ebe-8576-4337-87bb-f8cf66569f49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:42.130763 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dafa4ebe-8576-4337-87bb-f8cf66569f49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:42.131219 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dafa4ebe-8576-4337-87bb-f8cf66569f49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:42.132018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dafa4ebe-8576-4337-87bb-f8cf66569f49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:42.132459 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-dafa4ebe-8576-4337-87bb-f8cf66569f49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:42.256383 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dafa4ebe-8576-4337-87bb-f8cf66569f49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:42.264125 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dafa4ebe-8576-4337-87bb-f8cf66569f49 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144144 May 12 07:24:42.264706 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1610/3124] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:42 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:43.280800 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e633ab97-06b3-40d8-80e9-9577b0e1cf1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:43.281337 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e633ab97-06b3-40d8-80e9-9577b0e1cf1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:43.287556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e633ab97-06b3-40d8-80e9-9577b0e1cf1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:43.288030 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e633ab97-06b3-40d8-80e9-9577b0e1cf1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:43.288784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e633ab97-06b3-40d8-80e9-9577b0e1cf1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:43.289216 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e633ab97-06b3-40d8-80e9-9577b0e1cf1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:43.415286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-e633ab97-06b3-40d8-80e9-9577b0e1cf1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:43.423173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e633ab97-06b3-40d8-80e9-9577b0e1cf1e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146275 May 12 07:24:43.423759 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1515/3125] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:43 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:44.439216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-27151ed5-ae37-4e82-8783-f212e13b7f58 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:44.439864 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-27151ed5-ae37-4e82-8783-f212e13b7f58 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:44.446091 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27151ed5-ae37-4e82-8783-f212e13b7f58 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:44.446540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27151ed5-ae37-4e82-8783-f212e13b7f58 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:44.447301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27151ed5-ae37-4e82-8783-f212e13b7f58 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:44.447768 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-27151ed5-ae37-4e82-8783-f212e13b7f58 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:44.572860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-27151ed5-ae37-4e82-8783-f212e13b7f58 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:44.580799 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-27151ed5-ae37-4e82-8783-f212e13b7f58 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145494 May 12 07:24:44.581378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1611/3126] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:44 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:45.597853 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ae28d0fc-b299-4c4b-b78e-7bf4ceca3334 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:45.598467 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ae28d0fc-b299-4c4b-b78e-7bf4ceca3334 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:45.605454 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae28d0fc-b299-4c4b-b78e-7bf4ceca3334 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:45.605906 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae28d0fc-b299-4c4b-b78e-7bf4ceca3334 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:45.606680 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae28d0fc-b299-4c4b-b78e-7bf4ceca3334 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:45.607119 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ae28d0fc-b299-4c4b-b78e-7bf4ceca3334 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:45.730934 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ae28d0fc-b299-4c4b-b78e-7bf4ceca3334 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:45.738667 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ae28d0fc-b299-4c4b-b78e-7bf4ceca3334 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144694 May 12 07:24:45.739231 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1516/3127] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:45 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:46.755773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2dbd3647-f735-4f53-a892-bfa9f9ddf273 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:46.756386 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2dbd3647-f735-4f53-a892-bfa9f9ddf273 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:46.763135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2dbd3647-f735-4f53-a892-bfa9f9ddf273 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:46.763582 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2dbd3647-f735-4f53-a892-bfa9f9ddf273 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:46.764373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2dbd3647-f735-4f53-a892-bfa9f9ddf273 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:46.764807 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2dbd3647-f735-4f53-a892-bfa9f9ddf273 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:46.894777 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2dbd3647-f735-4f53-a892-bfa9f9ddf273 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:46.903150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2dbd3647-f735-4f53-a892-bfa9f9ddf273 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.151178 May 12 07:24:46.903745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1612/3128] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:46 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:47.921127 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8354c20a-82f1-4183-86b4-4c2835ce5d3e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:47.921775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8354c20a-82f1-4183-86b4-4c2835ce5d3e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:47.928150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8354c20a-82f1-4183-86b4-4c2835ce5d3e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:47.928604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8354c20a-82f1-4183-86b4-4c2835ce5d3e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:47.929370 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8354c20a-82f1-4183-86b4-4c2835ce5d3e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:47.929813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8354c20a-82f1-4183-86b4-4c2835ce5d3e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:48.053863 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8354c20a-82f1-4183-86b4-4c2835ce5d3e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:48.061854 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8354c20a-82f1-4183-86b4-4c2835ce5d3e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144867 May 12 07:24:48.062421 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1517/3129] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:47 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:49.078822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9c821134-68b8-493c-80c2-a773bc52b542 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:49.079440 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9c821134-68b8-493c-80c2-a773bc52b542 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:49.085937 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c821134-68b8-493c-80c2-a773bc52b542 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:49.086390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c821134-68b8-493c-80c2-a773bc52b542 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:49.087168 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c821134-68b8-493c-80c2-a773bc52b542 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:49.087610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9c821134-68b8-493c-80c2-a773bc52b542 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:49.213555 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9c821134-68b8-493c-80c2-a773bc52b542 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:49.221279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9c821134-68b8-493c-80c2-a773bc52b542 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146327 May 12 07:24:49.221848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1613/3130] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:49 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:50.238281 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-19c6f667-ea1c-4f20-8422-fa45ab40b313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:50.238914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-19c6f667-ea1c-4f20-8422-fa45ab40b313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:50.245838 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19c6f667-ea1c-4f20-8422-fa45ab40b313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:50.246229 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19c6f667-ea1c-4f20-8422-fa45ab40b313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:50.246988 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19c6f667-ea1c-4f20-8422-fa45ab40b313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:50.247419 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19c6f667-ea1c-4f20-8422-fa45ab40b313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:50.371787 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-19c6f667-ea1c-4f20-8422-fa45ab40b313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:50.379534 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-19c6f667-ea1c-4f20-8422-fa45ab40b313 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145176 May 12 07:24:50.385249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1518/3131] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:50 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:51.397576 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-985f6e03-bd3d-4e04-8b92-eaff9f918f17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:51.398142 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-985f6e03-bd3d-4e04-8b92-eaff9f918f17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:51.404611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-985f6e03-bd3d-4e04-8b92-eaff9f918f17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:51.405071 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-985f6e03-bd3d-4e04-8b92-eaff9f918f17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:51.405841 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-985f6e03-bd3d-4e04-8b92-eaff9f918f17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:51.406283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-985f6e03-bd3d-4e04-8b92-eaff9f918f17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:51.531527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-985f6e03-bd3d-4e04-8b92-eaff9f918f17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:51.539309 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-985f6e03-bd3d-4e04-8b92-eaff9f918f17 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145948 May 12 07:24:51.539900 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1614/3132] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:51 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:52.556535 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8bfc5746-f251-4832-8f0e-ccc91b64115a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:52.557150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8bfc5746-f251-4832-8f0e-ccc91b64115a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:52.563505 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8bfc5746-f251-4832-8f0e-ccc91b64115a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:52.563983 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8bfc5746-f251-4832-8f0e-ccc91b64115a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:52.564750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8bfc5746-f251-4832-8f0e-ccc91b64115a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:52.565193 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8bfc5746-f251-4832-8f0e-ccc91b64115a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:52.689448 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8bfc5746-f251-4832-8f0e-ccc91b64115a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:52.697773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8bfc5746-f251-4832-8f0e-ccc91b64115a tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145125 May 12 07:24:52.698340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1519/3133] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:52 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:53.714301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9a27d5ac-a606-4cbc-9a02-07ce8015fadc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:53.714862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9a27d5ac-a606-4cbc-9a02-07ce8015fadc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:53.721197 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a27d5ac-a606-4cbc-9a02-07ce8015fadc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:53.721645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a27d5ac-a606-4cbc-9a02-07ce8015fadc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:53.722414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a27d5ac-a606-4cbc-9a02-07ce8015fadc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:53.722856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9a27d5ac-a606-4cbc-9a02-07ce8015fadc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:53.847556 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9a27d5ac-a606-4cbc-9a02-07ce8015fadc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:53.856211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9a27d5ac-a606-4cbc-9a02-07ce8015fadc tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145855 May 12 07:24:53.856851 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1615/3134] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:53 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:54.873880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-66b180cd-ff95-46fc-9cfd-4660f417890c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:54.874532 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-66b180cd-ff95-46fc-9cfd-4660f417890c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:54.880912 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66b180cd-ff95-46fc-9cfd-4660f417890c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:54.881394 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66b180cd-ff95-46fc-9cfd-4660f417890c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:54.882168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66b180cd-ff95-46fc-9cfd-4660f417890c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:54.882604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-66b180cd-ff95-46fc-9cfd-4660f417890c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:55.014595 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-66b180cd-ff95-46fc-9cfd-4660f417890c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:55.022268 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-66b180cd-ff95-46fc-9cfd-4660f417890c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.152246 May 12 07:24:55.022835 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1520/3135] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:54 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:56.040791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-00d6a106-5db4-42d2-a304-4374661e3818 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:56.041428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-00d6a106-5db4-42d2-a304-4374661e3818 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:56.047969 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00d6a106-5db4-42d2-a304-4374661e3818 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:56.048423 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00d6a106-5db4-42d2-a304-4374661e3818 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:56.049196 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00d6a106-5db4-42d2-a304-4374661e3818 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:56.049645 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-00d6a106-5db4-42d2-a304-4374661e3818 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:56.176994 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-00d6a106-5db4-42d2-a304-4374661e3818 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:56.185339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-00d6a106-5db4-42d2-a304-4374661e3818 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149435 May 12 07:24:56.185894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1616/3136] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:56 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:57.202440 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ee52fdac-8363-4d01-8b1e-dca329c7670c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:57.203084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ee52fdac-8363-4d01-8b1e-dca329c7670c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:57.209375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee52fdac-8363-4d01-8b1e-dca329c7670c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:57.209825 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee52fdac-8363-4d01-8b1e-dca329c7670c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:57.210590 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee52fdac-8363-4d01-8b1e-dca329c7670c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:57.211665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ee52fdac-8363-4d01-8b1e-dca329c7670c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:57.337546 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-ee52fdac-8363-4d01-8b1e-dca329c7670c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:57.345269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ee52fdac-8363-4d01-8b1e-dca329c7670c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146762 May 12 07:24:57.345836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1521/3137] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:57 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:58.361609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c37c6655-8a6e-434c-93a5-8f01e29b0811 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:58.362157 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c37c6655-8a6e-434c-93a5-8f01e29b0811 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:58.368627 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c37c6655-8a6e-434c-93a5-8f01e29b0811 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:58.369077 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c37c6655-8a6e-434c-93a5-8f01e29b0811 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:58.369862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c37c6655-8a6e-434c-93a5-8f01e29b0811 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:58.370295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c37c6655-8a6e-434c-93a5-8f01e29b0811 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:58.493169 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c37c6655-8a6e-434c-93a5-8f01e29b0811 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:58.500945 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c37c6655-8a6e-434c-93a5-8f01e29b0811 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143251 May 12 07:24:58.501519 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1617/3138] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:58 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:24:59.517700 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-6be6093f-393a-40d8-ae17-66c381181148 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:24:59.518314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-6be6093f-393a-40d8-ae17-66c381181148 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:24:59.524719 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6be6093f-393a-40d8-ae17-66c381181148 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:59.525173 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6be6093f-393a-40d8-ae17-66c381181148 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:59.525938 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6be6093f-393a-40d8-ae17-66c381181148 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:24:59.526375 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-6be6093f-393a-40d8-ae17-66c381181148 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:24:59.650326 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-6be6093f-393a-40d8-ae17-66c381181148 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:24:59.658017 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-6be6093f-393a-40d8-ae17-66c381181148 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.144196 May 12 07:24:59.658582 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1522/3139] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:24:59 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:25:00.675707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e9d97dbe-c2a4-4ca7-bf0c-59dd20310795 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:25:00.676336 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e9d97dbe-c2a4-4ca7-bf0c-59dd20310795 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:25:00.683021 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e9d97dbe-c2a4-4ca7-bf0c-59dd20310795 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:00.683826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e9d97dbe-c2a4-4ca7-bf0c-59dd20310795 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:00.684262 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e9d97dbe-c2a4-4ca7-bf0c-59dd20310795 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:00.684699 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e9d97dbe-c2a4-4ca7-bf0c-59dd20310795 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:00.813833 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e9d97dbe-c2a4-4ca7-bf0c-59dd20310795 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:25:00.822127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e9d97dbe-c2a4-4ca7-bf0c-59dd20310795 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.150306 May 12 07:25:00.822688 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1618/3140] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:25:00 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:25:01.838932 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-5dfdfe5a-0c85-4169-b556-c26021b711aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:25:01.839543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-5dfdfe5a-0c85-4169-b556-c26021b711aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:25:01.845470 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dfdfe5a-0c85-4169-b556-c26021b711aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:01.845914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dfdfe5a-0c85-4169-b556-c26021b711aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:01.846672 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dfdfe5a-0c85-4169-b556-c26021b711aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:01.847107 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-5dfdfe5a-0c85-4169-b556-c26021b711aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:01.971648 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-5dfdfe5a-0c85-4169-b556-c26021b711aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:25:01.979556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-5dfdfe5a-0c85-4169-b556-c26021b711aa tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145192 May 12 07:25:01.980150 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1523/3141] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:25:01 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:25:02.997281 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-5e2563e0-092a-4465-b426-d71f3455edb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:25:02.997906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-5e2563e0-092a-4465-b426-d71f3455edb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:25:03.004375 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e2563e0-092a-4465-b426-d71f3455edb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:03.004832 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e2563e0-092a-4465-b426-d71f3455edb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:03.005614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e2563e0-092a-4465-b426-d71f3455edb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:03.006060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-5e2563e0-092a-4465-b426-d71f3455edb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:03.136794 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-5e2563e0-092a-4465-b426-d71f3455edb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:25:03.144666 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-5e2563e0-092a-4465-b426-d71f3455edb8 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.151303 May 12 07:25:03.145242 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1619/3142] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:25:02 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:25:04.161260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-716a1812-9d59-4793-8030-622e8910705c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:25:04.161869 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-716a1812-9d59-4793-8030-622e8910705c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:25:04.168169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-716a1812-9d59-4793-8030-622e8910705c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:04.168620 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-716a1812-9d59-4793-8030-622e8910705c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:04.169630 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-716a1812-9d59-4793-8030-622e8910705c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:04.170066 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-716a1812-9d59-4793-8030-622e8910705c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:04.292276 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-716a1812-9d59-4793-8030-622e8910705c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:25:04.300103 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-716a1812-9d59-4793-8030-622e8910705c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.142654 May 12 07:25:04.300674 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1524/3143] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:25:04 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:25:05.318247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a3db3c89-c22d-4fb2-b1c7-23a65b8a4848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:25:05.318862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a3db3c89-c22d-4fb2-b1c7-23a65b8a4848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:25:05.325696 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3db3c89-c22d-4fb2-b1c7-23a65b8a4848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:05.326147 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3db3c89-c22d-4fb2-b1c7-23a65b8a4848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:05.326919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3db3c89-c22d-4fb2-b1c7-23a65b8a4848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:05.327358 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a3db3c89-c22d-4fb2-b1c7-23a65b8a4848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:05.455063 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a3db3c89-c22d-4fb2-b1c7-23a65b8a4848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:25:05.463586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a3db3c89-c22d-4fb2-b1c7-23a65b8a4848 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.149223 May 12 07:25:05.464188 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1620/3144] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:25:05 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:25:06.481236 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-49e74fbc-95dd-402e-84de-920e76ba2e5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:25:06.481791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-49e74fbc-95dd-402e-84de-920e76ba2e5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:25:06.488229 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49e74fbc-95dd-402e-84de-920e76ba2e5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:06.488680 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49e74fbc-95dd-402e-84de-920e76ba2e5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:06.489443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49e74fbc-95dd-402e-84de-920e76ba2e5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:06.489880 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-49e74fbc-95dd-402e-84de-920e76ba2e5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:06.614499 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-49e74fbc-95dd-402e-84de-920e76ba2e5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:25:06.622608 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-49e74fbc-95dd-402e-84de-920e76ba2e5e tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.145263 May 12 07:25:06.623182 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1525/3145] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:25:06 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:25:07.639581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3ba472b0-4d15-45be-b9d7-2f3264e778a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:25:07.640218 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3ba472b0-4d15-45be-b9d7-2f3264e778a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:25:07.646509 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ba472b0-4d15-45be-b9d7-2f3264e778a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:07.646959 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ba472b0-4d15-45be-b9d7-2f3264e778a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:07.647744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ba472b0-4d15-45be-b9d7-2f3264e778a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:07.648805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3ba472b0-4d15-45be-b9d7-2f3264e778a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:07.770920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3ba472b0-4d15-45be-b9d7-2f3264e778a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:25:07.779225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3ba472b0-4d15-45be-b9d7-2f3264e778a1 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.143426 May 12 07:25:07.779817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1621/3146] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:25:07 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:25:08.796199 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-39822e2d-abb5-4329-b814-a36174896be4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:25:08.796813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-39822e2d-abb5-4329-b814-a36174896be4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:25:08.803081 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39822e2d-abb5-4329-b814-a36174896be4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:08.803525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39822e2d-abb5-4329-b814-a36174896be4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:08.804410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39822e2d-abb5-4329-b814-a36174896be4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:08.804849 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-39822e2d-abb5-4329-b814-a36174896be4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:08.931269 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-39822e2d-abb5-4329-b814-a36174896be4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:25:08.939008 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-39822e2d-abb5-4329-b814-a36174896be4 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.146921 May 12 07:25:08.939573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1526/3147] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:25:08 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:25:09.955537 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d14ef672-47ee-45fb-96ae-ce661ca79ca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:25:09.956188 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d14ef672-47ee-45fb-96ae-ce661ca79ca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:25:09.963602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d14ef672-47ee-45fb-96ae-ce661ca79ca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:09.964101 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d14ef672-47ee-45fb-96ae-ce661ca79ca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:09.964898 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d14ef672-47ee-45fb-96ae-ce661ca79ca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:09.965348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d14ef672-47ee-45fb-96ae-ce661ca79ca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:10.048651 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:25:10.053625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:25:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:25:10.098513 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-d14ef672-47ee-45fb-96ae-ce661ca79ca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:25:10.106700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d14ef672-47ee-45fb-96ae-ce661ca79ca9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106" status: 200 len: 1736 microversion: 2.1 time: 0.155112 May 12 07:25:10.107279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1622/3148] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:25:09 2022] GET /compute/v2.1/servers/d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:25:10.122754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e31d4282-0956-4740-8871-f6a6234efcd7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '.version_select at 0x7f89da2f8af0>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:25:10.191797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e31d4282-0956-4740-8871-f6a6234efcd7 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071890825" status: 202 len: 0 microversion: 2.1 time: 0.072774 May 12 07:25:10.192376 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1527/3149] 10.222.0.25 () {58 vars in 1220 bytes} [Thu May 12 07:25:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071890825 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:25:11.220839 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-864daaac-4462-4092-b133-6e21ba44d0ef req-6c1301b7-7af5-4f48-b400-5476ff73cbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106", "tag": "bb3b7568-76ad-422a-b728-00d4b4baa39a"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:25:11.229437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-864daaac-4462-4092-b133-6e21ba44d0ef req-6c1301b7-7af5-4f48-b400-5476ff73cbe8 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:25:11.229895 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-864daaac-4462-4092-b133-6e21ba44d0ef req-6c1301b7-7af5-4f48-b400-5476ff73cbe8 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:25:11.241313 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-864daaac-4462-4092-b133-6e21ba44d0ef req-6c1301b7-7af5-4f48-b400-5476ff73cbe8 service nova] Creating event network-changed:bb3b7568-76ad-422a-b728-00d4b4baa39a for instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 on hv-cinder-76606 May 12 07:25:11.244999 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR oslo.messaging._drivers.impl_rabbit [req-864daaac-4462-4092-b133-6e21ba44d0ef req-6c1301b7-7af5-4f48-b400-5476ff73cbe8 service nova] [c3336a57-c2ec-4f6f-84b7-8887a15c4498] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 07:25:12.251756 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [req-864daaac-4462-4092-b133-6e21ba44d0ef req-6c1301b7-7af5-4f48-b400-5476ff73cbe8 service nova] [c3336a57-c2ec-4f6f-84b7-8887a15c4498] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56860. May 12 07:25:12.255150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-864daaac-4462-4092-b133-6e21ba44d0ef req-6c1301b7-7af5-4f48-b400-5476ff73cbe8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.095453 May 12 07:25:12.255873 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1623/3150] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:25:16.607430 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:25:16.608108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:25:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:26:27.586563 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-69ae4b3b-f733-4fad-a62c-3097b608e4be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:27.587190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-69ae4b3b-f733-4fad-a62c-3097b608e4be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:27.600044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69ae4b3b-f733-4fad-a62c-3097b608e4be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:27.600794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69ae4b3b-f733-4fad-a62c-3097b608e4be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:27.602187 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69ae4b3b-f733-4fad-a62c-3097b608e4be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:27.603290 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-69ae4b3b-f733-4fad-a62c-3097b608e4be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:27.647284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-69ae4b3b-f733-4fad-a62c-3097b608e4be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Going to try to terminate instance {{(pid=124024) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:26:27.904928 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.compute.api [None req-69ae4b3b-f733-4fad-a62c-3097b608e4be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Instance is already in deleting state, ignoring this request May 12 07:26:27.905801 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-69ae4b3b-f733-4fad-a62c-3097b608e4be tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 204 len: 0 microversion: 2.20 time: 0.327758 May 12 07:26:27.906361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1528/3151] 10.222.0.25 () {60 vars in 1279 bytes} [Thu May 12 07:26:27 2022] DELETE /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 07:26:27.918146 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:27.919100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:27.925171 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:27.925624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:27.926385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:27.926821 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:27.961319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:27.961319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:27.961319 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lazy-loading 'fault' on Instance uuid d30aa8f3-ada1-42f3-bb93-081f2552b4a3 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:26:28.023785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:28.034695 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:28.036272 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4097ea09148b4093914d1c4796e05df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c6164700aa4d2a87819ad713a5fa37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:28.040534 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8b1c129c-6bdf-4a10-9301-54c80a830e3a tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 200 len: 1543 microversion: 2.20 time: 0.126568 May 12 07:26:28.040534 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1624/3152] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:26:27 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 1543 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 07:26:28.695927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e56aa943-cda3-47f7-bb2b-cf1a33f3f952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:28.696533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e56aa943-cda3-47f7-bb2b-cf1a33f3f952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:28.704098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e56aa943-cda3-47f7-bb2b-cf1a33f3f952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:28.704797 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e56aa943-cda3-47f7-bb2b-cf1a33f3f952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:28.706084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e56aa943-cda3-47f7-bb2b-cf1a33f3f952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:28.706804 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e56aa943-cda3-47f7-bb2b-cf1a33f3f952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:28.723954 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-e56aa943-cda3-47f7-bb2b-cf1a33f3f952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] HTTP exception thrown: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e56aa943-cda3-47f7-bb2b-cf1a33f3f952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Request method failure captured: May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: DELETE /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af HTTP/1.1 May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6HRGYlYWXya91pIHFVjAOJYmWtY5MYyvZwnZXCpGZQzepfO3c5NJWQekHocxqSfxT8elJH9ruUtKdfHyZTPoHWcIRBOAcyLXayn_VKB1I6gvi1k8VtECvraaK2HuKMC_VgY_LLYMl3klBjcYGThTYZQRd5C0PPkOms3IAcJhz746w May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: 91ccbfb303dc40a7a2313fe5e6ab3332 May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeTestJSON-1496827555 May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:26:28.725875 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91ccbfb303dc40a7a2313fe5e6ab3332"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91ccbfb303dc40a7a2313fe5e6ab3332", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91ccbfb303dc40a7a2313fe5e6ab3332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91ccbfb303dc40a7a2313fe5e6ab3332"}]}] May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeTestJSON-1496827555 May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: 91ccbfb303dc40a7a2313fe5e6ab3332 May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1496827555 May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeTestJSON-1496827555-project May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 9f11c63feb0740aeb5283907c8b61680 May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeTestJSON-1496827555-project May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. May 12 07:26:28.727709 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': '7f4aebcd-2d12-4d12-941a-12261cb855af'} May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:26:28.728673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. May 12 07:26:28.730447 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:28.732896 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e56aa943-cda3-47f7-bb2b-cf1a33f3f952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Returning 404 to user: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:26:28.733957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e56aa943-cda3-47f7-bb2b-cf1a33f3f952 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 404 len: 111 microversion: 2.1 time: 0.042111 May 12 07:26:28.735723 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1529/3153] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:26:28 2022] DELETE /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:26:28.744043 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0644a494-53aa-4786-9bd2-1b4122bf64e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:28.745190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-0644a494-53aa-4786-9bd2-1b4122bf64e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] [instance: 7f4aebcd-2d12-4d12-941a-12261cb855af] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:28.758087 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0644a494-53aa-4786-9bd2-1b4122bf64e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:28.758860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0644a494-53aa-4786-9bd2-1b4122bf64e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:28.760961 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0644a494-53aa-4786-9bd2-1b4122bf64e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:28.761426 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-0644a494-53aa-4786-9bd2-1b4122bf64e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:28.783708 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-0644a494-53aa-4786-9bd2-1b4122bf64e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] HTTP exception thrown: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0644a494-53aa-4786-9bd2-1b4122bf64e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Request method failure captured: May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af HTTP/1.1 May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifK6HRGYlYWXya91pIHFVjAOJYmWtY5MYyvZwnZXCpGZQzepfO3c5NJWQekHocxqSfxT8elJH9ruUtKdfHyZTPoHWcIRBOAcyLXayn_VKB1I6gvi1k8VtECvraaK2HuKMC_VgY_LLYMl3klBjcYGThTYZQRd5C0PPkOms3IAcJhz746w May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: 91ccbfb303dc40a7a2313fe5e6ab3332 May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-AttachVolumeTestJSON-1496827555 May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:26:28.785655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91ccbfb303dc40a7a2313fe5e6ab3332"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91ccbfb303dc40a7a2313fe5e6ab3332", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91ccbfb303dc40a7a2313fe5e6ab3332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91ccbfb303dc40a7a2313fe5e6ab3332"}]}] May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-AttachVolumeTestJSON-1496827555 May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: 91ccbfb303dc40a7a2313fe5e6ab3332 May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1496827555 May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-AttachVolumeTestJSON-1496827555-project May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 9f11c63feb0740aeb5283907c8b61680 May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-AttachVolumeTestJSON-1496827555-project May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. May 12 07:26:28.787526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': '7f4aebcd-2d12-4d12-941a-12261cb855af'} May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:26:28.788558 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. May 12 07:26:28.791551 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:28.792855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0644a494-53aa-4786-9bd2-1b4122bf64e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] Returning 404 to user: Instance 7f4aebcd-2d12-4d12-941a-12261cb855af could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:26:28.792855 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0644a494-53aa-4786-9bd2-1b4122bf64e7 tempest-AttachVolumeTestJSON-1496827555 tempest-AttachVolumeTestJSON-1496827555-project] 10.222.0.25 "GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af" status: 404 len: 111 microversion: 2.1 time: 0.048157 May 12 07:26:28.804189 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1625/3154] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:28 2022] GET /compute/v2.1/servers/7f4aebcd-2d12-4d12-941a-12261cb855af => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:26:29.060644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c526f796-f560-4c77-9342-8f3251e1f6f1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:29.061509 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c526f796-f560-4c77-9342-8f3251e1f6f1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] [instance: d30aa8f3-ada1-42f3-bb93-081f2552b4a3] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:29.067627 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c526f796-f560-4c77-9342-8f3251e1f6f1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:29.068111 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c526f796-f560-4c77-9342-8f3251e1f6f1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:29.068876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c526f796-f560-4c77-9342-8f3251e1f6f1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:29.070307 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c526f796-f560-4c77-9342-8f3251e1f6f1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:29.093378 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-c526f796-f560-4c77-9342-8f3251e1f6f1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] HTTP exception thrown: Instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 could not be found. May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c526f796-f560-4c77-9342-8f3251e1f6f1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Request method failure captured: May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 HTTP/1.1 May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK7OQOivTsMgpZyHOVOCIuxXplIEposnic7rKRniAYsa4O8Tyt166YY_PtYOUieQ64ALZ8C8Zy0szDT3TMaFyy3zTnnaxhvUYGVx6d2mtBo2ZOyzKwxkrb6JAwxhGOn6Rp_58GIaPe3Y6A8ELjt9cQvSFKaK1YtHGil4-rSs1RnIKDQ May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Openstack-Nova-Api-Version: 2.20 May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: d3c6164700aa4d2a87819ad713a5fa37 May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:26:29.095086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3c6164700aa4d2a87819ad713a5fa37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3c6164700aa4d2a87819ad713a5fa37", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3c6164700aa4d2a87819ad713a5fa37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3c6164700aa4d2a87819ad713a5fa37"}]}] May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: d3c6164700aa4d2a87819ad713a5fa37 May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-507767302 May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-AttachVolumeShelveTestJSON-507767302-project May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 4097ea09148b4093914d1c4796e05df8 May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-AttachVolumeShelveTestJSON-507767302-project May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 could not be found. May 12 07:26:29.097033 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': 'd30aa8f3-ada1-42f3-bb93-081f2552b4a3'} May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 could not be found. May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:26:29.097935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 could not be found. May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 could not be found. May 12 07:26:29.099416 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:29.100809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c526f796-f560-4c77-9342-8f3251e1f6f1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] Returning 404 to user: Instance d30aa8f3-ada1-42f3-bb93-081f2552b4a3 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:26:29.100809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c526f796-f560-4c77-9342-8f3251e1f6f1 tempest-AttachVolumeShelveTestJSON-507767302 tempest-AttachVolumeShelveTestJSON-507767302-project] 10.222.0.25 "GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3" status: 404 len: 111 microversion: 2.20 time: 0.040945 May 12 07:26:29.100809 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1530/3155] 10.222.0.25 () {60 vars in 1276 bytes} [Thu May 12 07:26:29 2022] GET /compute/v2.1/servers/d30aa8f3-ada1-42f3-bb93-081f2552b4a3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 07:26:29.488690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-f9a4bbb2-d2d5-4ea0-aedf-d85bc5fbfe24 req-88547c3c-c23b-491f-aec6-84b8f2e19c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106", "name": "network-vif-deleted", "tag": "bb3b7568-76ad-422a-b728-00d4b4baa39a"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:26:29.516727 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-f9a4bbb2-d2d5-4ea0-aedf-d85bc5fbfe24 req-88547c3c-c23b-491f-aec6-84b8f2e19c28 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:29.519930 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-f9a4bbb2-d2d5-4ea0-aedf-d85bc5fbfe24 req-88547c3c-c23b-491f-aec6-84b8f2e19c28 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:29.546070 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-f9a4bbb2-d2d5-4ea0-aedf-d85bc5fbfe24 req-88547c3c-c23b-491f-aec6-84b8f2e19c28 service nova] Creating event network-vif-deleted:bb3b7568-76ad-422a-b728-00d4b4baa39a for instance d1d4f4b0-aaa4-4e2a-bc94-83d27ad4a106 on hv-cinder-76606 May 12 07:26:29.553822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-f9a4bbb2-d2d5-4ea0-aedf-d85bc5fbfe24 req-88547c3c-c23b-491f-aec6-84b8f2e19c28 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255147 May 12 07:26:29.554744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1626/3156] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:30.124189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-da0d9405-51a8-4f6e-bb97-cfe0201cb85c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:30.125335 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-da0d9405-51a8-4f6e-bb97-cfe0201cb85c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:30.132772 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da0d9405-51a8-4f6e-bb97-cfe0201cb85c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:30.133640 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da0d9405-51a8-4f6e-bb97-cfe0201cb85c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:30.134699 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da0d9405-51a8-4f6e-bb97-cfe0201cb85c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:30.135277 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-da0d9405-51a8-4f6e-bb97-cfe0201cb85c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:30.163367 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-da0d9405-51a8-4f6e-bb97-cfe0201cb85c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Going to try to terminate instance {{(pid=124024) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:26:30.513949 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-da0d9405-51a8-4f6e-bb97-cfe0201cb85c tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 204 len: 0 microversion: 2.1 time: 0.394064 May 12 07:26:30.515241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1531/3157] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:26:30 2022] DELETE /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:26:30.530122 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-156da55d-efb7-4a14-8915-cf387a90ffba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:30.531642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-156da55d-efb7-4a14-8915-cf387a90ffba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:30.539618 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-156da55d-efb7-4a14-8915-cf387a90ffba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:30.540566 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-156da55d-efb7-4a14-8915-cf387a90ffba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:30.542429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-156da55d-efb7-4a14-8915-cf387a90ffba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:30.543053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-156da55d-efb7-4a14-8915-cf387a90ffba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:30.832241 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-156da55d-efb7-4a14-8915-cf387a90ffba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:30.841865 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-156da55d-efb7-4a14-8915-cf387a90ffba tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1507 microversion: 2.1 time: 0.320243 May 12 07:26:30.843214 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1627/3158] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:30 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:31.590190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-d18c8528-d220-4e08-b062-1ea34e2460e8 req-1e31a734-5b4d-4bb0-88e8-4e49d7e7f8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ebfe3f-ca98-4256-96c2-2bdb6f5a838f", "name": "network-vif-deleted", "tag": "263cd19a-6ce0-4caf-b2ff-5fc0bc9aeb45"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:26:31.606691 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-d18c8528-d220-4e08-b062-1ea34e2460e8 req-1e31a734-5b4d-4bb0-88e8-4e49d7e7f8d0 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:31.609289 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-d18c8528-d220-4e08-b062-1ea34e2460e8 req-1e31a734-5b4d-4bb0-88e8-4e49d7e7f8d0 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:31.637098 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-d18c8528-d220-4e08-b062-1ea34e2460e8 req-1e31a734-5b4d-4bb0-88e8-4e49d7e7f8d0 service nova] Creating event network-vif-deleted:263cd19a-6ce0-4caf-b2ff-5fc0bc9aeb45 for instance 19ebfe3f-ca98-4256-96c2-2bdb6f5a838f on hv-cinder-76606 May 12 07:26:31.650137 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-d18c8528-d220-4e08-b062-1ea34e2460e8 req-1e31a734-5b4d-4bb0-88e8-4e49d7e7f8d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064251 May 12 07:26:31.651609 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1532/3159] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:31.859879 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-544b2835-0b9c-44dd-ad45-c863e5842c16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:31.860503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-544b2835-0b9c-44dd-ad45-c863e5842c16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:31.874595 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-544b2835-0b9c-44dd-ad45-c863e5842c16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:31.880095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-544b2835-0b9c-44dd-ad45-c863e5842c16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:31.880095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-544b2835-0b9c-44dd-ad45-c863e5842c16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:31.880095 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-544b2835-0b9c-44dd-ad45-c863e5842c16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:32.260544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-544b2835-0b9c-44dd-ad45-c863e5842c16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:32.269323 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-544b2835-0b9c-44dd-ad45-c863e5842c16 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1507 microversion: 2.1 time: 0.413499 May 12 07:26:32.271924 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1628/3160] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:31 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:33.287351 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c3daf036-a02c-4d5b-9a1b-18dbf3f8c0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:33.288232 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c3daf036-a02c-4d5b-9a1b-18dbf3f8c0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:33.299859 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3daf036-a02c-4d5b-9a1b-18dbf3f8c0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:33.300339 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3daf036-a02c-4d5b-9a1b-18dbf3f8c0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:33.301285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3daf036-a02c-4d5b-9a1b-18dbf3f8c0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:33.301729 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3daf036-a02c-4d5b-9a1b-18dbf3f8c0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:33.340650 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3daf036-a02c-4d5b-9a1b-18dbf3f8c0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:33.344178 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c3daf036-a02c-4d5b-9a1b-18dbf3f8c0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:33.344746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-c3daf036-a02c-4d5b-9a1b-18dbf3f8c0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lazy-loading 'fault' on Instance uuid e23874ce-55b2-4fd4-8d8a-17c33e01daf4 {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:26:33.642697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c3daf036-a02c-4d5b-9a1b-18dbf3f8c0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:33.653361 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c3daf036-a02c-4d5b-9a1b-18dbf3f8c0b3 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 200 len: 1311 microversion: 2.1 time: 0.370744 May 12 07:26:33.662133 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1533/3161] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:33 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 1311 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:33.674617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-b5ceda5a-82ec-4d23-8d84-397a08d851e7 req-5734f154-2113-402a-aae3-35488168e826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23874ce-55b2-4fd4-8d8a-17c33e01daf4", "name": "network-vif-deleted", "tag": "61a6481b-18ae-40a4-80a4-4c8a3ac311e1"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:26:33.689485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-b5ceda5a-82ec-4d23-8d84-397a08d851e7 req-5734f154-2113-402a-aae3-35488168e826 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:33.689485 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-b5ceda5a-82ec-4d23-8d84-397a08d851e7 req-5734f154-2113-402a-aae3-35488168e826 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:33.696176 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-b5ceda5a-82ec-4d23-8d84-397a08d851e7 req-5734f154-2113-402a-aae3-35488168e826 service nova] Creating event network-vif-deleted:61a6481b-18ae-40a4-80a4-4c8a3ac311e1 for instance e23874ce-55b2-4fd4-8d8a-17c33e01daf4 on hv-cinder-76606 May 12 07:26:33.702704 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-b5ceda5a-82ec-4d23-8d84-397a08d851e7 req-5734f154-2113-402a-aae3-35488168e826 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031851 May 12 07:26:33.703516 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1629/3162] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:34.680977 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3033c87e-61b3-4813-bd51-bd7daec277b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:34.682284 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3033c87e-61b3-4813-bd51-bd7daec277b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: e23874ce-55b2-4fd4-8d8a-17c33e01daf4] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:34.693444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3033c87e-61b3-4813-bd51-bd7daec277b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:34.696149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3033c87e-61b3-4813-bd51-bd7daec277b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:34.697538 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3033c87e-61b3-4813-bd51-bd7daec277b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:34.702175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3033c87e-61b3-4813-bd51-bd7daec277b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:34.728143 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-3033c87e-61b3-4813-bd51-bd7daec277b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Instance e23874ce-55b2-4fd4-8d8a-17c33e01daf4 could not be found. May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3033c87e-61b3-4813-bd51-bd7daec277b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 HTTP/1.1 May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:26:34.731312 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance e23874ce-55b2-4fd4-8d8a-17c33e01daf4 could not be found. May 12 07:26:34.732956 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': 'e23874ce-55b2-4fd4-8d8a-17c33e01daf4'} May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e23874ce-55b2-4fd4-8d8a-17c33e01daf4 could not be found. May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:26:34.733915 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e23874ce-55b2-4fd4-8d8a-17c33e01daf4 could not be found. May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e23874ce-55b2-4fd4-8d8a-17c33e01daf4 could not be found. May 12 07:26:34.735426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:34.738270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3033c87e-61b3-4813-bd51-bd7daec277b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 404 to user: Instance e23874ce-55b2-4fd4-8d8a-17c33e01daf4 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:26:34.738270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3033c87e-61b3-4813-bd51-bd7daec277b0 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4" status: 404 len: 111 microversion: 2.1 time: 0.066462 May 12 07:26:34.738270 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1534/3163] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:34 2022] GET /compute/v2.1/servers/e23874ce-55b2-4fd4-8d8a-17c33e01daf4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:26:34.742581 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7cdd4011-9515-4617-88fc-8bd46efe5bd6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:34.743170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7cdd4011-9515-4617-88fc-8bd46efe5bd6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:34.753232 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cdd4011-9515-4617-88fc-8bd46efe5bd6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:34.754006 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cdd4011-9515-4617-88fc-8bd46efe5bd6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:34.755641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cdd4011-9515-4617-88fc-8bd46efe5bd6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:34.757398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cdd4011-9515-4617-88fc-8bd46efe5bd6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:34.797684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7cdd4011-9515-4617-88fc-8bd46efe5bd6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Going to try to terminate instance {{(pid=124025) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:26:35.148772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7cdd4011-9515-4617-88fc-8bd46efe5bd6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 204 len: 0 microversion: 2.1 time: 0.410663 May 12 07:26:35.149296 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1630/3164] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:26:34 2022] DELETE /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:26:35.157600 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9bbc09fd-973c-44f4-867b-a4d3642b45e9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:35.158230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9bbc09fd-973c-44f4-867b-a4d3642b45e9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:35.164129 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9bbc09fd-973c-44f4-867b-a4d3642b45e9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:35.164589 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9bbc09fd-973c-44f4-867b-a4d3642b45e9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:35.165377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9bbc09fd-973c-44f4-867b-a4d3642b45e9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:35.167072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9bbc09fd-973c-44f4-867b-a4d3642b45e9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:35.339903 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9bbc09fd-973c-44f4-867b-a4d3642b45e9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:35.348456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9bbc09fd-973c-44f4-867b-a4d3642b45e9 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1522 microversion: 2.1 time: 0.194780 May 12 07:26:35.349671 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1535/3165] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:35 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:26:36.234655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-1ddef3a2-92ee-496f-bfa3-d266019f154e req-9f277d12-87db-405d-8767-6ff08207a58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15", "name": "network-vif-deleted", "tag": "1c97b15f-78b6-4633-9ef7-e577a30995a1"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:26:36.245378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-1ddef3a2-92ee-496f-bfa3-d266019f154e req-9f277d12-87db-405d-8767-6ff08207a58e service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:36.246243 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-1ddef3a2-92ee-496f-bfa3-d266019f154e req-9f277d12-87db-405d-8767-6ff08207a58e service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:36.278450 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-1ddef3a2-92ee-496f-bfa3-d266019f154e req-9f277d12-87db-405d-8767-6ff08207a58e service nova] Creating event network-vif-deleted:1c97b15f-78b6-4633-9ef7-e577a30995a1 for instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 on hv-cinder-76606 May 12 07:26:36.284795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-1ddef3a2-92ee-496f-bfa3-d266019f154e req-9f277d12-87db-405d-8767-6ff08207a58e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056114 May 12 07:26:36.285305 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1631/3166] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:36.366267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-829f71dc-a722-4664-a916-63117250d906 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:36.366948 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-829f71dc-a722-4664-a916-63117250d906 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:36.374764 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-829f71dc-a722-4664-a916-63117250d906 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:36.375224 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-829f71dc-a722-4664-a916-63117250d906 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:36.376354 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-829f71dc-a722-4664-a916-63117250d906 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:36.376848 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-829f71dc-a722-4664-a916-63117250d906 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:36.446710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-829f71dc-a722-4664-a916-63117250d906 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ef78da38e941b3a09f1de838581d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b772df3ea0d9417188aab057dce4d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:36.454663 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-829f71dc-a722-4664-a916-63117250d906 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 200 len: 1307 microversion: 2.1 time: 0.091937 May 12 07:26:36.455240 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1536/3167] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:36 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:37.072569 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4bb8768d-aad2-4a14-a5f5-27487d93be9a tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] Action: 'create', calling method: .version_select at 0x7f89df3b9550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1002544936", "metadata": {"Type": "work"}}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:26:37.472379 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-daf92274-5012-450e-879e-ff5143e6c0e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:37.473230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-daf92274-5012-450e-879e-ff5143e6c0e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] [instance: a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:37.485947 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-daf92274-5012-450e-879e-ff5143e6c0e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:37.486473 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-daf92274-5012-450e-879e-ff5143e6c0e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:37.491344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-daf92274-5012-450e-879e-ff5143e6c0e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:37.491344 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-daf92274-5012-450e-879e-ff5143e6c0e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:37.504524 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.wsgi [None req-daf92274-5012-450e-879e-ff5143e6c0e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] HTTP exception thrown: Instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 could not be found. May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-daf92274-5012-450e-879e-ff5143e6c0e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Request method failure captured: May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: request: GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 HTTP/1.1 May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept: application/json May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Accept-Encoding: identity May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Connection: close May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Length: 0 May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Content-Type: application/json May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Host: 10.222.0.25 May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Openstack-System-Scope: None May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: User-Agent: python-urllib3/1.26.9 May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Auth-Token: gAAAAABifK6HUaIwp7g8STx0ibYWGF--wMd3rRIeHYe987_XXkHpHrm-nnpvmqFyEkGh0haDVgP4KhNnfHB77XFExUb4-aGVwXf3e3WtHFBe878UAYahjNbjNHRQerstbJtgcm_zAa4hMiGtfOLcHa9prwoF0_-C5RZpHcoxl2K0VIbo4C_WOwk May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Id: None May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Domain-Name: None May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Identity-Status: Confirmed May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Is-Admin-Project: True May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Id: default May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Domain-Name: Default May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Role: reader,member May 12 07:26:37.506733 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Roles: reader,member May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b772df3ea0d9417188aab057dce4d320", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b772df3ea0d9417188aab057dce4d320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b772df3ea0d9417188aab057dce4d320"}]}] May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Id: b772df3ea0d9417188aab057dce4d320 May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1771544383 May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Id: default May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Domain-Name: Default May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Id: 13ef78da38e941b3a09f1de838581d54 May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1771544383-project May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: method: > May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: exception: Instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 could not be found. May 12 07:26:37.508720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: action_args: {'id': 'a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15'} May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 could not be found. May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:26:37.509969 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 could not be found. May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 could not be found. May 12 07:26:37.511760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: ERROR nova.api.openstack.wsgi May 12 07:26:37.515163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-daf92274-5012-450e-879e-ff5143e6c0e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] Returning 404 to user: Instance a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 could not be found. {{(pid=124024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:26:37.516202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-daf92274-5012-450e-879e-ff5143e6c0e6 tempest-ServerRescueNegativeTestJSON-1771544383 tempest-ServerRescueNegativeTestJSON-1771544383-project] 10.222.0.25 "GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15" status: 404 len: 111 microversion: 2.1 time: 0.048021 May 12 07:26:37.516760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1537/3168] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:37 2022] GET /compute/v2.1/servers/a3e860a9-d14d-47d5-bb95-c9bb1ee2ca15 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 07:26:37.736184 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4bb8768d-aad2-4a14-a5f5-27487d93be9a tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.897734 May 12 07:26:37.737001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1632/3169] 10.222.0.25 () {60 vars in 1155 bytes} [Thu May 12 07:26:36 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 899 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 07:26:37.748384 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-237db6dc-5ecd-41ac-bb2c-f848c6a301eb tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] Calling method '.version_select at 0x7f89df558700>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:37.797122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-237db6dc-5ecd-41ac-bb2c-f848c6a301eb tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9" status: 200 len: 353 microversion: 2.1 time: 0.053213 May 12 07:26:37.798669 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1538/3170] 10.222.0.25 () {58 vars in 1244 bytes} [Thu May 12 07:26:37 2022] GET /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:38.810798 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-550f9f45-137d-4976-af8d-ad5652d00d1c tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] Calling method '.version_select at 0x7f89da521b80>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:38.873644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-550f9f45-137d-4976-af8d-ad5652d00d1c tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9" status: 200 len: 354 microversion: 2.1 time: 0.067707 May 12 07:26:38.874692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1633/3171] 10.222.0.25 () {58 vars in 1244 bytes} [Thu May 12 07:26:38 2022] GET /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9 => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:38.889993 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8b9180b7-618d-441d-9505-688845e72717 tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] Calling method '.version_select at 0x7f89da6ae8b0>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:38.950728 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8b9180b7-618d-441d-9505-688845e72717 tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9" status: 200 len: 354 microversion: 2.1 time: 0.066098 May 12 07:26:38.962567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1539/3172] 10.222.0.25 () {58 vars in 1244 bytes} [Thu May 12 07:26:38 2022] GET /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9 => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:38.964009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-6a8401e6-ed38-43bf-a69a-f8e38707020c tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] Calling method '.version_select at 0x7f89df4040d0>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:39.189199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-6a8401e6-ed38-43bf-a69a-f8e38707020c tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9" status: 202 len: 0 microversion: 2.1 time: 0.225359 May 12 07:26:39.189199 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1634/3173] 10.222.0.25 () {58 vars in 1247 bytes} [Thu May 12 07:26:38 2022] DELETE /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:26:39.194223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-80d9ee28-23be-41a1-a33d-8225ead050dc tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] Calling method '.version_select at 0x7f89da2f84c0>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:39.262037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-80d9ee28-23be-41a1-a33d-8225ead050dc tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9" status: 200 len: 353 microversion: 2.1 time: 0.071672 May 12 07:26:39.262968 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1540/3174] 10.222.0.25 () {58 vars in 1244 bytes} [Thu May 12 07:26:39 2022] GET /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:26:40.275484 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7b1c8920-cc2d-4f13-a9a8-3ad1e58f893f tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] Calling method '.version_select at 0x7f89da41c310>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:40.311032 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-7b1c8920-cc2d-4f13-a9a8-3ad1e58f893f tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] HTTP exception thrown: Volume 3d78fee2-616b-4f53-bfac-6b2b2df25eb9 could not be found. May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7b1c8920-cc2d-4f13-a9a8-3ad1e58f893f tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] Request method failure captured: May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: GET /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9 HTTP/1.1 May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifLasZCFQSvL4k3GL8X1t9Uv5eVBAvqzX-OIO00SkqlRmjakR9W6dfRC0zrklaWOGLN2NlRgPoan80VUBJ0YyUNi_-9msNuJ2Pv3rlCAxgLGDbbN-eNpJgQQP2RNInguVG6TTamWrvTCHFskQgCZm6hd2AKQ3d561InVERgaCt6yTBII May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: 196d48b0ecf34adf85012a2fd8ef2cf0 May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-VolumesGetTestJSON-1402974091 May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:26:40.313857 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/196d48b0ecf34adf85012a2fd8ef2cf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_196d48b0ecf34adf85012a2fd8ef2cf0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/196d48b0ecf34adf85012a2fd8ef2cf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/196d48b0ecf34adf85012a2fd8ef2cf0"}]}] May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-VolumesGetTestJSON-1402974091 May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: 196d48b0ecf34adf85012a2fd8ef2cf0 May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-VolumesGetTestJSON-1402974091 May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-VolumesGetTestJSON-1402974091-project May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: d62d6c8b3a1e4cc7b00e2b979d1be8b2 May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-VolumesGetTestJSON-1402974091-project May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Volume 3d78fee2-616b-4f53-bfac-6b2b2df25eb9 could not be found. May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': '3d78fee2-616b-4f53-bfac-6b2b2df25eb9'} May 12 07:26:40.315604 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3d78fee2-616b-4f53-bfac-6b2b2df25eb9 could not be found. (HTTP 404) (Request-ID: req-10efad9f-6f29-4874-9319-da44c0819993) May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:40.319988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 07:26:40.321355 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3d78fee2-616b-4f53-bfac-6b2b2df25eb9 could not be found. May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 07:26:40.322664 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3d78fee2-616b-4f53-bfac-6b2b2df25eb9 could not be found. May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3d78fee2-616b-4f53-bfac-6b2b2df25eb9 could not be found. May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7b1c8920-cc2d-4f13-a9a8-3ad1e58f893f tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] Returning 404 to user: Volume 3d78fee2-616b-4f53-bfac-6b2b2df25eb9 could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7b1c8920-cc2d-4f13-a9a8-3ad1e58f893f tempest-VolumesGetTestJSON-1402974091 tempest-VolumesGetTestJSON-1402974091-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9" status: 404 len: 109 microversion: 2.1 time: 0.045034 May 12 07:26:40.331920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1635/3175] 10.222.0.25 () {58 vars in 1244 bytes} [Thu May 12 07:26:40 2022] GET /compute/v2.1/os-volumes/3d78fee2-616b-4f53-bfac-6b2b2df25eb9 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:26:41.062804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:26:41.062968 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:26:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:26:43.405856 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1669851534", "imageRef": "ae41df1a-4672-48f2-a3ea-147405ce9f45", "flavorRef": "452"}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:26:43.459485 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.network.neutron [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] validate_networks() for None {{(pid=124024) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 07:26:44.120579 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Flavor limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 07:26:44.121036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Image limits 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 07:26:44.121510 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Flavor pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 07:26:44.121918 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Image pref 0:0:0 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 07:26:44.122333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.virt.hardware [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 07:26:44.131754 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:44.132492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:44.133314 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:44.133958 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:44.150944 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Getting quotas for project 5ae3a88827a548a3814d29074421ad90. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 07:26:44.155537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Getting quotas for user 4761df768dea4a90a1ae831cebf0f95f and project 5ae3a88827a548a3814d29074421ad90. Resources: {'cores', 'instances', 'ram'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 07:26:44.167791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Going to run 1 instances... {{(pid=124024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 07:26:44.170453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae41df1a-4672-48f2-a3ea-147405ce9f45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 07:26:44.300202 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-ea0ae85e-96d4-4e98-ac16-26cc5cc262bb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898585 May 12 07:26:44.306762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1541/3176] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 07:26:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 07:26:44.313224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-dafac42b-b79d-4593-a64b-d1e43ae49e28 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:44.313907 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-dafac42b-b79d-4593-a64b-d1e43ae49e28 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:44.374084 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-dafac42b-b79d-4593-a64b-d1e43ae49e28 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:44.380894 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-dafac42b-b79d-4593-a64b-d1e43ae49e28 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1215 microversion: 2.1 time: 0.072486 May 12 07:26:44.381535 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1636/3177] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:44 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:44.678673 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-bcfb829b-24ea-46fc-bbae-33afc86618b5 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] Calling method '.version_select at 0x7f89da6ae9d0>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:44.730741 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-bcfb829b-24ea-46fc-bbae-33afc86618b5 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e307be9b-c76f-49df-ad0b-1dd1e64a5395" status: 200 len: 350 microversion: 2.1 time: 0.055836 May 12 07:26:44.739766 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1542/3178] 10.222.0.25 () {58 vars in 1244 bytes} [Thu May 12 07:26:44 2022] GET /compute/v2.1/os-volumes/e307be9b-c76f-49df-ad0b-1dd1e64a5395 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:45.398290 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-7cbec56b-ac1a-4fdc-9d37-e0c48e823d45 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:45.398884 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-7cbec56b-ac1a-4fdc-9d37-e0c48e823d45 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:45.405817 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cbec56b-ac1a-4fdc-9d37-e0c48e823d45 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:45.406270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cbec56b-ac1a-4fdc-9d37-e0c48e823d45 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:45.410327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cbec56b-ac1a-4fdc-9d37-e0c48e823d45 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:45.410327 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-7cbec56b-ac1a-4fdc-9d37-e0c48e823d45 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:45.472805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-7cbec56b-ac1a-4fdc-9d37-e0c48e823d45 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:45.481339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-7cbec56b-ac1a-4fdc-9d37-e0c48e823d45 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1219 microversion: 2.1 time: 0.086871 May 12 07:26:45.482149 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1637/3179] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:45 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:46.322479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-770b8fea-24e7-4adf-9a21-0339ab2b2e03 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] Calling method '.version_select at 0x7f89da178040>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:46.368623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-770b8fea-24e7-4adf-9a21-0339ab2b2e03 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ff58872b-b178-4a5f-adf6-0fcd05d0f4f3" status: 200 len: 351 microversion: 2.1 time: 0.050418 May 12 07:26:46.369189 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1543/3180] 10.222.0.25 () {58 vars in 1244 bytes} [Thu May 12 07:26:46 2022] GET /compute/v2.1/os-volumes/ff58872b-b178-4a5f-adf6-0fcd05d0f4f3 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:46.498222 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-f29a7079-0564-485e-afb1-615f944fda05 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:46.498985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-f29a7079-0564-485e-afb1-615f944fda05 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:46.505436 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f29a7079-0564-485e-afb1-615f944fda05 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:46.506136 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f29a7079-0564-485e-afb1-615f944fda05 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:46.506915 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f29a7079-0564-485e-afb1-615f944fda05 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:46.507356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-f29a7079-0564-485e-afb1-615f944fda05 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:46.585689 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-f29a7079-0564-485e-afb1-615f944fda05 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:46.602572 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-f29a7079-0564-485e-afb1-615f944fda05 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1275 microversion: 2.1 time: 0.102036 May 12 07:26:46.603579 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1638/3181] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:46 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:47.620494 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-320eb4ba-9c44-4fe7-996c-79d700af36cb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:47.621163 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-320eb4ba-9c44-4fe7-996c-79d700af36cb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:47.627255 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-320eb4ba-9c44-4fe7-996c-79d700af36cb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:47.627726 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-320eb4ba-9c44-4fe7-996c-79d700af36cb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:47.628502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-320eb4ba-9c44-4fe7-996c-79d700af36cb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:47.628942 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-320eb4ba-9c44-4fe7-996c-79d700af36cb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:47.691005 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-320eb4ba-9c44-4fe7-996c-79d700af36cb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:47.698884 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-320eb4ba-9c44-4fe7-996c-79d700af36cb tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1273 microversion: 2.1 time: 0.082848 May 12 07:26:47.699461 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1544/3182] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:47 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:48.073599 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-72d97e06-73e6-4afb-b64b-b5ccbd4625c5 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] Calling method '.version_select at 0x7f89df549940>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:48.122202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-72d97e06-73e6-4afb-b64b-b5ccbd4625c5 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/fbfbcb97-9d34-4386-ab6f-176399284fd7" status: 200 len: 351 microversion: 2.1 time: 0.053014 May 12 07:26:48.122712 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1639/3183] 10.222.0.25 () {58 vars in 1244 bytes} [Thu May 12 07:26:48 2022] GET /compute/v2.1/os-volumes/fbfbcb97-9d34-4386-ab6f-176399284fd7 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:48.133770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f5014dbd-48e0-4334-998a-ca1b17684f76 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] Calling method '.version_select at 0x7f89da12bca0>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:48.224842 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f5014dbd-48e0-4334-998a-ca1b17684f76 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094726 May 12 07:26:48.225490 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1545/3184] 10.222.0.25 () {58 vars in 1133 bytes} [Thu May 12 07:26:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:48.238202 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-00d91291-b47d-4c84-824d-fec90d9909a8 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] Calling method '.version_select at 0x7f89df40bd30>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:48.320339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-00d91291-b47d-4c84-824d-fec90d9909a8 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086049 May 12 07:26:48.328048 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1640/3185] 10.222.0.25 () {58 vars in 1148 bytes} [Thu May 12 07:26:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:48.334241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-afe0ceaa-effb-4062-a18a-4a3d2dbf7a83 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] Calling method '.version_select at 0x7f89da6ae8b0>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:48.418611 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-afe0ceaa-effb-4062-a18a-4a3d2dbf7a83 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088465 May 12 07:26:48.419206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1546/3186] 10.222.0.25 () {58 vars in 1133 bytes} [Thu May 12 07:26:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:48.430365 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-04217412-97f7-4a2d-96f0-a44b71e549b1 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] Calling method '.version_select at 0x7f89da521dc0>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:48.534198 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-04217412-97f7-4a2d-96f0-a44b71e549b1 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.107335 May 12 07:26:48.535017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1641/3187] 10.222.0.25 () {58 vars in 1166 bytes} [Thu May 12 07:26:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:48.547469 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-91b27719-8063-4b78-8741-53e000cffc9d tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] Calling method '.version_select at 0x7f89da19c700>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:48.652443 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-91b27719-8063-4b78-8741-53e000cffc9d tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.109034 May 12 07:26:48.653044 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1547/3188] 10.222.0.25 () {58 vars in 1169 bytes} [Thu May 12 07:26:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:48.665211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aa6b680e-7eb9-4f3b-88b2-a1f8ac8e1d74 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] Calling method '.version_select at 0x7f89da594310>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:48.715991 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c00d5105-0847-45c4-b0c2-1b8d9032412b tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:48.716834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c00d5105-0847-45c4-b0c2-1b8d9032412b tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:48.723061 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d5105-0847-45c4-b0c2-1b8d9032412b tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:48.723866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d5105-0847-45c4-b0c2-1b8d9032412b tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:48.728263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d5105-0847-45c4-b0c2-1b8d9032412b tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:48.728263 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c00d5105-0847-45c4-b0c2-1b8d9032412b tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:48.750956 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aa6b680e-7eb9-4f3b-88b2-a1f8ac8e1d74 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089457 May 12 07:26:48.751524 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1642/3189] 10.222.0.25 () {58 vars in 1154 bytes} [Thu May 12 07:26:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:48.763548 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-b3242818-f074-4be3-bfa5-fb06dd62677d tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] Calling method '.version_select at 0x7f89df3b9550>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:48.870767 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-b3242818-f074-4be3-bfa5-fb06dd62677d tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.111861 May 12 07:26:48.871335 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1643/3190] 10.222.0.25 () {58 vars in 1187 bytes} [Thu May 12 07:26:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:26:48.876432 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-ea101006-554c-4401-b168-259f3d443e18 req-8cf66784-9dc0-4827-bad0-5899a0dfecf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814ff910-9b81-4593-95bb-939479745bbe", "tag": "d517b649-df12-4804-8769-3d2cb1f6bad4"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:26:48.894362 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-ea101006-554c-4401-b168-259f3d443e18 req-8cf66784-9dc0-4827-bad0-5899a0dfecf6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:48.894804 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-ea101006-554c-4401-b168-259f3d443e18 req-8cf66784-9dc0-4827-bad0-5899a0dfecf6 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:48.906974 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-ea101006-554c-4401-b168-259f3d443e18 req-8cf66784-9dc0-4827-bad0-5899a0dfecf6 service nova] Creating event network-changed:d517b649-df12-4804-8769-3d2cb1f6bad4 for instance 814ff910-9b81-4593-95bb-939479745bbe on hv-cinder-76606 May 12 07:26:48.908303 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c00d5105-0847-45c4-b0c2-1b8d9032412b tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:48.912797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-ea101006-554c-4401-b168-259f3d443e18 req-8cf66784-9dc0-4827-bad0-5899a0dfecf6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039700 May 12 07:26:48.913871 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1644/3191] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:48.918716 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c00d5105-0847-45c4-b0c2-1b8d9032412b tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1315 microversion: 2.1 time: 0.207220 May 12 07:26:48.919305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1548/3192] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:48 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:26:48.919773 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4ab31404-a6c3-4099-8aa1-fdbd115ac0d7 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] Calling method '.version_select at 0x7f89df549ca0>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:49.013860 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4ab31404-a6c3-4099-8aa1-fdbd115ac0d7 tempest-VolumesTestJSON-1386248785 tempest-VolumesTestJSON-1386248785-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.098530 May 12 07:26:49.014628 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1645/3193] 10.222.0.25 () {58 vars in 1154 bytes} [Thu May 12 07:26:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:49.935957 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f2dbf7f1-f875-4577-8497-e9a1ace5f9cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:49.936566 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f2dbf7f1-f875-4577-8497-e9a1ace5f9cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:49.943085 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2dbf7f1-f875-4577-8497-e9a1ace5f9cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:49.943558 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2dbf7f1-f875-4577-8497-e9a1ace5f9cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:49.944352 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2dbf7f1-f875-4577-8497-e9a1ace5f9cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:49.944790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f2dbf7f1-f875-4577-8497-e9a1ace5f9cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:50.083175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f2dbf7f1-f875-4577-8497-e9a1ace5f9cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:50.091486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f2dbf7f1-f875-4577-8497-e9a1ace5f9cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1315 microversion: 2.1 time: 0.159287 May 12 07:26:50.092105 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1549/3194] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:49 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:51.109339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-cac34fe6-00ab-45a3-accc-08ee7b7dff55 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:51.116190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-cac34fe6-00ab-45a3-accc-08ee7b7dff55 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:51.116711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cac34fe6-00ab-45a3-accc-08ee7b7dff55 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:51.117170 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cac34fe6-00ab-45a3-accc-08ee7b7dff55 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:51.117948 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cac34fe6-00ab-45a3-accc-08ee7b7dff55 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:51.118390 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-cac34fe6-00ab-45a3-accc-08ee7b7dff55 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:51.255647 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-cac34fe6-00ab-45a3-accc-08ee7b7dff55 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:51.264377 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-cac34fe6-00ab-45a3-accc-08ee7b7dff55 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1315 microversion: 2.1 time: 0.159830 May 12 07:26:51.264934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1646/3195] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:51 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:52.281569 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-cc2c436c-cc21-4198-84d1-083713ae549a tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:52.282190 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-cc2c436c-cc21-4198-84d1-083713ae549a tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:52.288557 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc2c436c-cc21-4198-84d1-083713ae549a tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:52.289013 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc2c436c-cc21-4198-84d1-083713ae549a tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:52.292727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc2c436c-cc21-4198-84d1-083713ae549a tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:52.292727 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-cc2c436c-cc21-4198-84d1-083713ae549a tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:52.422252 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-cc2c436c-cc21-4198-84d1-083713ae549a tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:52.429433 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-cc2c436c-cc21-4198-84d1-083713ae549a tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1315 microversion: 2.1 time: 0.151952 May 12 07:26:52.430001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1550/3196] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:52 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:52.674624 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:26:52.675190 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:26:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:26:53.447090 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-06f72f0c-f63c-4fdf-b11b-6ff8c19c3f1d tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:53.447745 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-06f72f0c-f63c-4fdf-b11b-6ff8c19c3f1d tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:53.454772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-06f72f0c-f63c-4fdf-b11b-6ff8c19c3f1d tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:53.455228 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-06f72f0c-f63c-4fdf-b11b-6ff8c19c3f1d tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:53.456847 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-06f72f0c-f63c-4fdf-b11b-6ff8c19c3f1d tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:53.457398 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-06f72f0c-f63c-4fdf-b11b-6ff8c19c3f1d tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:53.592782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-06f72f0c-f63c-4fdf-b11b-6ff8c19c3f1d tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:53.600025 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-06f72f0c-f63c-4fdf-b11b-6ff8c19c3f1d tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1315 microversion: 2.1 time: 0.157712 May 12 07:26:53.600649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1647/3197] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:53 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:54.616908 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3b18cc11-2f6f-4a08-8d25-19582432e317 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:54.617533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3b18cc11-2f6f-4a08-8d25-19582432e317 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:54.624794 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b18cc11-2f6f-4a08-8d25-19582432e317 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:54.625252 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b18cc11-2f6f-4a08-8d25-19582432e317 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:54.626032 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b18cc11-2f6f-4a08-8d25-19582432e317 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:54.626525 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3b18cc11-2f6f-4a08-8d25-19582432e317 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:54.792244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-3b18cc11-2f6f-4a08-8d25-19582432e317 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:54.799820 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3b18cc11-2f6f-4a08-8d25-19582432e317 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1315 microversion: 2.1 time: 0.186801 May 12 07:26:54.800516 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1551/3198] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:54 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:54.963526 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-43dcca7f-85ef-499f-bd25-af932ced8007 req-ab0ef7c1-b5e3-4f39-8f44-17dd5fc34cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814ff910-9b81-4593-95bb-939479745bbe", "name": "network-vif-plugged", "status": "completed", "tag": "d517b649-df12-4804-8769-3d2cb1f6bad4"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:26:54.973612 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-43dcca7f-85ef-499f-bd25-af932ced8007 req-ab0ef7c1-b5e3-4f39-8f44-17dd5fc34cee service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:54.974178 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-43dcca7f-85ef-499f-bd25-af932ced8007 req-ab0ef7c1-b5e3-4f39-8f44-17dd5fc34cee service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:54.987960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-43dcca7f-85ef-499f-bd25-af932ced8007 req-ab0ef7c1-b5e3-4f39-8f44-17dd5fc34cee service nova] Creating event network-vif-plugged:d517b649-df12-4804-8769-3d2cb1f6bad4 for instance 814ff910-9b81-4593-95bb-939479745bbe on hv-cinder-76606 May 12 07:26:54.994805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-43dcca7f-85ef-499f-bd25-af932ced8007 req-ab0ef7c1-b5e3-4f39-8f44-17dd5fc34cee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225608 May 12 07:26:54.996226 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1648/3199] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:55.820235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-19579151-efb5-4c8d-8a86-ad4106d17c14 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:55.820235 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-19579151-efb5-4c8d-8a86-ad4106d17c14 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:55.825315 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19579151-efb5-4c8d-8a86-ad4106d17c14 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:55.825773 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19579151-efb5-4c8d-8a86-ad4106d17c14 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:55.826556 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19579151-efb5-4c8d-8a86-ad4106d17c14 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:55.827128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-19579151-efb5-4c8d-8a86-ad4106d17c14 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:55.968259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-19579151-efb5-4c8d-8a86-ad4106d17c14 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:55.976037 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-19579151-efb5-4c8d-8a86-ad4106d17c14 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1315 microversion: 2.1 time: 0.162844 May 12 07:26:55.976604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1552/3200] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:55 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:26:56.999583 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8e49440c-753e-4352-8864-00995555e224 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:57.000892 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8e49440c-753e-4352-8864-00995555e224 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:57.007711 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e49440c-753e-4352-8864-00995555e224 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:57.008518 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e49440c-753e-4352-8864-00995555e224 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:57.009385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e49440c-753e-4352-8864-00995555e224 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:57.009826 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8e49440c-753e-4352-8864-00995555e224 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:57.153150 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8e49440c-753e-4352-8864-00995555e224 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:57.161231 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8e49440c-753e-4352-8864-00995555e224 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1464 microversion: 2.1 time: 0.167701 May 12 07:26:57.162026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1649/3201] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:56 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:57.200024 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-3254a2ce-8f94-4215-9eb3-6f550d61f01c tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:57.200720 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3254a2ce-8f94-4215-9eb3-6f550d61f01c tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:57.207192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3254a2ce-8f94-4215-9eb3-6f550d61f01c tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:57.207652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3254a2ce-8f94-4215-9eb3-6f550d61f01c tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:57.208520 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3254a2ce-8f94-4215-9eb3-6f550d61f01c tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:57.208967 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-3254a2ce-8f94-4215-9eb3-6f550d61f01c tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:57.237432 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-3254a2ce-8f94-4215-9eb3-6f550d61f01c tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Going to try to terminate instance {{(pid=124024) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:26:57.543517 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-3254a2ce-8f94-4215-9eb3-6f550d61f01c tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "DELETE /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 204 len: 0 microversion: 2.1 time: 0.347636 May 12 07:26:57.544365 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1553/3202] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:26:57 2022] DELETE /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:26:57.552515 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-957f23e9-b37f-4058-94c6-d480720ba0ea tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:57.553127 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-957f23e9-b37f-4058-94c6-d480720ba0ea tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:57.559316 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-957f23e9-b37f-4058-94c6-d480720ba0ea tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:57.559793 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-957f23e9-b37f-4058-94c6-d480720ba0ea tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:57.560554 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-957f23e9-b37f-4058-94c6-d480720ba0ea tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:57.560988 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-957f23e9-b37f-4058-94c6-d480720ba0ea tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:57.701477 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-957f23e9-b37f-4058-94c6-d480720ba0ea tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:57.710270 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-957f23e9-b37f-4058-94c6-d480720ba0ea tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1470 microversion: 2.1 time: 0.161487 May 12 07:26:57.710870 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1650/3203] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:57 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:58.734970 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-16e356c3-d3dd-4efc-9281-1f00f51606cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:58.735573 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-16e356c3-d3dd-4efc-9281-1f00f51606cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:58.741996 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16e356c3-d3dd-4efc-9281-1f00f51606cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:58.742444 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16e356c3-d3dd-4efc-9281-1f00f51606cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:58.743273 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16e356c3-d3dd-4efc-9281-1f00f51606cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:58.743722 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-16e356c3-d3dd-4efc-9281-1f00f51606cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:58.886560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-16e356c3-d3dd-4efc-9281-1f00f51606cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:26:58.893912 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-16e356c3-d3dd-4efc-9281-1f00f51606cd tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1470 microversion: 2.1 time: 0.163169 May 12 07:26:58.894479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1554/3204] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:58 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:26:59.390536 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-cb00902b-ff1d-4fd4-bd57-1bf0e59ef898 req-f758d268-3e47-4480-a15c-e7f02648b630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814ff910-9b81-4593-95bb-939479745bbe", "name": "network-vif-deleted", "tag": "d517b649-df12-4804-8769-3d2cb1f6bad4"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:26:59.400348 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-cb00902b-ff1d-4fd4-bd57-1bf0e59ef898 req-f758d268-3e47-4480-a15c-e7f02648b630 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:59.400805 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-cb00902b-ff1d-4fd4-bd57-1bf0e59ef898 req-f758d268-3e47-4480-a15c-e7f02648b630 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:59.415775 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-cb00902b-ff1d-4fd4-bd57-1bf0e59ef898 req-f758d268-3e47-4480-a15c-e7f02648b630 service nova] Creating event network-vif-deleted:d517b649-df12-4804-8769-3d2cb1f6bad4 for instance 814ff910-9b81-4593-95bb-939479745bbe on hv-cinder-76606 May 12 07:26:59.422263 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-cb00902b-ff1d-4fd4-bd57-1bf0e59ef898 req-f758d268-3e47-4480-a15c-e7f02648b630 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036965 May 12 07:26:59.423675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1651/3205] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:26:59.910585 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1b64539d-1694-4db0-b035-5497ef7bef56 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:26:59.911386 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1b64539d-1694-4db0-b035-5497ef7bef56 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:26:59.918330 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b64539d-1694-4db0-b035-5497ef7bef56 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:59.918842 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b64539d-1694-4db0-b035-5497ef7bef56 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:59.919612 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b64539d-1694-4db0-b035-5497ef7bef56 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:59.920076 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b64539d-1694-4db0-b035-5497ef7bef56 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:59.954911 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b64539d-1694-4db0-b035-5497ef7bef56 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:26:59.955359 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1b64539d-1694-4db0-b035-5497ef7bef56 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:26:59.955836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.objects.instance [None req-1b64539d-1694-4db0-b035-5497ef7bef56 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lazy-loading 'fault' on Instance uuid 814ff910-9b81-4593-95bb-939479745bbe {{(pid=124024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:26:59.996639 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1b64539d-1694-4db0-b035-5497ef7bef56 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4761df768dea4a90a1ae831cebf0f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae3a88827a548a3814d29074421ad90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:00.004750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1b64539d-1694-4db0-b035-5497ef7bef56 tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 200 len: 1305 microversion: 2.1 time: 0.098166 May 12 07:27:00.012790 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1555/3206] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:26:59 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:01.023815 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d5ccd8d4-b63a-482a-b693-d61d8818576e tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:01.024610 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-d5ccd8d4-b63a-482a-b693-d61d8818576e tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] [instance: 814ff910-9b81-4593-95bb-939479745bbe] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:01.031904 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5ccd8d4-b63a-482a-b693-d61d8818576e tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:01.032428 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5ccd8d4-b63a-482a-b693-d61d8818576e tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:01.033280 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5ccd8d4-b63a-482a-b693-d61d8818576e tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:01.033925 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-d5ccd8d4-b63a-482a-b693-d61d8818576e tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:01.048511 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-d5ccd8d4-b63a-482a-b693-d61d8818576e tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] HTTP exception thrown: Instance 814ff910-9b81-4593-95bb-939479745bbe could not be found. May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d5ccd8d4-b63a-482a-b693-d61d8818576e tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Request method failure captured: May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe HTTP/1.1 May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifLaxKGDBaO4zIYAYfxSGbe64u6WdgwVonBGSToVLRTwmxSeec1_ALmclfzTz98smZVxTMVWeG-nxgcWXtUNphAwZaK0axymKtPERLorA6Bh_IJfcY11xhpjJ0WZbNMVaEezX3Z8NArcDDHhSpdKJeVZ0NUxA4glR8PVjiG1lrVn4FOo May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: 5ae3a88827a548a3814d29074421ad90 May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-VolumesNegativeTest-1628103414 May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:27:01.050158 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ae3a88827a548a3814d29074421ad90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ae3a88827a548a3814d29074421ad90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ae3a88827a548a3814d29074421ad90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ae3a88827a548a3814d29074421ad90"}]}] May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-VolumesNegativeTest-1628103414 May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: 5ae3a88827a548a3814d29074421ad90 May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-VolumesNegativeTest-1628103414 May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-VolumesNegativeTest-1628103414-project May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: 4761df768dea4a90a1ae831cebf0f95f May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-VolumesNegativeTest-1628103414-project May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance 814ff910-9b81-4593-95bb-939479745bbe could not be found. May 12 07:27:01.052108 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': '814ff910-9b81-4593-95bb-939479745bbe'} May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 814ff910-9b81-4593-95bb-939479745bbe could not be found. May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:27:01.053080 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 814ff910-9b81-4593-95bb-939479745bbe could not be found. May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 814ff910-9b81-4593-95bb-939479745bbe could not be found. May 12 07:27:01.054578 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:27:01.056349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-d5ccd8d4-b63a-482a-b693-d61d8818576e tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] Returning 404 to user: Instance 814ff910-9b81-4593-95bb-939479745bbe could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:27:01.056349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-d5ccd8d4-b63a-482a-b693-d61d8818576e tempest-VolumesNegativeTest-1628103414 tempest-VolumesNegativeTest-1628103414-project] 10.222.0.25 "GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe" status: 404 len: 111 microversion: 2.1 time: 0.032536 May 12 07:27:01.056349 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1652/3207] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:01 2022] GET /compute/v2.1/servers/814ff910-9b81-4593-95bb-939479745bbe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:27:35.329976 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-15e6017e-c72d-4aca-94eb-acee1da42a4e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Action: 'create', calling method: .version_select at 0x7f89da1c8b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1782714850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYb2oc8XBn/reb2NNltLDXJHWMxCOme79PZqmz+A0RECgZ/g9amFWD9oRaRaNTUvA1gNBAKrtlvAWLA9lnAar6goZo18UXEzDYi36PrWaW47MeTkUk40uVladLjPj6f+Q=="}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:27:35.344165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-15e6017e-c72d-4aca-94eb-acee1da42a4e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Getting quotas for project b0d0d48c1db3496da28cdc39061b3d70. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 07:27:35.347732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.quota [None req-15e6017e-c72d-4aca-94eb-acee1da42a4e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Getting quotas for user d64b5396be8944ce9fafc9034f54d55f and project b0d0d48c1db3496da28cdc39061b3d70. Resources: {'key_pairs'} {{(pid=124024) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 07:27:35.432195 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-15e6017e-c72d-4aca-94eb-acee1da42a4e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.106141 May 12 07:27:35.432937 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1556/3208] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 12 07:27:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:27:35.533009 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-978710810", "imageRef": "3a3c65f9-be52-4c09-9868-f121baedb200", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1782714850", "networks": [{"uuid": "4dc87520-b5fc-452d-a557-a78938d8b9cb"}]}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:27:35.717338 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.network.neutron [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] validate_networks() for [('4dc87520-b5fc-452d-a557-a78938d8b9cb', None, None, None, None, None)] {{(pid=124025) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 07:27:36.185525 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Flavor limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 07:27:36.187212 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Image limits 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 07:27:36.187720 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Flavor pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 07:27:36.188167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Image pref 0:0:0 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 07:27:36.188619 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.virt.hardware [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 07:27:36.197216 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:36.197675 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:36.198481 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:36.198920 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:36.215508 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Getting quotas for project b0d0d48c1db3496da28cdc39061b3d70. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 07:27:36.219399 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.quota [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Getting quotas for user d64b5396be8944ce9fafc9034f54d55f and project b0d0d48c1db3496da28cdc39061b3d70. Resources: {'cores', 'instances', 'ram'} {{(pid=124025) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 07:27:36.230370 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Going to run 1 instances... {{(pid=124025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 07:27:36.232245 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a3c65f9-be52-4c09-9868-f121baedb200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 07:27:36.325422 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-754ad130-5dc1-4604-9d37-3588e2fd2942 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795602 May 12 07:27:36.326145 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1653/3209] 10.222.0.25 () {60 vars in 1146 bytes} [Thu May 12 07:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 07:27:36.336745 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2323d19b-68e7-4445-acb9-586016336fbb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:36.337369 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2323d19b-68e7-4445-acb9-586016336fbb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:36.441927 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-2323d19b-68e7-4445-acb9-586016336fbb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:36.449852 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2323d19b-68e7-4445-acb9-586016336fbb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1258 microversion: 2.1 time: 0.117528 May 12 07:27:36.450406 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1557/3210] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:36 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1258 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:37.468026 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-08b09957-7d7d-44d2-a541-b93850b4e967 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:37.468644 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-08b09957-7d7d-44d2-a541-b93850b4e967 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:37.474707 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08b09957-7d7d-44d2-a541-b93850b4e967 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:37.475156 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08b09957-7d7d-44d2-a541-b93850b4e967 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:37.476020 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08b09957-7d7d-44d2-a541-b93850b4e967 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:37.476466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-08b09957-7d7d-44d2-a541-b93850b4e967 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:37.540038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-08b09957-7d7d-44d2-a541-b93850b4e967 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:37.547322 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-08b09957-7d7d-44d2-a541-b93850b4e967 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1262 microversion: 2.1 time: 0.084526 May 12 07:27:37.547919 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1654/3211] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:37 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:38.564844 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-9429f725-e139-466b-a904-5f7ce5435a29 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:38.566237 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-9429f725-e139-466b-a904-5f7ce5435a29 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:38.572642 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9429f725-e139-466b-a904-5f7ce5435a29 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:38.573179 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9429f725-e139-466b-a904-5f7ce5435a29 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:38.573917 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9429f725-e139-466b-a904-5f7ce5435a29 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:38.577680 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-9429f725-e139-466b-a904-5f7ce5435a29 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:38.638685 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-9429f725-e139-466b-a904-5f7ce5435a29 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:38.646050 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-9429f725-e139-466b-a904-5f7ce5435a29 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1318 microversion: 2.1 time: 0.085072 May 12 07:27:38.647029 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1558/3212] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:38 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1318 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:39.665539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a5be18b5-d85b-420b-8041-da6041ea41fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:39.666539 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a5be18b5-d85b-420b-8041-da6041ea41fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:39.681783 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5be18b5-d85b-420b-8041-da6041ea41fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:39.682227 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5be18b5-d85b-420b-8041-da6041ea41fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:39.683035 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5be18b5-d85b-420b-8041-da6041ea41fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:39.688689 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a5be18b5-d85b-420b-8041-da6041ea41fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:39.991366 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a5be18b5-d85b-420b-8041-da6041ea41fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:40.004916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a5be18b5-d85b-420b-8041-da6041ea41fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.340190 May 12 07:27:40.005561 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1655/3213] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:39 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:40.702506 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-4f8de2db-3be8-4c88-94e0-e3474bab6b47 req-df64b482-4bdd-4a42-8017-09e7d141d4fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca44b113-f00d-4b63-a964-3519c7729bd8", "tag": "1e73df73-0147-48ef-9205-4182d6bf68ca"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:27:40.716571 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-4f8de2db-3be8-4c88-94e0-e3474bab6b47 req-df64b482-4bdd-4a42-8017-09e7d141d4fc service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:40.717333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-4f8de2db-3be8-4c88-94e0-e3474bab6b47 req-df64b482-4bdd-4a42-8017-09e7d141d4fc service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:40.733014 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-4f8de2db-3be8-4c88-94e0-e3474bab6b47 req-df64b482-4bdd-4a42-8017-09e7d141d4fc service nova] Creating event network-changed:1e73df73-0147-48ef-9205-4182d6bf68ca for instance ca44b113-f00d-4b63-a964-3519c7729bd8 on hv-cinder-76606 May 12 07:27:40.743462 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-4f8de2db-3be8-4c88-94e0-e3474bab6b47 req-df64b482-4bdd-4a42-8017-09e7d141d4fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045251 May 12 07:27:40.744206 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1559/3214] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:27:41.022545 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-811ac3c9-4e7b-413e-b36a-4afb1269a889 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:41.023220 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-811ac3c9-4e7b-413e-b36a-4afb1269a889 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:41.039586 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-811ac3c9-4e7b-413e-b36a-4afb1269a889 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:41.040152 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-811ac3c9-4e7b-413e-b36a-4afb1269a889 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:41.041092 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-811ac3c9-4e7b-413e-b36a-4afb1269a889 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:41.041634 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-811ac3c9-4e7b-413e-b36a-4afb1269a889 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:41.194684 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-811ac3c9-4e7b-413e-b36a-4afb1269a889 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:41.202134 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-811ac3c9-4e7b-413e-b36a-4afb1269a889 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.183431 May 12 07:27:41.202700 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1656/3215] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:41 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:42.220480 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8048a6fd-b175-4341-a6b4-43549bf39357 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:42.221165 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8048a6fd-b175-4341-a6b4-43549bf39357 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:42.227777 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8048a6fd-b175-4341-a6b4-43549bf39357 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:42.228234 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8048a6fd-b175-4341-a6b4-43549bf39357 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:42.229011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8048a6fd-b175-4341-a6b4-43549bf39357 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:42.229453 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8048a6fd-b175-4341-a6b4-43549bf39357 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:42.388943 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8048a6fd-b175-4341-a6b4-43549bf39357 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:42.396805 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8048a6fd-b175-4341-a6b4-43549bf39357 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.180606 May 12 07:27:42.398108 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1560/3216] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:42 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:43.414655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a4d7fa0d-3051-479e-8a41-0c835f1dfa6a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:43.415411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a4d7fa0d-3051-479e-8a41-0c835f1dfa6a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:43.422053 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4d7fa0d-3051-479e-8a41-0c835f1dfa6a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:43.422498 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4d7fa0d-3051-479e-8a41-0c835f1dfa6a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:43.423283 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4d7fa0d-3051-479e-8a41-0c835f1dfa6a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:43.424001 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a4d7fa0d-3051-479e-8a41-0c835f1dfa6a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:43.596044 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a4d7fa0d-3051-479e-8a41-0c835f1dfa6a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:43.606073 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a4d7fa0d-3051-479e-8a41-0c835f1dfa6a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.195354 May 12 07:27:43.606934 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1657/3217] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:43 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:27:44.622625 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-143a1554-5206-434d-af48-bded9a58f5c5 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:44.623259 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-143a1554-5206-434d-af48-bded9a58f5c5 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:44.630278 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-143a1554-5206-434d-af48-bded9a58f5c5 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:44.630791 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-143a1554-5206-434d-af48-bded9a58f5c5 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:44.631605 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-143a1554-5206-434d-af48-bded9a58f5c5 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:44.632169 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-143a1554-5206-434d-af48-bded9a58f5c5 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:44.787422 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-143a1554-5206-434d-af48-bded9a58f5c5 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:44.796174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-143a1554-5206-434d-af48-bded9a58f5c5 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.177542 May 12 07:27:44.797174 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1561/3218] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:44 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:45.814356 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-df3d12e0-6121-42bc-a940-485f393c509f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:45.814973 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-df3d12e0-6121-42bc-a940-485f393c509f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:45.821494 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df3d12e0-6121-42bc-a940-485f393c509f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:45.822028 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df3d12e0-6121-42bc-a940-485f393c509f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:45.822912 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df3d12e0-6121-42bc-a940-485f393c509f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:45.823438 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-df3d12e0-6121-42bc-a940-485f393c509f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:45.969225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-df3d12e0-6121-42bc-a940-485f393c509f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:45.978692 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-df3d12e0-6121-42bc-a940-485f393c509f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.168533 May 12 07:27:45.979766 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1658/3219] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:45 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:46.998410 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a380b2d1-d836-4cff-973a-bae3c80cca7f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:46.999031 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a380b2d1-d836-4cff-973a-bae3c80cca7f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:47.005888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a380b2d1-d836-4cff-973a-bae3c80cca7f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:47.006350 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a380b2d1-d836-4cff-973a-bae3c80cca7f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:47.007144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a380b2d1-d836-4cff-973a-bae3c80cca7f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:47.007587 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a380b2d1-d836-4cff-973a-bae3c80cca7f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:47.156610 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a380b2d1-d836-4cff-973a-bae3c80cca7f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:47.164113 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a380b2d1-d836-4cff-973a-bae3c80cca7f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.171199 May 12 07:27:47.164688 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1562/3220] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:46 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:48.181979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9f71ad4e-c380-4fb4-9c02-67a3f4c95a5a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:48.182596 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9f71ad4e-c380-4fb4-9c02-67a3f4c95a5a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:48.189372 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f71ad4e-c380-4fb4-9c02-67a3f4c95a5a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:48.189822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f71ad4e-c380-4fb4-9c02-67a3f4c95a5a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:48.190590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f71ad4e-c380-4fb4-9c02-67a3f4c95a5a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:48.191027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f71ad4e-c380-4fb4-9c02-67a3f4c95a5a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:48.314333 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9f71ad4e-c380-4fb4-9c02-67a3f4c95a5a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:48.321527 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9f71ad4e-c380-4fb4-9c02-67a3f4c95a5a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.143382 May 12 07:27:48.322096 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1659/3221] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:48 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:49.338560 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-73e6547c-790f-452d-a30e-7ba0a8ada887 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:49.339194 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-73e6547c-790f-452d-a30e-7ba0a8ada887 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:49.346168 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-73e6547c-790f-452d-a30e-7ba0a8ada887 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:49.346607 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-73e6547c-790f-452d-a30e-7ba0a8ada887 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:49.347368 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-73e6547c-790f-452d-a30e-7ba0a8ada887 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:49.347834 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-73e6547c-790f-452d-a30e-7ba0a8ada887 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:49.476479 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-73e6547c-790f-452d-a30e-7ba0a8ada887 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:49.483533 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-73e6547c-790f-452d-a30e-7ba0a8ada887 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.148894 May 12 07:27:49.484128 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1563/3222] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:49 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:50.500163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-bb948963-aac4-417e-aa01-faa7c8c08534 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:50.500779 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-bb948963-aac4-417e-aa01-faa7c8c08534 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:50.507041 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb948963-aac4-417e-aa01-faa7c8c08534 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:50.507487 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb948963-aac4-417e-aa01-faa7c8c08534 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:50.508312 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb948963-aac4-417e-aa01-faa7c8c08534 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:50.508757 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-bb948963-aac4-417e-aa01-faa7c8c08534 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:50.636247 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-bb948963-aac4-417e-aa01-faa7c8c08534 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:50.644060 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-bb948963-aac4-417e-aa01-faa7c8c08534 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.147900 May 12 07:27:50.644672 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1660/3223] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:50 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:51.660886 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-8058a062-873d-4a7d-af09-4cc36f7fa032 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:51.661529 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-8058a062-873d-4a7d-af09-4cc36f7fa032 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:51.667767 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8058a062-873d-4a7d-af09-4cc36f7fa032 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:51.668164 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8058a062-873d-4a7d-af09-4cc36f7fa032 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:51.669409 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8058a062-873d-4a7d-af09-4cc36f7fa032 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:51.669840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-8058a062-873d-4a7d-af09-4cc36f7fa032 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:51.798644 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-8058a062-873d-4a7d-af09-4cc36f7fa032 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:51.806267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-8058a062-873d-4a7d-af09-4cc36f7fa032 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.149207 May 12 07:27:51.806829 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1564/3224] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:51 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:52.823330 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-8f3fa002-4821-4a80-a374-31047ad02d8d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:52.823979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-8f3fa002-4821-4a80-a374-31047ad02d8d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:52.830611 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f3fa002-4821-4a80-a374-31047ad02d8d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:52.831891 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f3fa002-4821-4a80-a374-31047ad02d8d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:52.832038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f3fa002-4821-4a80-a374-31047ad02d8d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:52.832453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-8f3fa002-4821-4a80-a374-31047ad02d8d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:52.959331 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-8f3fa002-4821-4a80-a374-31047ad02d8d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:52.966573 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-8f3fa002-4821-4a80-a374-31047ad02d8d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.147242 May 12 07:27:52.967173 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1661/3225] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:52 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:53.982840 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-d6e2f4ca-1be5-4330-bf8f-28501df1f29f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:53.983456 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-d6e2f4ca-1be5-4330-bf8f-28501df1f29f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:53.990023 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6e2f4ca-1be5-4330-bf8f-28501df1f29f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:53.990512 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6e2f4ca-1be5-4330-bf8f-28501df1f29f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:53.991291 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6e2f4ca-1be5-4330-bf8f-28501df1f29f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:53.991758 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-d6e2f4ca-1be5-4330-bf8f-28501df1f29f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:54.115230 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-d6e2f4ca-1be5-4330-bf8f-28501df1f29f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:54.122441 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-d6e2f4ca-1be5-4330-bf8f-28501df1f29f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.143432 May 12 07:27:54.123492 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1565/3226] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:53 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:55.140160 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fe2c9ad0-10fc-45fc-aa27-38d4d1e6fe0d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:55.140791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fe2c9ad0-10fc-45fc-aa27-38d4d1e6fe0d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:55.147024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe2c9ad0-10fc-45fc-aa27-38d4d1e6fe0d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:55.147488 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe2c9ad0-10fc-45fc-aa27-38d4d1e6fe0d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:55.148279 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe2c9ad0-10fc-45fc-aa27-38d4d1e6fe0d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:55.148715 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fe2c9ad0-10fc-45fc-aa27-38d4d1e6fe0d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:55.276462 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fe2c9ad0-10fc-45fc-aa27-38d4d1e6fe0d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:55.284215 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fe2c9ad0-10fc-45fc-aa27-38d4d1e6fe0d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.148422 May 12 07:27:55.284802 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1662/3227] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:55 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:56.302188 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0ca295bf-61ff-49f9-9851-4a1b87a27269 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:56.302813 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0ca295bf-61ff-49f9-9851-4a1b87a27269 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:56.309162 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ca295bf-61ff-49f9-9851-4a1b87a27269 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:56.309643 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ca295bf-61ff-49f9-9851-4a1b87a27269 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:56.310412 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ca295bf-61ff-49f9-9851-4a1b87a27269 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:56.310847 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ca295bf-61ff-49f9-9851-4a1b87a27269 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:56.438177 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0ca295bf-61ff-49f9-9851-4a1b87a27269 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:56.445455 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0ca295bf-61ff-49f9-9851-4a1b87a27269 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.148118 May 12 07:27:56.446047 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1566/3228] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:56 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:57.428499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-77025647-92b1-46d5-9acb-f25a52f4900c req-83fbfe17-4a6a-4aba-9d32-c12065fec282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca44b113-f00d-4b63-a964-3519c7729bd8", "name": "network-vif-plugged", "status": "completed", "tag": "1e73df73-0147-48ef-9205-4182d6bf68ca"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:27:57.440185 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-77025647-92b1-46d5-9acb-f25a52f4900c req-83fbfe17-4a6a-4aba-9d32-c12065fec282 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:57.440641 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-77025647-92b1-46d5-9acb-f25a52f4900c req-83fbfe17-4a6a-4aba-9d32-c12065fec282 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:57.452004 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-77025647-92b1-46d5-9acb-f25a52f4900c req-83fbfe17-4a6a-4aba-9d32-c12065fec282 service nova] Creating event network-vif-plugged:1e73df73-0147-48ef-9205-4182d6bf68ca for instance ca44b113-f00d-4b63-a964-3519c7729bd8 on hv-cinder-76606 May 12 07:27:57.457718 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-77025647-92b1-46d5-9acb-f25a52f4900c req-83fbfe17-4a6a-4aba-9d32-c12065fec282 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045976 May 12 07:27:57.458334 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1663/3229] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:27:57.462141 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-eb03bdfc-8c48-4391-b4c3-78e1a52e6eed tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:57.462760 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-eb03bdfc-8c48-4391-b4c3-78e1a52e6eed tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:57.477997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb03bdfc-8c48-4391-b4c3-78e1a52e6eed tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:57.477997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb03bdfc-8c48-4391-b4c3-78e1a52e6eed tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:57.477997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb03bdfc-8c48-4391-b4c3-78e1a52e6eed tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:57.477997 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-eb03bdfc-8c48-4391-b4c3-78e1a52e6eed tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:57.607400 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-eb03bdfc-8c48-4391-b4c3-78e1a52e6eed tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:57.615241 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-eb03bdfc-8c48-4391-b4c3-78e1a52e6eed tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.156882 May 12 07:27:57.617732 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1567/3230] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:57 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:27:58.633397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a138c49b-857e-4613-b160-2590f9b33375 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:58.634163 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a138c49b-857e-4613-b160-2590f9b33375 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:58.648106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a138c49b-857e-4613-b160-2590f9b33375 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:58.648106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a138c49b-857e-4613-b160-2590f9b33375 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:58.648106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a138c49b-857e-4613-b160-2590f9b33375 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:58.648106 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a138c49b-857e-4613-b160-2590f9b33375 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:58.776562 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a138c49b-857e-4613-b160-2590f9b33375 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:58.784492 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a138c49b-857e-4613-b160-2590f9b33375 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1358 microversion: 2.1 time: 0.155648 May 12 07:27:58.785059 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1664/3231] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:58 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:59.802377 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0cadcbf6-2832-4ece-9761-9d8ef2f74b2c tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:59.802929 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0cadcbf6-2832-4ece-9761-9d8ef2f74b2c tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:59.809374 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cadcbf6-2832-4ece-9761-9d8ef2f74b2c tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:59.809833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cadcbf6-2832-4ece-9761-9d8ef2f74b2c tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:59.810623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cadcbf6-2832-4ece-9761-9d8ef2f74b2c tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:59.811045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0cadcbf6-2832-4ece-9761-9d8ef2f74b2c tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:59.935923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0cadcbf6-2832-4ece-9761-9d8ef2f74b2c tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:27:59.944175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0cadcbf6-2832-4ece-9761-9d8ef2f74b2c tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1548 microversion: 2.1 time: 0.146428 May 12 07:27:59.944761 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1568/3232] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:59 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:27:59.960223 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-4c366513-bbe5-4b60-8b13-4780986b01d6 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:27:59.961393 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-4c366513-bbe5-4b60-8b13-4780986b01d6 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:27:59.968702 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c366513-bbe5-4b60-8b13-4780986b01d6 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:59.969153 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c366513-bbe5-4b60-8b13-4780986b01d6 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:27:59.970414 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c366513-bbe5-4b60-8b13-4780986b01d6 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:27:59.970848 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-4c366513-bbe5-4b60-8b13-4780986b01d6 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:00.356875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-4c366513-bbe5-4b60-8b13-4780986b01d6 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:00.364385 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-4c366513-bbe5-4b60-8b13-4780986b01d6 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1548 microversion: 2.1 time: 0.407923 May 12 07:28:00.364960 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1665/3233] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:27:59 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1548 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:00.380267 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1bfe1998-1190-4c77-9c83-78696e28c043 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:00.383876 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1bfe1998-1190-4c77-9c83-78696e28c043 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:00.384647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1bfe1998-1190-4c77-9c83-78696e28c043 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Searching by: {'deleted': False, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70'} {{(pid=124024) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 12 07:28:00.391175 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bfe1998-1190-4c77-9c83-78696e28c043 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:00.392244 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bfe1998-1190-4c77-9c83-78696e28c043 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:00.393060 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bfe1998-1190-4c77-9c83-78696e28c043 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:00.393502 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1bfe1998-1190-4c77-9c83-78696e28c043 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:00.482645 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.multi_cell_list [None req-1bfe1998-1190-4c77-9c83-78696e28c043 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124024) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 12 07:28:00.575149 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1bfe1998-1190-4c77-9c83-78696e28c043 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.198614 May 12 07:28:00.575742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1569/3234] 10.222.0.25 () {58 vars in 1124 bytes} [Thu May 12 07:28:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:28:00.586476 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3a78c7ae-57d3-4db2-a814-9030a661ae42 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:00.587098 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3a78c7ae-57d3-4db2-a814-9030a661ae42 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:00.592941 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a78c7ae-57d3-4db2-a814-9030a661ae42 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:00.593397 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a78c7ae-57d3-4db2-a814-9030a661ae42 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:00.594175 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a78c7ae-57d3-4db2-a814-9030a661ae42 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:00.594648 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3a78c7ae-57d3-4db2-a814-9030a661ae42 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:00.719678 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-3a78c7ae-57d3-4db2-a814-9030a661ae42 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:00.726916 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3a78c7ae-57d3-4db2-a814-9030a661ae42 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1548 microversion: 2.1 time: 0.144349 May 12 07:28:00.727473 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1666/3235] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:00 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1548 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:06.804598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e54d9f17-9c8f-4085-9ceb-322e8841426d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f812d6c3-7f16-4f13-8fe6-f4a30652b158"}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:28:06.804598 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-e54d9f17-9c8f-4085-9ceb-322e8841426d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:06.812602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e54d9f17-9c8f-4085-9ceb-322e8841426d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:06.812602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e54d9f17-9c8f-4085-9ceb-322e8841426d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:06.812602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e54d9f17-9c8f-4085-9ceb-322e8841426d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:06.812602 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-e54d9f17-9c8f-4085-9ceb-322e8841426d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:07.550389 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e54d9f17-9c8f-4085-9ceb-322e8841426d tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "POST /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752371 May 12 07:28:07.552665 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1570/3236] 10.222.0.25 () {60 vars in 1322 bytes} [Thu May 12 07:28:06 2022] POST /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:28:18.287819 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9d784af2-e74e-4f34-8808-5b57029bfa02 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:18.289014 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9d784af2-e74e-4f34-8808-5b57029bfa02 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:18.296667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d784af2-e74e-4f34-8808-5b57029bfa02 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:18.296667 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d784af2-e74e-4f34-8808-5b57029bfa02 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:18.297301 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d784af2-e74e-4f34-8808-5b57029bfa02 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:18.297813 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9d784af2-e74e-4f34-8808-5b57029bfa02 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:18.432590 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-9d784af2-e74e-4f34-8808-5b57029bfa02 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:18.440723 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9d784af2-e74e-4f34-8808-5b57029bfa02 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1594 microversion: 2.1 time: 0.157369 May 12 07:28:18.442538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1667/3237] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:18 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:20.612798 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-0bf0e4bf-5984-46dd-8282-4a9dd3d59492 req-735a9023-1711-458e-991c-b934d3ed0c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca44b113-f00d-4b63-a964-3519c7729bd8", "tag": "1e73df73-0147-48ef-9205-4182d6bf68ca"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:28:20.626086 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-0bf0e4bf-5984-46dd-8282-4a9dd3d59492 req-735a9023-1711-458e-991c-b934d3ed0c4a service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:20.626888 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-0bf0e4bf-5984-46dd-8282-4a9dd3d59492 req-735a9023-1711-458e-991c-b934d3ed0c4a service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:20.639159 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-0bf0e4bf-5984-46dd-8282-4a9dd3d59492 req-735a9023-1711-458e-991c-b934d3ed0c4a service nova] Creating event network-changed:1e73df73-0147-48ef-9205-4182d6bf68ca for instance ca44b113-f00d-4b63-a964-3519c7729bd8 on hv-cinder-76606 May 12 07:28:20.644646 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-0bf0e4bf-5984-46dd-8282-4a9dd3d59492 req-735a9023-1711-458e-991c-b934d3ed0c4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036282 May 12 07:28:20.645249 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1571/3238] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:28:23.009698 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-edf61d77-2527-4427-8674-d6e04fc52dc4 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-719136381"}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:28:23.010503 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-edf61d77-2527-4427-8674-d6e04fc52dc4 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:23.019453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edf61d77-2527-4427-8674-d6e04fc52dc4 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:23.019453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edf61d77-2527-4427-8674-d6e04fc52dc4 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:23.019453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edf61d77-2527-4427-8674-d6e04fc52dc4 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:23.019453 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-edf61d77-2527-4427-8674-d6e04fc52dc4 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:23.154603 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.network.security_group_api [None req-edf61d77-2527-4427-8674-d6e04fc52dc4 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Adding security group 3c8f09d4-a1fc-4be5-b981-bdb86156ebda to port 1e73df73-0147-48ef-9205-4182d6bf68ca May 12 07:28:23.684443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-edf61d77-2527-4427-8674-d6e04fc52dc4 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "POST /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/action" status: 202 len: 0 microversion: 2.1 time: 0.656147 May 12 07:28:23.684443 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1668/3239] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 07:28:23 2022] POST /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:28:23.685155 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-d98022b7-b041-4261-99b2-94510145dafa req-bf9b5336-b011-4cf3-82d4-d4da55e8a735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca44b113-f00d-4b63-a964-3519c7729bd8", "tag": "1e73df73-0147-48ef-9205-4182d6bf68ca"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:28:23.685597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-aadca31e-df00-4d84-8793-d7e7a944bf19 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:23.685597 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-aadca31e-df00-4d84-8793-d7e7a944bf19 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:23.685891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-d98022b7-b041-4261-99b2-94510145dafa req-bf9b5336-b011-4cf3-82d4-d4da55e8a735 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:23.685891 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-d98022b7-b041-4261-99b2-94510145dafa req-bf9b5336-b011-4cf3-82d4-d4da55e8a735 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:23.701802 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-d98022b7-b041-4261-99b2-94510145dafa req-bf9b5336-b011-4cf3-82d4-d4da55e8a735 service nova] Creating event network-changed:1e73df73-0147-48ef-9205-4182d6bf68ca for instance ca44b113-f00d-4b63-a964-3519c7729bd8 on hv-cinder-76606 May 12 07:28:23.702466 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aadca31e-df00-4d84-8793-d7e7a944bf19 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:23.702979 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aadca31e-df00-4d84-8793-d7e7a944bf19 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:23.704094 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aadca31e-df00-4d84-8793-d7e7a944bf19 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:23.707284 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-aadca31e-df00-4d84-8793-d7e7a944bf19 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:23.707742 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-d98022b7-b041-4261-99b2-94510145dafa req-bf9b5336-b011-4cf3-82d4-d4da55e8a735 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041697 May 12 07:28:23.709045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1572/3240] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 07:28:23.888670 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-aadca31e-df00-4d84-8793-d7e7a944bf19 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:23.898888 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-aadca31e-df00-4d84-8793-d7e7a944bf19 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1758 microversion: 2.1 time: 0.226029 May 12 07:28:23.899906 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1669/3241] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:23 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1758 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:38.330766 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c5d64f27-567c-4fcc-9966-7ddc19223237 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:28:38.331833 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c5d64f27-567c-4fcc-9966-7ddc19223237 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:38.338593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5d64f27-567c-4fcc-9966-7ddc19223237 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:38.339039 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5d64f27-567c-4fcc-9966-7ddc19223237 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:38.339826 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5d64f27-567c-4fcc-9966-7ddc19223237 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:38.340260 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c5d64f27-567c-4fcc-9966-7ddc19223237 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:38.527387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c5d64f27-567c-4fcc-9966-7ddc19223237 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "POST /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/action" status: 202 len: 0 microversion: 2.1 time: 0.201057 May 12 07:28:38.528118 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1573/3242] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 07:28:38 2022] POST /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:28:38.537018 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c33a25f5-fd2f-4bac-b482-4193097a606f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:38.537642 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c33a25f5-fd2f-4bac-b482-4193097a606f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:38.544105 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c33a25f5-fd2f-4bac-b482-4193097a606f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:38.544615 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c33a25f5-fd2f-4bac-b482-4193097a606f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:38.545400 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c33a25f5-fd2f-4bac-b482-4193097a606f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:38.545845 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c33a25f5-fd2f-4bac-b482-4193097a606f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:38.688187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-c33a25f5-fd2f-4bac-b482-4193097a606f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:38.696751 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c33a25f5-fd2f-4bac-b482-4193097a606f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1750 microversion: 2.1 time: 0.164445 May 12 07:28:38.697321 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1670/3243] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:38 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:39.715497 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-7dfa2063-8794-4666-bc6f-621ca08e7fd3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:39.716223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-7dfa2063-8794-4666-bc6f-621ca08e7fd3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:39.722333 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dfa2063-8794-4666-bc6f-621ca08e7fd3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:39.722783 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dfa2063-8794-4666-bc6f-621ca08e7fd3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:39.723545 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dfa2063-8794-4666-bc6f-621ca08e7fd3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:39.724011 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-7dfa2063-8794-4666-bc6f-621ca08e7fd3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:39.861693 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-7dfa2063-8794-4666-bc6f-621ca08e7fd3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:39.869458 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-7dfa2063-8794-4666-bc6f-621ca08e7fd3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1755 microversion: 2.1 time: 0.158645 May 12 07:28:39.870015 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1574/3244] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:39 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:40.886811 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-a38d441c-cce4-4739-ad86-174d3766b3b3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:40.887415 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-a38d441c-cce4-4739-ad86-174d3766b3b3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:40.893946 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a38d441c-cce4-4739-ad86-174d3766b3b3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:40.894399 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a38d441c-cce4-4739-ad86-174d3766b3b3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:40.895167 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a38d441c-cce4-4739-ad86-174d3766b3b3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:40.895607 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-a38d441c-cce4-4739-ad86-174d3766b3b3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:41.035822 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-a38d441c-cce4-4739-ad86-174d3766b3b3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:41.043565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-a38d441c-cce4-4739-ad86-174d3766b3b3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1755 microversion: 2.1 time: 0.160585 May 12 07:28:41.044164 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1671/3245] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:40 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:42.060775 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-c28142e8-48b6-4e89-b489-edebf3e9df2e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:42.061387 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-c28142e8-48b6-4e89-b489-edebf3e9df2e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:42.067635 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c28142e8-48b6-4e89-b489-edebf3e9df2e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:42.072226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c28142e8-48b6-4e89-b489-edebf3e9df2e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:42.072226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c28142e8-48b6-4e89-b489-edebf3e9df2e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:42.072226 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-c28142e8-48b6-4e89-b489-edebf3e9df2e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:42.227542 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-c28142e8-48b6-4e89-b489-edebf3e9df2e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:42.235305 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-c28142e8-48b6-4e89-b489-edebf3e9df2e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1755 microversion: 2.1 time: 0.178479 May 12 07:28:42.235889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1575/3246] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:42 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:43.252772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-2fc2960b-000c-4b4e-a3b7-9e79012cd6ad tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:43.253304 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-2fc2960b-000c-4b4e-a3b7-9e79012cd6ad tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:43.259538 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fc2960b-000c-4b4e-a3b7-9e79012cd6ad tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:43.260016 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fc2960b-000c-4b4e-a3b7-9e79012cd6ad tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:43.260772 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fc2960b-000c-4b4e-a3b7-9e79012cd6ad tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:43.261206 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-2fc2960b-000c-4b4e-a3b7-9e79012cd6ad tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:43.401093 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-2fc2960b-000c-4b4e-a3b7-9e79012cd6ad tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:43.408795 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-2fc2960b-000c-4b4e-a3b7-9e79012cd6ad tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1755 microversion: 2.1 time: 0.159959 May 12 07:28:43.409364 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1672/3247] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:43 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:44.427209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-72d01078-b827-4ccd-819c-8618ec37c016 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:44.427861 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-72d01078-b827-4ccd-819c-8618ec37c016 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:44.434750 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-72d01078-b827-4ccd-819c-8618ec37c016 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:44.435209 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-72d01078-b827-4ccd-819c-8618ec37c016 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:44.436001 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-72d01078-b827-4ccd-819c-8618ec37c016 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:44.436439 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-72d01078-b827-4ccd-819c-8618ec37c016 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:44.577882 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-72d01078-b827-4ccd-819c-8618ec37c016 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:44.585725 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-72d01078-b827-4ccd-819c-8618ec37c016 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1755 microversion: 2.1 time: 0.162520 May 12 07:28:44.586286 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1576/3248] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:44 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:45.602373 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ff6b4070-2f49-4d2a-8c34-71bb4d7dc8e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:45.602985 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ff6b4070-2f49-4d2a-8c34-71bb4d7dc8e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:45.609341 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff6b4070-2f49-4d2a-8c34-71bb4d7dc8e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:45.609791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff6b4070-2f49-4d2a-8c34-71bb4d7dc8e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:45.610560 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff6b4070-2f49-4d2a-8c34-71bb4d7dc8e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:45.611003 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ff6b4070-2f49-4d2a-8c34-71bb4d7dc8e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:45.751100 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ff6b4070-2f49-4d2a-8c34-71bb4d7dc8e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:45.759425 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ff6b4070-2f49-4d2a-8c34-71bb4d7dc8e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1755 microversion: 2.1 time: 0.161037 May 12 07:28:45.760024 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1673/3249] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:45 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:46.776868 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-1707e1b2-85dd-4ac7-9c44-2f32606f9fa3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:46.777486 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-1707e1b2-85dd-4ac7-9c44-2f32606f9fa3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:46.783647 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1707e1b2-85dd-4ac7-9c44-2f32606f9fa3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:46.786262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1707e1b2-85dd-4ac7-9c44-2f32606f9fa3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:46.786262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1707e1b2-85dd-4ac7-9c44-2f32606f9fa3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:46.786262 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-1707e1b2-85dd-4ac7-9c44-2f32606f9fa3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:46.922762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-1707e1b2-85dd-4ac7-9c44-2f32606f9fa3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:46.930769 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-1707e1b2-85dd-4ac7-9c44-2f32606f9fa3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1755 microversion: 2.1 time: 0.158276 May 12 07:28:46.931327 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1577/3250] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:46 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:47.948075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-e92d1b9b-9213-4656-b845-8088eaa12b24 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:47.948690 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-e92d1b9b-9213-4656-b845-8088eaa12b24 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:47.954896 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e92d1b9b-9213-4656-b845-8088eaa12b24 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:47.955340 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e92d1b9b-9213-4656-b845-8088eaa12b24 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:47.956135 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e92d1b9b-9213-4656-b845-8088eaa12b24 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:47.956567 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-e92d1b9b-9213-4656-b845-8088eaa12b24 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:48.098418 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-e92d1b9b-9213-4656-b845-8088eaa12b24 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:48.106776 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-e92d1b9b-9213-4656-b845-8088eaa12b24 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1755 microversion: 2.1 time: 0.162592 May 12 07:28:48.107339 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1674/3251] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:47 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:49.124304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-f5f142d3-c5b0-4916-91ed-453d22b0ef93 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:49.124860 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-f5f142d3-c5b0-4916-91ed-453d22b0ef93 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:49.131223 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5f142d3-c5b0-4916-91ed-453d22b0ef93 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:49.131679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5f142d3-c5b0-4916-91ed-453d22b0ef93 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:49.132537 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5f142d3-c5b0-4916-91ed-453d22b0ef93 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:49.133628 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-f5f142d3-c5b0-4916-91ed-453d22b0ef93 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:49.272045 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-f5f142d3-c5b0-4916-91ed-453d22b0ef93 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:49.279836 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-f5f142d3-c5b0-4916-91ed-453d22b0ef93 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1755 microversion: 2.1 time: 0.159424 May 12 07:28:49.280404 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1578/3252] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:49 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:28:50.297609 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-fb16d21c-9d2a-4ec4-82b5-9471384ad796 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:50.298224 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-fb16d21c-9d2a-4ec4-82b5-9471384ad796 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:50.304893 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb16d21c-9d2a-4ec4-82b5-9471384ad796 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:50.305233 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb16d21c-9d2a-4ec4-82b5-9471384ad796 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:50.306010 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb16d21c-9d2a-4ec4-82b5-9471384ad796 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:50.306640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-fb16d21c-9d2a-4ec4-82b5-9471384ad796 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:50.446791 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-fb16d21c-9d2a-4ec4-82b5-9471384ad796 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:50.454614 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-fb16d21c-9d2a-4ec4-82b5-9471384ad796 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1755 microversion: 2.1 time: 0.160901 May 12 07:28:50.455187 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1675/3253] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:50 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 07:28:51.472027 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-80c10a88-bf57-4912-ad21-5ff73eeb5bb3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:28:51.472616 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-80c10a88-bf57-4912-ad21-5ff73eeb5bb3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:28:51.479452 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80c10a88-bf57-4912-ad21-5ff73eeb5bb3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:51.479923 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80c10a88-bf57-4912-ad21-5ff73eeb5bb3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:51.480679 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80c10a88-bf57-4912-ad21-5ff73eeb5bb3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:28:51.481112 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-80c10a88-bf57-4912-ad21-5ff73eeb5bb3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:28:51.617123 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-80c10a88-bf57-4912-ad21-5ff73eeb5bb3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:28:51.625192 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-80c10a88-bf57-4912-ad21-5ff73eeb5bb3 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1758 microversion: 2.1 time: 0.156972 May 12 07:28:51.625762 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1579/3254] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:28:51 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1758 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:29:23.920771 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-534a8ac7-1a2e-47cf-81d0-bb337c1e042f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-719136381"}} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:29:23.921344 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-534a8ac7-1a2e-47cf-81d0-bb337c1e042f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:29:23.927288 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-534a8ac7-1a2e-47cf-81d0-bb337c1e042f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:23.927770 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-534a8ac7-1a2e-47cf-81d0-bb337c1e042f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:23.928540 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-534a8ac7-1a2e-47cf-81d0-bb337c1e042f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:23.929233 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-534a8ac7-1a2e-47cf-81d0-bb337c1e042f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:24.055277 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.network.security_group_api [None req-534a8ac7-1a2e-47cf-81d0-bb337c1e042f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Removing security group 3c8f09d4-a1fc-4be5-b981-bdb86156ebda from port 1e73df73-0147-48ef-9205-4182d6bf68ca May 12 07:29:24.495784 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-534a8ac7-1a2e-47cf-81d0-bb337c1e042f tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "POST /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/action" status: 202 len: 0 microversion: 2.1 time: 0.579186 May 12 07:29:24.501617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1676/3255] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 12 07:29:23 2022] POST /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:29:24.503101 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [req-53567b9c-12ae-4205-84cf-e3d04533321b req-fec668a1-9083-4c91-a6fe-a1e34666ed42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca44b113-f00d-4b63-a964-3519c7729bd8", "tag": "1e73df73-0147-48ef-9205-4182d6bf68ca"}]} {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:29:24.515592 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-53567b9c-12ae-4205-84cf-e3d04533321b req-fec668a1-9083-4c91-a6fe-a1e34666ed42 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:24.516072 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [req-53567b9c-12ae-4205-84cf-e3d04533321b req-fec668a1-9083-4c91-a6fe-a1e34666ed42 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:24.530793 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.compute.server_external_events [req-53567b9c-12ae-4205-84cf-e3d04533321b req-fec668a1-9083-4c91-a6fe-a1e34666ed42 service nova] Creating event network-changed:1e73df73-0147-48ef-9205-4182d6bf68ca for instance ca44b113-f00d-4b63-a964-3519c7729bd8 on hv-cinder-76606 May 12 07:29:24.548425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [req-53567b9c-12ae-4205-84cf-e3d04533321b req-fec668a1-9083-4c91-a6fe-a1e34666ed42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037148 May 12 07:29:24.548425 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1580/3256] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:29:26.043713 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-9f35c508-9a78-4b9d-b229-62a41b54a0e7 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:29:26.051325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-9f35c508-9a78-4b9d-b229-62a41b54a0e7 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:29:26.051325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f35c508-9a78-4b9d-b229-62a41b54a0e7 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:26.051325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f35c508-9a78-4b9d-b229-62a41b54a0e7 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:26.051325 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f35c508-9a78-4b9d-b229-62a41b54a0e7 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:26.051797 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-9f35c508-9a78-4b9d-b229-62a41b54a0e7 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:26.133027 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.objects.instance [None req-9f35c508-9a78-4b9d-b229-62a41b54a0e7 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lazy-loading 'services' on Instance uuid ca44b113-f00d-4b63-a964-3519c7729bd8 {{(pid=124025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 07:29:26.360274 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-9f35c508-9a78-4b9d-b229-62a41b54a0e7 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/os-volume_attachments/f812d6c3-7f16-4f13-8fe6-f4a30652b158" status: 202 len: 0 microversion: 2.1 time: 0.321390 May 12 07:29:26.360875 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1677/3257] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:29:26 2022] DELETE /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/os-volume_attachments/f812d6c3-7f16-4f13-8fe6-f4a30652b158 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 07:29:26.372858 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a772353f-4cbd-4c77-98bd-28ea91b7df38 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:29:26.374503 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a772353f-4cbd-4c77-98bd-28ea91b7df38 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:29:26.382784 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a772353f-4cbd-4c77-98bd-28ea91b7df38 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:26.383243 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a772353f-4cbd-4c77-98bd-28ea91b7df38 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:26.384056 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a772353f-4cbd-4c77-98bd-28ea91b7df38 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:26.384513 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a772353f-4cbd-4c77-98bd-28ea91b7df38 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:26.413593 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a772353f-4cbd-4c77-98bd-28ea91b7df38 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046968 May 12 07:29:26.418122 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1581/3258] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:29:26 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:29:26.554917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-dbc036c6-2feb-443c-aad2-5e919754d7ed req-292f92c6-babd-47ed-b06e-91bd0ef7e5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca44b113-f00d-4b63-a964-3519c7729bd8", "tag": "1e73df73-0147-48ef-9205-4182d6bf68ca"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:29:26.562971 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-dbc036c6-2feb-443c-aad2-5e919754d7ed req-292f92c6-babd-47ed-b06e-91bd0ef7e5e7 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:26.563411 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-dbc036c6-2feb-443c-aad2-5e919754d7ed req-292f92c6-babd-47ed-b06e-91bd0ef7e5e7 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:26.573856 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-dbc036c6-2feb-443c-aad2-5e919754d7ed req-292f92c6-babd-47ed-b06e-91bd0ef7e5e7 service nova] Creating event network-changed:1e73df73-0147-48ef-9205-4182d6bf68ca for instance ca44b113-f00d-4b63-a964-3519c7729bd8 on hv-cinder-76606 May 12 07:29:26.578655 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-dbc036c6-2feb-443c-aad2-5e919754d7ed req-292f92c6-babd-47ed-b06e-91bd0ef7e5e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028140 May 12 07:29:26.579238 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1678/3259] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:29:27.425553 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-331eecc7-4805-489f-9090-91a283d887e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:29:27.426472 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-331eecc7-4805-489f-9090-91a283d887e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:29:27.433567 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-331eecc7-4805-489f-9090-91a283d887e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:27.433955 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-331eecc7-4805-489f-9090-91a283d887e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:27.434710 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-331eecc7-4805-489f-9090-91a283d887e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:27.435144 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-331eecc7-4805-489f-9090-91a283d887e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:27.462604 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-331eecc7-4805-489f-9090-91a283d887e1 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041029 May 12 07:29:27.463468 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1582/3260] 10.222.0.25 () {58 vars in 1301 bytes} [Thu May 12 07:29:27 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 07:29:27.474378 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c940d3d9-db79-4687-a0a4-6c5830f8439a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:29:27.474962 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-c940d3d9-db79-4687-a0a4-6c5830f8439a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:29:27.481565 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c940d3d9-db79-4687-a0a4-6c5830f8439a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:27.482017 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c940d3d9-db79-4687-a0a4-6c5830f8439a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:27.482785 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c940d3d9-db79-4687-a0a4-6c5830f8439a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:27.483225 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-c940d3d9-db79-4687-a0a4-6c5830f8439a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:27.555429 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-c940d3d9-db79-4687-a0a4-6c5830f8439a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] HTTP exception thrown: Instance ca44b113-f00d-4b63-a964-3519c7729bd8 is not attached to volume f812d6c3-7f16-4f13-8fe6-f4a30652b158 May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c940d3d9-db79-4687-a0a4-6c5830f8439a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Request method failure captured: May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: DELETE /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/os-volume_attachments/f812d6c3-7f16-4f13-8fe6-f4a30652b158 HTTP/1.1 May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifLbU4uuniUnUKKjFj1rsTIH2RZgGJIFLdTLcS72O-KvkyRpViDNUsQSbkVs9mqFJ4fhCzmTm_jVgJzXOFIafS2DMsXOlI-97dC6hphKsjd51v12OsD18AOR1xL93t7FxA9Lchhwjvl6CXB7tw-iEOUHkdz6d7B6zAqzrnOzS3nD1SL8 May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: b0d0d48c1db3496da28cdc39061b3d70 May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-TestMinimumBasicScenario-980371912 May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:29:27.563829 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:29:27.565741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0d0d48c1db3496da28cdc39061b3d70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0d0d48c1db3496da28cdc39061b3d70", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0d0d48c1db3496da28cdc39061b3d70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0d0d48c1db3496da28cdc39061b3d70"}]}] May 12 07:29:27.565741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-TestMinimumBasicScenario-980371912 May 12 07:29:27.565741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: b0d0d48c1db3496da28cdc39061b3d70 May 12 07:29:27.565741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-TestMinimumBasicScenario-980371912 May 12 07:29:27.565741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-TestMinimumBasicScenario-980371912-project May 12 07:29:27.565741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:29:27.565741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:29:27.565741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: d64b5396be8944ce9fafc9034f54d55f May 12 07:29:27.565741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-TestMinimumBasicScenario-980371912-project May 12 07:29:27.565741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:29:27.565741 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance ca44b113-f00d-4b63-a964-3519c7729bd8 is not attached to volume f812d6c3-7f16-4f13-8fe6-f4a30652b158 May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'server_id': 'ca44b113-f00d-4b63-a964-3519c7729bd8', 'id': 'f812d6c3-7f16-4f13-8fe6-f4a30652b158'} May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f812d6c3-7f16-4f13-8fe6-f4a30652b158. May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:29:27.566810 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca44b113-f00d-4b63-a964-3519c7729bd8 is not attached to volume f812d6c3-7f16-4f13-8fe6-f4a30652b158 May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca44b113-f00d-4b63-a964-3519c7729bd8 is not attached to volume f812d6c3-7f16-4f13-8fe6-f4a30652b158 May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:29:27.568602 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-c940d3d9-db79-4687-a0a4-6c5830f8439a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Returning 404 to user: Instance ca44b113-f00d-4b63-a964-3519c7729bd8 is not attached to volume f812d6c3-7f16-4f13-8fe6-f4a30652b158 {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:29:27.569992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-c940d3d9-db79-4687-a0a4-6c5830f8439a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/os-volume_attachments/f812d6c3-7f16-4f13-8fe6-f4a30652b158" status: 404 len: 154 microversion: 2.1 time: 0.095663 May 12 07:29:27.569992 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1679/3261] 10.222.0.25 () {58 vars in 1415 bytes} [Thu May 12 07:29:27 2022] DELETE /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8/os-volume_attachments/f812d6c3-7f16-4f13-8fe6-f4a30652b158 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:29:28.855850 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-2b82deb9-bb46-448a-9f3f-9c029a83c32a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:29:28.856349 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2b82deb9-bb46-448a-9f3f-9c029a83c32a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:29:28.862466 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b82deb9-bb46-448a-9f3f-9c029a83c32a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:28.862914 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b82deb9-bb46-448a-9f3f-9c029a83c32a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:28.863664 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b82deb9-bb46-448a-9f3f-9c029a83c32a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:28.864116 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-2b82deb9-bb46-448a-9f3f-9c029a83c32a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:28.888304 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-2b82deb9-bb46-448a-9f3f-9c029a83c32a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Going to try to terminate instance {{(pid=124024) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 07:29:29.176429 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-2b82deb9-bb46-448a-9f3f-9c029a83c32a tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 204 len: 0 microversion: 2.1 time: 0.324016 May 12 07:29:29.176962 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1583/3262] 10.222.0.25 () {58 vars in 1238 bytes} [Thu May 12 07:29:28 2022] DELETE /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 07:29:29.185917 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-ebcb026e-79a6-4c2b-bf18-d3592af15f7e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:29:29.186544 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-ebcb026e-79a6-4c2b-bf18-d3592af15f7e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:29:29.192881 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebcb026e-79a6-4c2b-bf18-d3592af15f7e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:29.196522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebcb026e-79a6-4c2b-bf18-d3592af15f7e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:29.196522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebcb026e-79a6-4c2b-bf18-d3592af15f7e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:29.196522 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-ebcb026e-79a6-4c2b-bf18-d3592af15f7e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:29.322949 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.policy [None req-ebcb026e-79a6-4c2b-bf18-d3592af15f7e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124025) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:29:29.330295 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-ebcb026e-79a6-4c2b-bf18-d3592af15f7e tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1554 microversion: 2.1 time: 0.148176 May 12 07:29:29.330862 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1680/3263] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:29:29 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:29:30.348265 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-0ef6898e-b4d6-445f-8e01-224e514d3248 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:29:30.348889 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-0ef6898e-b4d6-445f-8e01-224e514d3248 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:29:30.355191 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ef6898e-b4d6-445f-8e01-224e514d3248 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:30.355633 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ef6898e-b4d6-445f-8e01-224e514d3248 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:30.356426 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ef6898e-b4d6-445f-8e01-224e514d3248 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:30.356866 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-0ef6898e-b4d6-445f-8e01-224e514d3248 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:30.484623 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-0ef6898e-b4d6-445f-8e01-224e514d3248 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:29:30.492053 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-0ef6898e-b4d6-445f-8e01-224e514d3248 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1554 microversion: 2.1 time: 0.148088 May 12 07:29:30.493201 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1584/3264] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:29:30 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:29:31.440617 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [req-42167594-ef22-4699-9a92-21b2373dab69 req-50f54d01-8818-4ee4-9f92-eb523984a691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca44b113-f00d-4b63-a964-3519c7729bd8", "name": "network-vif-deleted", "tag": "1e73df73-0147-48ef-9205-4182d6bf68ca"}]} {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 07:29:31.449640 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-42167594-ef22-4699-9a92-21b2373dab69 req-50f54d01-8818-4ee4-9f92-eb523984a691 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:31.450089 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [req-42167594-ef22-4699-9a92-21b2373dab69 req-50f54d01-8818-4ee4-9f92-eb523984a691 service nova] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:31.461838 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.compute.server_external_events [req-42167594-ef22-4699-9a92-21b2373dab69 req-50f54d01-8818-4ee4-9f92-eb523984a691 service nova] Creating event network-vif-deleted:1e73df73-0147-48ef-9205-4182d6bf68ca for instance ca44b113-f00d-4b63-a964-3519c7729bd8 on hv-cinder-76606 May 12 07:29:31.466717 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [req-42167594-ef22-4699-9a92-21b2373dab69 req-50f54d01-8818-4ee4-9f92-eb523984a691 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029794 May 12 07:29:31.467499 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1681/3265] 10.222.0.25 () {64 vars in 1317 bytes} [Thu May 12 07:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 07:29:31.510132 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-a1cb6825-b970-4a9a-9f42-f42ba1264633 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:29:31.510746 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.compute.api [None req-a1cb6825-b970-4a9a-9f42-f42ba1264633 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124024) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:29:31.517266 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a1cb6825-b970-4a9a-9f42-f42ba1264633 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:31.517718 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a1cb6825-b970-4a9a-9f42-f42ba1264633 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:31.518543 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a1cb6825-b970-4a9a-9f42-f42ba1264633 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:31.519036 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG oslo_concurrency.lockutils [None req-a1cb6825-b970-4a9a-9f42-f42ba1264633 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:31.579121 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.policy [None req-a1cb6825-b970-4a9a-9f42-f42ba1264633 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64b5396be8944ce9fafc9034f54d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d0d48c1db3496da28cdc39061b3d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124024) authorize /opt/stack/nova/nova/policy.py:199}} May 12 07:29:31.587110 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-a1cb6825-b970-4a9a-9f42-f42ba1264633 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 200 len: 1512 microversion: 2.1 time: 0.081334 May 12 07:29:31.587667 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1585/3266] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:29:31 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 1512 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 07:29:32.606038 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3e95dd4b-61fd-4e23-b535-9f8fa8d8a2fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:29:32.606742 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.compute.api [None req-3e95dd4b-61fd-4e23-b535-9f8fa8d8a2fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] [instance: ca44b113-f00d-4b63-a964-3519c7729bd8] Fetching instance by UUID {{(pid=124025) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 07:29:32.612928 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e95dd4b-61fd-4e23-b535-9f8fa8d8a2fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:32.613392 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e95dd4b-61fd-4e23-b535-9f8fa8d8a2fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:32.614230 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e95dd4b-61fd-4e23-b535-9f8fa8d8a2fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 07:29:32.614677 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG oslo_concurrency.lockutils [None req-3e95dd4b-61fd-4e23-b535-9f8fa8d8a2fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Lock "89bbc1cc-c01d-4f55-aea8-f3ec32bb7b58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 07:29:32.628165 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.wsgi [None req-3e95dd4b-61fd-4e23-b535-9f8fa8d8a2fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] HTTP exception thrown: Instance ca44b113-f00d-4b63-a964-3519c7729bd8 could not be found. May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3e95dd4b-61fd-4e23-b535-9f8fa8d8a2fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Request method failure captured: May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: request: GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 HTTP/1.1 May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept: application/json May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Accept-Encoding: identity May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Connection: close May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Length: 0 May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Content-Type: application/json May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Host: 10.222.0.25 May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Openstack-System-Scope: None May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: User-Agent: python-urllib3/1.26.9 May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Auth-Token: gAAAAABifLbU4uuniUnUKKjFj1rsTIH2RZgGJIFLdTLcS72O-KvkyRpViDNUsQSbkVs9mqFJ4fhCzmTm_jVgJzXOFIafS2DMsXOlI-97dC6hphKsjd51v12OsD18AOR1xL93t7FxA9Lchhwjvl6CXB7tw-iEOUHkdz6d7B6zAqzrnOzS3nD1SL8 May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Id: None May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Domain-Name: None May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Identity-Status: Confirmed May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Is-Admin-Project: True May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Id: default May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Domain-Name: Default May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Id: b0d0d48c1db3496da28cdc39061b3d70 May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Project-Name: tempest-TestMinimumBasicScenario-980371912 May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Role: reader,member May 12 07:29:32.633121 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Roles: reader,member May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0d0d48c1db3496da28cdc39061b3d70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0d0d48c1db3496da28cdc39061b3d70", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0d0d48c1db3496da28cdc39061b3d70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0d0d48c1db3496da28cdc39061b3d70"}]}] May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant: tempest-TestMinimumBasicScenario-980371912 May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Id: b0d0d48c1db3496da28cdc39061b3d70 May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-Tenant-Name: tempest-TestMinimumBasicScenario-980371912 May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User: tempest-TestMinimumBasicScenario-980371912-project May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Id: default May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Domain-Name: Default May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Id: d64b5396be8944ce9fafc9034f54d55f May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: X-User-Name: tempest-TestMinimumBasicScenario-980371912-project May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: method: > May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: exception: Instance ca44b113-f00d-4b63-a964-3519c7729bd8 could not be found. May 12 07:29:32.635056 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: action_args: {'id': 'ca44b113-f00d-4b63-a964-3519c7729bd8'} May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca44b113-f00d-4b63-a964-3519c7729bd8 could not be found. May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 07:29:32.636005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca44b113-f00d-4b63-a964-3519c7729bd8 could not be found. May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca44b113-f00d-4b63-a964-3519c7729bd8 could not be found. May 12 07:29:32.638182 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR nova.api.openstack.wsgi May 12 07:29:32.639782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-3e95dd4b-61fd-4e23-b535-9f8fa8d8a2fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Returning 404 to user: Instance ca44b113-f00d-4b63-a964-3519c7729bd8 could not be found. {{(pid=124025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 07:29:32.639782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-3e95dd4b-61fd-4e23-b535-9f8fa8d8a2fb tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8" status: 404 len: 111 microversion: 2.1 time: 0.030769 May 12 07:29:32.639782 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1682/3267] 10.222.0.25 () {58 vars in 1235 bytes} [Thu May 12 07:29:32 2022] GET /compute/v2.1/servers/ca44b113-f00d-4b63-a964-3519c7729bd8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 07:29:32.640084 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: DEBUG nova.api.openstack.wsgi [None req-e3c60693-5242-4389-8af4-51b29301fa48 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] Calling method '.version_select at 0x7f89df4d7c10>' {{(pid=124024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:29:32.725697 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO nova.api.openstack.requestlog [None req-e3c60693-5242-4389-8af4-51b29301fa48 tempest-TestMinimumBasicScenario-980371912 tempest-TestMinimumBasicScenario-980371912-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1782714850" status: 202 len: 0 microversion: 2.1 time: 0.089404 May 12 07:29:32.726285 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: [pid: 124024|app: 0|req: 1586/3268] 10.222.0.25 () {58 vars in 1271 bytes} [Thu May 12 07:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1782714850 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:30:01.073005 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:30:01.073475 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:30:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:30:12.682559 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:30:12.683129 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:30:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:31:56.618575 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:31:56.619115 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:31:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:32:10.082052 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:32:10.082652 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:32:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:32:28.262686 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a2352a08-81ca-4005-bfce-9180f48d8a85] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 12 07:32:28.272075 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: DEBUG nova.api.openstack.wsgi [None req-0ef3b784-b744-4eda-a26c-a191ecd761d4 tempest-TestVolumeBootPattern-728057823 tempest-TestVolumeBootPattern-728057823-project] Calling method '.version_select at 0x7f89da4a9670>' {{(pid=124025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 07:32:28.339649 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO nova.api.openstack.requestlog [None req-0ef3b784-b744-4eda-a26c-a191ecd761d4 tempest-TestVolumeBootPattern-728057823 tempest-TestVolumeBootPattern-728057823-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1041594724" status: 202 len: 0 microversion: 2.1 time: 0.078797 May 12 07:32:28.340250 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: [pid: 124025|app: 0|req: 1683/3269] 10.222.0.25 () {58 vars in 1262 bytes} [Thu May 12 07:32:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1041594724 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 07:33:21.081254 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:33:21.081754 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:35:10.064935 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:35:10.065353 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:35:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:35:12.693211 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:35:12.693744 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:35:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:35:16.626770 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:35:16.627340 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:35:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:35:25.285769 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:35:25.286251 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:35:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:35:30.089959 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:35:30.090391 dv-cinder-766064-5-iscsi devstack@n-api.service[124024]: Thu May 12 07:35:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 07:36:41.089998 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 07:36:41.090437 dv-cinder-766064-5-iscsi devstack@n-api.service[124025]: Thu May 12 07:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!